Nov 28 16:55:14 user nova-compute[75246]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75246) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 16:55:14 user nova-compute[75246]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75246) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 16:55:14 user nova-compute[75246]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75246) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 16:55:14 user nova-compute[75246]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 28 16:55:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:55:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.023s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:55:15 user nova-compute[75246]: INFO nova.virt.driver [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 28 16:55:15 user nova-compute[75246]: INFO nova.compute.provider_config [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] Acquiring lock "singleton_lock" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] Acquired lock "singleton_lock" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] Releasing lock "singleton_lock" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] Full set of CONF: {{(pid=75246) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ******************************************************************************** {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] Configuration options gathered from: {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ================================================================================ {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] allow_resize_to_same_host      = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] arq_binding_timeout            = 300 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] backdoor_port                  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] backdoor_socket                = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] block_device_allocate_retries  = 300 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] block_device_allocate_retries_interval = 5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cert                           = self.pem {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] compute_monitors               = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] config_dir                     = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] config_drive_format            = iso9660 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] config_source                  = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] console_host                   = user {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] control_exchange               = nova {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cpu_allocation_ratio           = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] daemon                         = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] debug                          = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] default_access_ip_network_name = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] default_availability_zone      = nova {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] default_ephemeral_format       = ext4 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] default_green_pool_size        = 1000 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] default_schedule_zone          = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] disk_allocation_ratio          = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] enable_new_services            = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] enabled_ssl_apis               = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] flat_injected                  = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] force_config_drive             = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] force_raw_images               = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] graceful_shutdown_timeout      = 5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] heal_instance_info_cache_interval = 60 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] host                           = user {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] instance_build_timeout         = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] instance_delete_interval       = 300 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] instance_name_template         = instance-%08x {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] instance_usage_audit           = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] instance_usage_audit_period    = month {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] internal_service_availability_zone = internal {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] key                            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] live_migration_retry_count     = 30 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] log_config_append              = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] log_dir                        = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] log_file                       = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] log_options                    = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] log_rotate_interval            = 1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] log_rotate_interval_type       = days {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] log_rotation_type              = none {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] long_rpc_timeout               = 1800 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] max_concurrent_builds          = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] max_concurrent_live_migrations = 1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] max_concurrent_snapshots       = 5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] max_local_block_devices        = 3 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] max_logfile_count              = 30 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] max_logfile_size_mb            = 200 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] maximum_instance_delete_attempts = 5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] metadata_listen                = 0.0.0.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] metadata_listen_port           = 8775 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] metadata_workers               = 3 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] migrate_max_retries            = -1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] mkisofs_cmd                    = genisoimage {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] my_ip                          = 10.0.0.210 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] network_allocate_retries       = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] osapi_compute_listen_port      = 8774 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] osapi_compute_unique_server_name_scope =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] osapi_compute_workers          = 3 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] password_length                = 12 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] periodic_enable                = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] periodic_fuzzy_delay           = 60 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] pointer_model                  = ps2mouse {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] preallocate_images             = none {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] publish_errors                 = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] pybasedir                      = /opt/stack/nova {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ram_allocation_ratio           = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] rate_limit_burst               = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] rate_limit_except_level        = CRITICAL {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] rate_limit_interval            = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] reboot_timeout                 = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] reclaim_instance_interval      = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] record                         = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] reimage_timeout_per_gb         = 60 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] report_interval                = 120 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] rescue_timeout                 = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] reserved_host_cpus             = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] reserved_host_disk_mb          = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] reserved_host_memory_mb        = 512 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] reserved_huge_pages            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] resize_confirm_window          = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] resize_fs_using_block_device   = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] resume_guests_state_on_host_boot = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] rpc_response_timeout           = 60 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] run_external_periodic_tasks    = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] running_deleted_instance_action = reap {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] running_deleted_instance_timeout = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] scheduler_instance_sync_interval = 120 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] service_down_time              = 720 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] servicegroup_driver            = db {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] shelved_offload_time           = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] shelved_poll_interval          = 3600 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] shutdown_timeout               = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] source_is_ipv6                 = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ssl_only                       = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] state_path                     = /opt/stack/data/nova {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] sync_power_state_interval      = 600 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] sync_power_state_pool_size     = 1000 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] syslog_log_facility            = LOG_USER {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] tempdir                        = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] timeout_nbd                    = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] transport_url                  = **** {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] update_resources_interval      = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] use_cow_images                 = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] use_eventlog                   = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] use_journal                    = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] use_json                       = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] use_rootwrap_daemon            = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] use_stderr                     = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] use_syslog                     = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vcpu_pin_set                   = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vif_plugging_is_fatal          = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vif_plugging_timeout           = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] virt_mkfs                      = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] volume_usage_poll_interval     = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] watch_log_file                 = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] web                            = /usr/share/spice-html5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_concurrency.disable_process_locking = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.auth_strategy              = keystone {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.compute_link_prefix        = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.dhcp_domain                = novalocal {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.enable_instance_password   = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.glance_link_prefix         = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.instance_list_per_project_cells = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.list_records_by_skipping_down_cells = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.local_metadata_per_cell    = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.max_limit                  = 1000 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.metadata_cache_expiration  = 15 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.neutron_default_tenant_id  = default {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.use_forwarded_for          = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.use_neutron_default_nets   = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.vendordata_dynamic_targets = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.vendordata_jsonfile_path   = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.backend_argument         = **** {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.config_prefix            = cache.oslo {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.dead_timeout             = 60.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.debug_cache_backend      = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.enable_retry_client      = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.enable_socket_keepalive  = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.enabled                  = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.expiration_time          = 600 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.hashclient_retry_attempts = 2 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.memcache_dead_retry      = 300 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.memcache_password        =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.memcache_sasl_enabled    = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.memcache_username        =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.proxies                  = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.retry_attempts           = 2 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.retry_delay              = 0.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.socket_keepalive_count   = 1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.socket_keepalive_idle    = 1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.socket_keepalive_interval = 1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.tls_allowed_ciphers      = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.tls_cafile               = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.tls_certfile             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.tls_enabled              = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cache.tls_keyfile              = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cinder.auth_section            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cinder.auth_type               = password {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cinder.cafile                  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cinder.certfile                = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cinder.collect_timing          = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cinder.cross_az_attach         = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cinder.debug                   = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cinder.endpoint_template       = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cinder.http_retries            = 3 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cinder.insecure                = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cinder.keyfile                 = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cinder.os_region_name          = RegionOne {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cinder.split_loggers           = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cinder.timeout                 = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] compute.cpu_dedicated_set      = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] compute.cpu_shared_set         = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] compute.image_type_exclude_list = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] compute.resource_provider_association_refresh = 300 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] compute.shutdown_retry_interval = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] conductor.workers              = 3 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] console.allowed_origins        = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] console.ssl_ciphers            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] console.ssl_minimum_version    = default {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] consoleauth.token_ttl          = 600 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.cafile                  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.certfile                = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.collect_timing          = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.connect_retries         = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.connect_retry_delay     = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.endpoint_override       = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.insecure                = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.keyfile                 = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.max_version             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.min_version             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.region_name             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.service_name            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.service_type            = accelerator {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.split_loggers           = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.status_code_retries     = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.status_code_retry_delay = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.timeout                 = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] cyborg.version                 = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.backend               = sqlalchemy {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.connection            = **** {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.connection_debug      = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.connection_parameters =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.connection_recycle_time = 3600 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.connection_trace      = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.db_inc_retry_interval = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.db_max_retries        = 20 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.db_max_retry_interval = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.db_retry_interval     = 1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.max_overflow          = 50 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.max_pool_size         = 5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.max_retries           = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.mysql_wsrep_sync_wait = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.pool_timeout          = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.retry_interval        = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.slave_connection      = **** {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] database.sqlite_synchronous    = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.backend           = sqlalchemy {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.connection        = **** {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.connection_debug  = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.connection_parameters =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.connection_recycle_time = 3600 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.connection_trace  = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.db_inc_retry_interval = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.db_max_retries    = 20 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.db_max_retry_interval = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.db_retry_interval = 1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.max_overflow      = 50 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.max_pool_size     = 5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.max_retries       = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.pool_timeout      = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.retry_interval    = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.slave_connection  = **** {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] api_database.sqlite_synchronous = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] devices.enabled_mdev_types     = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ephemeral_storage_encryption.enabled = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.api_servers             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.cafile                  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.certfile                = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.collect_timing          = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.connect_retries         = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.connect_retry_delay     = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.debug                   = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.default_trusted_certificate_ids = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.enable_certificate_validation = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.enable_rbd_download     = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.endpoint_override       = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.insecure                = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.keyfile                 = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.max_version             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.min_version             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.num_retries             = 3 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.rbd_ceph_conf           =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.rbd_connect_timeout     = 5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.rbd_pool                =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.rbd_user                =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.region_name             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.service_name            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.service_type            = image {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.split_loggers           = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.status_code_retries     = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.status_code_retry_delay = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.timeout                 = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.verify_glance_signatures = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] glance.version                 = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] guestfs.debug                  = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] hyperv.config_drive_cdrom      = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] hyperv.config_drive_inject_password = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] hyperv.enable_remotefx         = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] hyperv.instances_path_share    =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] hyperv.limit_cpu_features      = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] hyperv.use_multipath_io        = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] hyperv.vswitch_name            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] mks.enabled                    = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] image_cache.manager_interval   = 2400 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] image_cache.precache_concurrency = 1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] image_cache.remove_unused_base_images = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] image_cache.subdirectory_name  = _base {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.api_max_retries         = 60 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.api_retry_interval      = 2 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.auth_section            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.auth_type               = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.cafile                  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.certfile                = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.collect_timing          = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.conductor_group         = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.connect_retries         = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.connect_retry_delay     = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.endpoint_override       = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.insecure                = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.keyfile                 = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.max_version             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.min_version             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.peer_list               = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.region_name             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.serial_console_state_timeout = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.service_name            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.service_type            = baremetal {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.split_loggers           = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.status_code_retries     = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.status_code_retry_delay = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.timeout                 = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ironic.version                 = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] key_manager.fixed_key          = **** {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican.barbican_api_version  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican.barbican_endpoint     = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican.barbican_endpoint_type = public {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican.barbican_region_name  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican.cafile                = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican.certfile              = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican.collect_timing        = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican.insecure              = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican.keyfile               = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican.number_of_retries     = 60 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican.retry_delay           = 1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican.send_service_user_token = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican.split_loggers         = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican.timeout               = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican.verify_ssl            = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican.verify_ssl_path       = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican_service_user.auth_section = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican_service_user.auth_type = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican_service_user.cafile   = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican_service_user.certfile = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican_service_user.collect_timing = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican_service_user.insecure = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican_service_user.keyfile  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican_service_user.split_loggers = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] barbican_service_user.timeout  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vault.approle_role_id          = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vault.approle_secret_id        = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vault.cafile                   = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vault.certfile                 = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vault.collect_timing           = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vault.insecure                 = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vault.keyfile                  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vault.kv_mountpoint            = secret {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vault.kv_path                  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vault.kv_version               = 2 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vault.namespace                = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vault.root_token_id            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vault.split_loggers            = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vault.ssl_ca_crt_file          = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vault.timeout                  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vault.use_ssl                  = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.auth_section          = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.auth_type             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.cafile                = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.certfile              = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.collect_timing        = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.connect_retries       = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.connect_retry_delay   = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.endpoint_override     = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.insecure              = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.keyfile               = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.max_version           = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.min_version           = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.region_name           = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.service_name          = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.service_type          = identity {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.split_loggers         = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.status_code_retries   = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.status_code_retry_delay = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.timeout               = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] keystone.version               = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.connection_uri         =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.cpu_mode               = custom {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: WARNING oslo_config.cfg [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.cpu_power_governor_high = performance {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.cpu_power_management   = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.device_detach_attempts = 8 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.device_detach_timeout  = 20 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.disk_cachemodes        = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.disk_prefix            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.enabled_perf_events    = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.file_backed_memory     = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.gid_maps               = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.hw_disk_discard        = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.hw_machine_type        = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.images_rbd_pool        = rbd {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.images_type            = default {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.images_volume_group    = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.inject_key             = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.inject_partition       = -2 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.inject_password        = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.iscsi_iface            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.iser_use_multipath     = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.live_migration_downtime = 500 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.live_migration_inbound_addr = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.live_migration_scheme  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.live_migration_timeout_action = abort {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.live_migration_tunnelled = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: WARNING oslo_config.cfg [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 28 16:55:15 user nova-compute[75246]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 28 16:55:15 user nova-compute[75246]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 28 16:55:15 user nova-compute[75246]: and ``live_migration_inbound_addr`` respectively.
Nov 28 16:55:15 user nova-compute[75246]: ).  Its value may be silently ignored in the future.
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.live_migration_with_native_tls = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.max_queues             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.nfs_mount_options      = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.num_pcie_ports         = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.pmem_namespaces        = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.quobyte_client_cfg     = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.rbd_secret_uuid        = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.rbd_user               = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.rescue_image_id        = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.rescue_kernel_id       = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.rx_queue_size          = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.smbfs_mount_options    =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.snapshot_compression   = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.snapshot_image_format  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.sparse_logical_volumes = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.swtpm_enabled          = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.swtpm_group            = tss {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.swtpm_user             = tss {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.sysinfo_serial         = unique {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.tb_cache_size          = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.tx_queue_size          = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.uid_maps               = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.use_virtio_for_bridges = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.virt_type              = kvm {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.volume_clear           = zero {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.volume_clear_size      = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.volume_use_multipath   = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.vzstorage_cache_path   = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.auth_section           = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.auth_type              = password {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.cafile                 = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.certfile               = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.collect_timing         = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.connect_retries        = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.connect_retry_delay    = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.default_floating_pool  = public {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.endpoint_override      = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.extension_sync_interval = 600 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.http_retries           = 3 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.insecure               = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.keyfile                = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.max_version            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.min_version            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.ovs_bridge             = br-int {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.physnets               = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.region_name            = RegionOne {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.service_metadata_proxy = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.service_name           = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.service_type           = network {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.split_loggers          = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.status_code_retries    = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.status_code_retry_delay = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.timeout                = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] neutron.version                = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] notifications.bdms_in_notifications = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] notifications.default_level    = INFO {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] notifications.notification_format = unversioned {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] notifications.notify_on_state_change = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] pci.alias                      = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] pci.device_spec                = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] pci.report_in_placement        = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.auth_section         = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.auth_type            = password {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.cafile               = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.certfile             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.collect_timing       = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.connect_retries      = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.connect_retry_delay  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.default_domain_id    = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.default_domain_name  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.domain_id            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.domain_name          = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.endpoint_override    = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.insecure             = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.keyfile              = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.max_version          = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.min_version          = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.password             = **** {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.project_domain_id    = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.project_domain_name  = Default {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.project_id           = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.project_name         = service {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.region_name          = RegionOne {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.service_name         = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.service_type         = placement {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.split_loggers        = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.status_code_retries  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.status_code_retry_delay = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.system_scope         = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.timeout              = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.trust_id             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.user_domain_id       = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.user_domain_name     = Default {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.user_id              = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.username             = placement {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] placement.version              = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] quota.cores                    = 20 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] quota.count_usage_from_placement = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] quota.injected_file_content_bytes = 10240 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] quota.injected_file_path_length = 255 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] quota.injected_files           = 5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] quota.instances                = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] quota.key_pairs                = 100 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] quota.metadata_items           = 128 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] quota.ram                      = 51200 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] quota.recheck_quota            = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] quota.server_group_members     = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] quota.server_groups            = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] rdp.enabled                    = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] scheduler.image_metadata_prefilter = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] scheduler.max_attempts         = 3 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] scheduler.max_placement_results = 1000 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] scheduler.workers              = 3 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.host_subset_size = 1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.isolated_hosts = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.isolated_images = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.pci_in_placement = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.track_instance_changes = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] metrics.required               = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] metrics.weight_multiplier      = 1.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] metrics.weight_setting         = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] serial_console.enabled         = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] serial_console.port_range      = 10000:20000 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] serial_console.serialproxy_port = 6083 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] service_user.auth_section      = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] service_user.auth_type         = password {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] service_user.cafile            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] service_user.certfile          = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] service_user.collect_timing    = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] service_user.insecure          = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] service_user.keyfile           = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] service_user.send_service_user_token = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] service_user.split_loggers     = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] service_user.timeout           = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] spice.agent_enabled            = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] spice.enabled                  = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] spice.html5proxy_port          = 6082 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] spice.image_compression        = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] spice.jpeg_compression         = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] spice.playback_compression     = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] spice.server_listen            = 127.0.0.1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] spice.streaming_mode           = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] spice.zlib_compression         = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] upgrade_levels.baseapi         = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] upgrade_levels.compute         = auto {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] upgrade_levels.conductor       = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] upgrade_levels.scheduler       = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vendordata_dynamic_auth.cafile = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vendordata_dynamic_auth.certfile = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vendordata_dynamic_auth.insecure = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vendordata_dynamic_auth.timeout = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.api_retry_count         = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.ca_file                 = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.cache_prefix            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.cluster_name            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.connection_pool_size    = 10 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.console_delay_seconds   = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.datastore_regex         = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.host_ip                 = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.host_password           = **** {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.host_port               = 443 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.host_username           = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.insecure                = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.integration_bridge      = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.maximum_objects         = 100 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.pbm_default_policy      = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.pbm_enabled             = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.pbm_wsdl_location       = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.serial_port_proxy_uri   = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.serial_port_service_uri = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.task_poll_interval      = 0.5 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.use_linked_clone        = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.vnc_keymap              = en-us {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.vnc_port                = 5900 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vmware.vnc_port_total          = 10000 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vnc.auth_schemes               = ['none'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vnc.enabled                    = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vnc.novncproxy_port            = 6080 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vnc.vencrypt_ca_certs          = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vnc.vencrypt_client_cert       = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vnc.vencrypt_client_key        = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.disable_rootwrap   = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.enable_numa_live_migration = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.libvirt_disable_apic = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] wsgi.client_socket_timeout     = 900 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] wsgi.default_pool_size         = 1000 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] wsgi.keep_alive                = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] wsgi.max_header_line           = 16384 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] wsgi.ssl_ca_file               = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] wsgi.ssl_cert_file             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] wsgi.ssl_key_file              = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] wsgi.tcp_keepidle              = 600 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] zvm.ca_file                    = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] zvm.cloud_connector_url        = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] zvm.reachable_timeout          = 300 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_policy.enforce_new_defaults = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_policy.enforce_scope      = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_policy.policy_default_rule = default {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] profiler.connection_string     = messaging:// {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] profiler.enabled               = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] profiler.es_doc_type           = notification {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] profiler.es_scroll_size        = 10000 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] profiler.es_scroll_time        = 2m {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] profiler.filter_error_trace    = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] profiler.hmac_keys             = **** {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] profiler.sentinel_service_name = mymaster {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] profiler.socket_timeout        = 0.1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] profiler.trace_requests        = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] profiler.trace_sqlalchemy      = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] profiler_jaeger.process_tags   = {} {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] profiler_jaeger.service_name_prefix = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] profiler_otlp.service_name_prefix = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] remote_debug.host              = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] remote_debug.port              = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_notifications.retry = -1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.auth_section        = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.auth_type           = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.cafile              = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.certfile            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.collect_timing      = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.connect_retries     = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.connect_retry_delay = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.endpoint_id         = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.endpoint_override   = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.insecure            = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.keyfile             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.max_version         = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.min_version         = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.region_name         = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.service_name        = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.service_type        = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.split_loggers       = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.status_code_retries = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.status_code_retry_delay = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.timeout             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.valid_interfaces    = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_limit.version             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_reports.file_event_handler = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] oslo_reports.log_dir           = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vif_plug_ovs_privileged.group  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] vif_plug_ovs_privileged.user   = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] os_vif_ovs.isolate_vif         = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] os_brick.lock_path             = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] privsep_osbrick.capabilities   = [21] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] privsep_osbrick.group          = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] privsep_osbrick.helper_command = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] privsep_osbrick.user           = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] nova_sys_admin.group           = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] nova_sys_admin.helper_command  = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] nova_sys_admin.user            = None {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG oslo_service.service [None req-94b82385-f1fb-4460-9e65-7f3a61c16706 None None] ******************************************************************************** {{(pid=75246) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 28 16:55:15 user nova-compute[75246]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 28 16:55:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Connecting to libvirt: qemu:///system {{(pid=75246) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fb4f8c263e0> {{(pid=75246) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 28 16:55:15 user nova-compute[75246]: libvirt:  error : internal error: could not initialize domain event timer
Nov 28 16:55:15 user nova-compute[75246]: WARNING nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 28 16:55:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fb4f8c263e0> {{(pid=75246) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Starting native event thread {{(pid=75246) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Starting green dispatch thread {{(pid=75246) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 28 16:55:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Starting connection event dispatch thread {{(pid=75246) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 28 16:55:15 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Connection event '1' reason 'None'
Nov 28 16:55:15 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 28 16:55:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.mount [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Initialising _HostMountState generation 0 {{(pid=75246) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 28 16:55:22 user nova-compute[75246]: INFO nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Libvirt host capabilities <capabilities>
Nov 28 16:55:22 user nova-compute[75246]:   <host>
Nov 28 16:55:22 user nova-compute[75246]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 28 16:55:22 user nova-compute[75246]:     <cpu>
Nov 28 16:55:22 user nova-compute[75246]:       <arch>x86_64</arch>
Nov 28 16:55:22 user nova-compute[75246]:       <model>IvyBridge-IBRS</model>
Nov 28 16:55:22 user nova-compute[75246]:       <vendor>Intel</vendor>
Nov 28 16:55:22 user nova-compute[75246]:       <microcode version='1070'/>
Nov 28 16:55:22 user nova-compute[75246]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 28 16:55:22 user nova-compute[75246]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 28 16:55:22 user nova-compute[75246]:       <feature name='ss'/>
Nov 28 16:55:22 user nova-compute[75246]:       <feature name='vmx'/>
Nov 28 16:55:22 user nova-compute[75246]:       <feature name='pcid'/>
Nov 28 16:55:22 user nova-compute[75246]:       <feature name='osxsave'/>
Nov 28 16:55:22 user nova-compute[75246]:       <feature name='hypervisor'/>
Nov 28 16:55:22 user nova-compute[75246]:       <feature name='arat'/>
Nov 28 16:55:22 user nova-compute[75246]:       <feature name='tsc_adjust'/>
Nov 28 16:55:22 user nova-compute[75246]:       <feature name='md-clear'/>
Nov 28 16:55:22 user nova-compute[75246]:       <feature name='stibp'/>
Nov 28 16:55:22 user nova-compute[75246]:       <feature name='arch-capabilities'/>
Nov 28 16:55:22 user nova-compute[75246]:       <feature name='ssbd'/>
Nov 28 16:55:22 user nova-compute[75246]:       <feature name='invtsc'/>
Nov 28 16:55:22 user nova-compute[75246]:       <feature name='rsba'/>
Nov 28 16:55:22 user nova-compute[75246]:       <feature name='skip-l1dfl-vmentry'/>
Nov 28 16:55:22 user nova-compute[75246]:       <pages unit='KiB' size='4'/>
Nov 28 16:55:22 user nova-compute[75246]:       <pages unit='KiB' size='2048'/>
Nov 28 16:55:22 user nova-compute[75246]:     </cpu>
Nov 28 16:55:22 user nova-compute[75246]:     <power_management>
Nov 28 16:55:22 user nova-compute[75246]:       <suspend_mem/>
Nov 28 16:55:22 user nova-compute[75246]:       <suspend_disk/>
Nov 28 16:55:22 user nova-compute[75246]:       <suspend_hybrid/>
Nov 28 16:55:22 user nova-compute[75246]:     </power_management>
Nov 28 16:55:22 user nova-compute[75246]:     <iommu support='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     <migration_features>
Nov 28 16:55:22 user nova-compute[75246]:       <live/>
Nov 28 16:55:22 user nova-compute[75246]:       <uri_transports>
Nov 28 16:55:22 user nova-compute[75246]:         <uri_transport>tcp</uri_transport>
Nov 28 16:55:22 user nova-compute[75246]:         <uri_transport>rdma</uri_transport>
Nov 28 16:55:22 user nova-compute[75246]:       </uri_transports>
Nov 28 16:55:22 user nova-compute[75246]:     </migration_features>
Nov 28 16:55:22 user nova-compute[75246]:     <topology>
Nov 28 16:55:22 user nova-compute[75246]:       <cells num='2'>
Nov 28 16:55:22 user nova-compute[75246]:         <cell id='0'>
Nov 28 16:55:22 user nova-compute[75246]:           <memory unit='KiB'>8189224</memory>
Nov 28 16:55:22 user nova-compute[75246]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 28 16:55:22 user nova-compute[75246]:           <pages unit='KiB' size='2048'>0</pages>
Nov 28 16:55:22 user nova-compute[75246]:           <distances>
Nov 28 16:55:22 user nova-compute[75246]:             <sibling id='0' value='10'/>
Nov 28 16:55:22 user nova-compute[75246]:             <sibling id='1' value='20'/>
Nov 28 16:55:22 user nova-compute[75246]:           </distances>
Nov 28 16:55:22 user nova-compute[75246]:           <cpus num='6'>
Nov 28 16:55:22 user nova-compute[75246]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 28 16:55:22 user nova-compute[75246]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 28 16:55:22 user nova-compute[75246]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 28 16:55:22 user nova-compute[75246]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 28 16:55:22 user nova-compute[75246]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 28 16:55:22 user nova-compute[75246]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 28 16:55:22 user nova-compute[75246]:           </cpus>
Nov 28 16:55:22 user nova-compute[75246]:         </cell>
Nov 28 16:55:22 user nova-compute[75246]:         <cell id='1'>
Nov 28 16:55:22 user nova-compute[75246]:           <memory unit='KiB'>8206460</memory>
Nov 28 16:55:22 user nova-compute[75246]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 28 16:55:22 user nova-compute[75246]:           <pages unit='KiB' size='2048'>0</pages>
Nov 28 16:55:22 user nova-compute[75246]:           <distances>
Nov 28 16:55:22 user nova-compute[75246]:             <sibling id='0' value='20'/>
Nov 28 16:55:22 user nova-compute[75246]:             <sibling id='1' value='10'/>
Nov 28 16:55:22 user nova-compute[75246]:           </distances>
Nov 28 16:55:22 user nova-compute[75246]:           <cpus num='6'>
Nov 28 16:55:22 user nova-compute[75246]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 28 16:55:22 user nova-compute[75246]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 28 16:55:22 user nova-compute[75246]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 28 16:55:22 user nova-compute[75246]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 28 16:55:22 user nova-compute[75246]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 28 16:55:22 user nova-compute[75246]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 28 16:55:22 user nova-compute[75246]:           </cpus>
Nov 28 16:55:22 user nova-compute[75246]:         </cell>
Nov 28 16:55:22 user nova-compute[75246]:       </cells>
Nov 28 16:55:22 user nova-compute[75246]:     </topology>
Nov 28 16:55:22 user nova-compute[75246]:     <cache>
Nov 28 16:55:22 user nova-compute[75246]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 28 16:55:22 user nova-compute[75246]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 28 16:55:22 user nova-compute[75246]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 28 16:55:22 user nova-compute[75246]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 28 16:55:22 user nova-compute[75246]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 28 16:55:22 user nova-compute[75246]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 28 16:55:22 user nova-compute[75246]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 28 16:55:22 user nova-compute[75246]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 28 16:55:22 user nova-compute[75246]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 28 16:55:22 user nova-compute[75246]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 28 16:55:22 user nova-compute[75246]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 28 16:55:22 user nova-compute[75246]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 28 16:55:22 user nova-compute[75246]:     </cache>
Nov 28 16:55:22 user nova-compute[75246]:     <secmodel>
Nov 28 16:55:22 user nova-compute[75246]:       <model>apparmor</model>
Nov 28 16:55:22 user nova-compute[75246]:       <doi>0</doi>
Nov 28 16:55:22 user nova-compute[75246]:     </secmodel>
Nov 28 16:55:22 user nova-compute[75246]:     <secmodel>
Nov 28 16:55:22 user nova-compute[75246]:       <model>dac</model>
Nov 28 16:55:22 user nova-compute[75246]:       <doi>0</doi>
Nov 28 16:55:22 user nova-compute[75246]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 28 16:55:22 user nova-compute[75246]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 28 16:55:22 user nova-compute[75246]:     </secmodel>
Nov 28 16:55:22 user nova-compute[75246]:   </host>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='alpha'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>64</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>clipper</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='armv6l'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>32</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>spitz</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>nuri</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>kzm</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>sx1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>z2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>tosa</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>n810</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>n800</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>terrier</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>midway</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>microbit</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>verdex</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>highbank</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>akita</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>connex</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>collie</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='armv7l'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>32</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>spitz</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>nuri</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>kzm</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>sx1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>z2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>tosa</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>n810</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>n800</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>terrier</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>midway</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>microbit</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>verdex</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>highbank</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>akita</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>connex</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>collie</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='aarch64'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>64</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>spitz</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>nuri</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>kzm</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>sx1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>z2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>tosa</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>n810</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>n800</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>terrier</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>midway</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>microbit</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>verdex</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>raspi3b</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>highbank</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>akita</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>connex</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>collie</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <acpi default='on' toggle='yes'/>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='cris'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>32</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='i686'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>32</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>x-remote</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>isapc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>microvm</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='kvm'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <pae/>
Nov 28 16:55:22 user nova-compute[75246]:       <nonpae/>
Nov 28 16:55:22 user nova-compute[75246]:       <acpi default='on' toggle='yes'/>
Nov 28 16:55:22 user nova-compute[75246]:       <apic default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='m68k'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>32</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>an5206</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>q800</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>next-cube</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='microblaze'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>32</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='microblazeel'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>32</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='mips'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>32</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='16'>malta</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='mipsel'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>32</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='16'>malta</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='mips64'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>64</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='16'>malta</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>pica61</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>magnum</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='mips64el'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>64</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='16'>malta</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>pica61</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>magnum</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='16'>boston</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='ppc'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>32</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mac99</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>40p</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>taihu</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='ppc64'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>64</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2048'>powernv9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>taihu</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2048'>powernv10</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>40p</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mac99</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2048'>powernv8</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='ppc64le'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>64</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2048'>powernv9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>taihu</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2048'>powernv10</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>40p</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>mac99</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2048'>powernv8</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='riscv32'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>32</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='8'>spike</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>opentitan</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='5'>sifive_u</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>sifive_e</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='8'>virt</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='riscv64'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>64</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='8'>spike</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='5'>sifive_u</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>shakti_c</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>sifive_e</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='8'>virt</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='s390x'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>64</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='sh4'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>32</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>shix</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>r2d</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='sh4eb'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>64</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>shix</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>r2d</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='sparc'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>32</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>SS-5</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>SS-20</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>LX</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>SS-4</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>SS-10</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>Voyager</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='sparc64'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>64</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>sun4u</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>niagara</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>sun4v</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='x86_64'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>64</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>x-remote</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='1'>isapc</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>microvm</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:22 user nova-compute[75246]:       <domain type='kvm'/>
Nov 28 16:55:22 user nova-compute[75246]:     </arch>
Nov 28 16:55:22 user nova-compute[75246]:     <features>
Nov 28 16:55:22 user nova-compute[75246]:       <acpi default='on' toggle='yes'/>
Nov 28 16:55:22 user nova-compute[75246]:       <apic default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:22 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:22 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:22 user nova-compute[75246]:     </features>
Nov 28 16:55:22 user nova-compute[75246]:   </guest>
Nov 28 16:55:22 user nova-compute[75246]:   <guest>
Nov 28 16:55:22 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:22 user nova-compute[75246]:     <arch name='xtensa'>
Nov 28 16:55:22 user nova-compute[75246]:       <wordsize>32</wordsize>
Nov 28 16:55:22 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='4'>sim</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='32'>kc705</machine>
Nov 28 16:55:22 user nova-compute[75246]:       <machine maxCpus='32'>ml605</machine>
Nov 28 16:55:23 user nova-compute[75246]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 28 16:55:23 user nova-compute[75246]:       <machine maxCpus='32'>virt</machine>
Nov 28 16:55:23 user nova-compute[75246]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 28 16:55:23 user nova-compute[75246]:       <machine maxCpus='32'>lx200</machine>
Nov 28 16:55:23 user nova-compute[75246]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 28 16:55:23 user nova-compute[75246]:       <machine maxCpus='32'>lx60</machine>
Nov 28 16:55:23 user nova-compute[75246]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 28 16:55:23 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:23 user nova-compute[75246]:     </arch>
Nov 28 16:55:23 user nova-compute[75246]:     <features>
Nov 28 16:55:23 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:23 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:23 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:23 user nova-compute[75246]:     </features>
Nov 28 16:55:23 user nova-compute[75246]:   </guest>
Nov 28 16:55:23 user nova-compute[75246]:   <guest>
Nov 28 16:55:23 user nova-compute[75246]:     <os_type>hvm</os_type>
Nov 28 16:55:23 user nova-compute[75246]:     <arch name='xtensaeb'>
Nov 28 16:55:23 user nova-compute[75246]:       <wordsize>32</wordsize>
Nov 28 16:55:23 user nova-compute[75246]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 28 16:55:23 user nova-compute[75246]:       <machine maxCpus='4'>sim</machine>
Nov 28 16:55:23 user nova-compute[75246]:       <machine maxCpus='32'>kc705</machine>
Nov 28 16:55:23 user nova-compute[75246]:       <machine maxCpus='32'>ml605</machine>
Nov 28 16:55:23 user nova-compute[75246]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 28 16:55:23 user nova-compute[75246]:       <machine maxCpus='32'>virt</machine>
Nov 28 16:55:23 user nova-compute[75246]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 28 16:55:23 user nova-compute[75246]:       <machine maxCpus='32'>lx200</machine>
Nov 28 16:55:23 user nova-compute[75246]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 28 16:55:23 user nova-compute[75246]:       <machine maxCpus='32'>lx60</machine>
Nov 28 16:55:23 user nova-compute[75246]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 28 16:55:23 user nova-compute[75246]:       <domain type='qemu'/>
Nov 28 16:55:23 user nova-compute[75246]:     </arch>
Nov 28 16:55:23 user nova-compute[75246]:     <features>
Nov 28 16:55:23 user nova-compute[75246]:       <cpuselection/>
Nov 28 16:55:23 user nova-compute[75246]:       <deviceboot/>
Nov 28 16:55:23 user nova-compute[75246]:       <disksnapshot default='on' toggle='no'/>
Nov 28 16:55:23 user nova-compute[75246]:     </features>
Nov 28 16:55:23 user nova-compute[75246]:   </guest>
Nov 28 16:55:23 user nova-compute[75246]: </capabilities>
Nov 28 16:55:23 user nova-compute[75246]: 
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 28 16:55:23 user nova-compute[75246]: <domainCapabilities>
Nov 28 16:55:23 user nova-compute[75246]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 16:55:23 user nova-compute[75246]:   <domain>kvm</domain>
Nov 28 16:55:23 user nova-compute[75246]:   <machine>pc-i440fx-6.2</machine>
Nov 28 16:55:23 user nova-compute[75246]:   <arch>i686</arch>
Nov 28 16:55:23 user nova-compute[75246]:   <vcpu max='255'/>
Nov 28 16:55:23 user nova-compute[75246]:   <iothreads supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:   <os supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:     <enum name='firmware'/>
Nov 28 16:55:23 user nova-compute[75246]:     <loader supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='type'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>rom</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>pflash</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='readonly'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>yes</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>no</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='secure'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>no</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </loader>
Nov 28 16:55:23 user nova-compute[75246]:   </os>
Nov 28 16:55:23 user nova-compute[75246]:   <cpu>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='host-passthrough' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='hostPassthroughMigratable'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>off</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='maximum' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='maximumMigratable'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>on</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>off</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='host-model' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <vendor>Intel</vendor>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ss'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='vmx'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='pcid'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='hypervisor'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='arat'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='umip'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='md-clear'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='stibp'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ssbd'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ibpb'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ibrs'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='amd-stibp'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='erms'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='lm'/>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='custom' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>qemu64</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>qemu32</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>phenom</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium3</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium2</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>n270</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>kvm64</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>kvm32</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>coreduo</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>core2duo</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>athlon</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Westmere</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Snowridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>SandyBridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Penryn</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G5</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G4</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G3</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G2</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G1</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Nehalem</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>IvyBridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Icelake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-Rome</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-Milan</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Dhyana</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cooperlake</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Conroe</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>486</model>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:   </cpu>
Nov 28 16:55:23 user nova-compute[75246]:   <memoryBacking supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:     <enum name='sourceType'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>file</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>anonymous</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>memfd</value>
Nov 28 16:55:23 user nova-compute[75246]:     </enum>
Nov 28 16:55:23 user nova-compute[75246]:   </memoryBacking>
Nov 28 16:55:23 user nova-compute[75246]:   <devices>
Nov 28 16:55:23 user nova-compute[75246]:     <disk supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='diskDevice'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>disk</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>cdrom</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>floppy</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>lun</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='bus'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>ide</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>fdc</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>scsi</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>usb</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>sata</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-non-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </disk>
Nov 28 16:55:23 user nova-compute[75246]:     <graphics supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='type'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>sdl</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vnc</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>spice</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>egl-headless</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </graphics>
Nov 28 16:55:23 user nova-compute[75246]:     <video supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='modelType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vga</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>cirrus</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vmvga</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>qxl</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>none</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>bochs</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>ramfb</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </video>
Nov 28 16:55:23 user nova-compute[75246]:     <hostdev supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='mode'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>subsystem</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='startupPolicy'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>default</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>mandatory</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>requisite</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>optional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='subsysType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>usb</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>pci</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>scsi</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='capsType'/>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='pciBackend'/>
Nov 28 16:55:23 user nova-compute[75246]:     </hostdev>
Nov 28 16:55:23 user nova-compute[75246]:     <rng supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-non-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='backendModel'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>random</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>egd</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>builtin</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </rng>
Nov 28 16:55:23 user nova-compute[75246]:     <filesystem supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='driverType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>path</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>handle</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtiofs</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </filesystem>
Nov 28 16:55:23 user nova-compute[75246]:     <tpm supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>tpm-tis</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>tpm-crb</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='backendModel'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>passthrough</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>emulator</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </tpm>
Nov 28 16:55:23 user nova-compute[75246]:   </devices>
Nov 28 16:55:23 user nova-compute[75246]:   <features>
Nov 28 16:55:23 user nova-compute[75246]:     <gic supported='no'/>
Nov 28 16:55:23 user nova-compute[75246]:     <vmcoreinfo supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <genid supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <backingStoreInput supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <backup supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <sev supported='no'/>
Nov 28 16:55:23 user nova-compute[75246]:   </features>
Nov 28 16:55:23 user nova-compute[75246]: </domainCapabilities>
Nov 28 16:55:23 user nova-compute[75246]:  {{(pid=75246) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 28 16:55:23 user nova-compute[75246]: <domainCapabilities>
Nov 28 16:55:23 user nova-compute[75246]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 16:55:23 user nova-compute[75246]:   <domain>kvm</domain>
Nov 28 16:55:23 user nova-compute[75246]:   <machine>pc-q35-6.2</machine>
Nov 28 16:55:23 user nova-compute[75246]:   <arch>i686</arch>
Nov 28 16:55:23 user nova-compute[75246]:   <vcpu max='288'/>
Nov 28 16:55:23 user nova-compute[75246]:   <iothreads supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:   <os supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:     <enum name='firmware'/>
Nov 28 16:55:23 user nova-compute[75246]:     <loader supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='type'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>rom</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>pflash</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='readonly'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>yes</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>no</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='secure'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>no</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </loader>
Nov 28 16:55:23 user nova-compute[75246]:   </os>
Nov 28 16:55:23 user nova-compute[75246]:   <cpu>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='host-passthrough' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='hostPassthroughMigratable'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>off</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='maximum' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='maximumMigratable'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>on</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>off</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='host-model' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <vendor>Intel</vendor>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ss'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='vmx'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='pcid'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='hypervisor'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='arat'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='umip'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='md-clear'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='stibp'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ssbd'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ibpb'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ibrs'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='amd-stibp'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='erms'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='lm'/>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='custom' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>qemu64</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>qemu32</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>phenom</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium3</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium2</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>n270</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>kvm64</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>kvm32</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>coreduo</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>core2duo</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>athlon</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Westmere</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Snowridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>SandyBridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Penryn</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G5</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G4</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G3</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G2</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G1</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Nehalem</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>IvyBridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Icelake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-Rome</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-Milan</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Dhyana</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cooperlake</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Conroe</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>486</model>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:   </cpu>
Nov 28 16:55:23 user nova-compute[75246]:   <memoryBacking supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:     <enum name='sourceType'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>file</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>anonymous</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>memfd</value>
Nov 28 16:55:23 user nova-compute[75246]:     </enum>
Nov 28 16:55:23 user nova-compute[75246]:   </memoryBacking>
Nov 28 16:55:23 user nova-compute[75246]:   <devices>
Nov 28 16:55:23 user nova-compute[75246]:     <disk supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='diskDevice'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>disk</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>cdrom</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>floppy</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>lun</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='bus'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>fdc</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>scsi</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>usb</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>sata</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-non-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </disk>
Nov 28 16:55:23 user nova-compute[75246]:     <graphics supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='type'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>sdl</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vnc</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>spice</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>egl-headless</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </graphics>
Nov 28 16:55:23 user nova-compute[75246]:     <video supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='modelType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vga</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>cirrus</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vmvga</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>qxl</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>none</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>bochs</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>ramfb</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </video>
Nov 28 16:55:23 user nova-compute[75246]:     <hostdev supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='mode'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>subsystem</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='startupPolicy'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>default</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>mandatory</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>requisite</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>optional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='subsysType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>usb</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>pci</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>scsi</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='capsType'/>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='pciBackend'/>
Nov 28 16:55:23 user nova-compute[75246]:     </hostdev>
Nov 28 16:55:23 user nova-compute[75246]:     <rng supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-non-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='backendModel'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>random</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>egd</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>builtin</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </rng>
Nov 28 16:55:23 user nova-compute[75246]:     <filesystem supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='driverType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>path</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>handle</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtiofs</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </filesystem>
Nov 28 16:55:23 user nova-compute[75246]:     <tpm supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>tpm-tis</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>tpm-crb</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='backendModel'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>passthrough</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>emulator</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </tpm>
Nov 28 16:55:23 user nova-compute[75246]:   </devices>
Nov 28 16:55:23 user nova-compute[75246]:   <features>
Nov 28 16:55:23 user nova-compute[75246]:     <gic supported='no'/>
Nov 28 16:55:23 user nova-compute[75246]:     <vmcoreinfo supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <genid supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <backingStoreInput supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <backup supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <sev supported='no'/>
Nov 28 16:55:23 user nova-compute[75246]:   </features>
Nov 28 16:55:23 user nova-compute[75246]: </domainCapabilities>
Nov 28 16:55:23 user nova-compute[75246]:  {{(pid=75246) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 28 16:55:23 user nova-compute[75246]: <domainCapabilities>
Nov 28 16:55:23 user nova-compute[75246]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 16:55:23 user nova-compute[75246]:   <domain>kvm</domain>
Nov 28 16:55:23 user nova-compute[75246]:   <machine>pc-q35-jammy</machine>
Nov 28 16:55:23 user nova-compute[75246]:   <arch>i686</arch>
Nov 28 16:55:23 user nova-compute[75246]:   <vcpu max='288'/>
Nov 28 16:55:23 user nova-compute[75246]:   <iothreads supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:   <os supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:     <enum name='firmware'/>
Nov 28 16:55:23 user nova-compute[75246]:     <loader supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='type'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>rom</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>pflash</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='readonly'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>yes</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>no</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='secure'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>no</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </loader>
Nov 28 16:55:23 user nova-compute[75246]:   </os>
Nov 28 16:55:23 user nova-compute[75246]:   <cpu>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='host-passthrough' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='hostPassthroughMigratable'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>off</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='maximum' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='maximumMigratable'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>on</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>off</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='host-model' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <vendor>Intel</vendor>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ss'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='vmx'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='pcid'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='hypervisor'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='arat'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='umip'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='md-clear'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='stibp'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ssbd'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ibpb'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ibrs'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='amd-stibp'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='erms'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='lm'/>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='custom' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>qemu64</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>qemu32</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>phenom</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium3</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium2</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>n270</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>kvm64</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>kvm32</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>coreduo</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>core2duo</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>athlon</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Westmere</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Snowridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>SandyBridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Penryn</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G5</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G4</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G3</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G2</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G1</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Nehalem</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>IvyBridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Icelake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-Rome</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-Milan</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Dhyana</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cooperlake</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Conroe</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>486</model>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:   </cpu>
Nov 28 16:55:23 user nova-compute[75246]:   <memoryBacking supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:     <enum name='sourceType'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>file</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>anonymous</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>memfd</value>
Nov 28 16:55:23 user nova-compute[75246]:     </enum>
Nov 28 16:55:23 user nova-compute[75246]:   </memoryBacking>
Nov 28 16:55:23 user nova-compute[75246]:   <devices>
Nov 28 16:55:23 user nova-compute[75246]:     <disk supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='diskDevice'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>disk</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>cdrom</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>floppy</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>lun</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='bus'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>fdc</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>scsi</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>usb</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>sata</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-non-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </disk>
Nov 28 16:55:23 user nova-compute[75246]:     <graphics supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='type'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>sdl</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vnc</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>spice</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>egl-headless</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </graphics>
Nov 28 16:55:23 user nova-compute[75246]:     <video supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='modelType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vga</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>cirrus</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vmvga</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>qxl</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>none</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>bochs</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>ramfb</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </video>
Nov 28 16:55:23 user nova-compute[75246]:     <hostdev supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='mode'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>subsystem</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='startupPolicy'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>default</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>mandatory</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>requisite</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>optional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='subsysType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>usb</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>pci</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>scsi</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='capsType'/>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='pciBackend'/>
Nov 28 16:55:23 user nova-compute[75246]:     </hostdev>
Nov 28 16:55:23 user nova-compute[75246]:     <rng supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-non-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='backendModel'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>random</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>egd</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>builtin</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </rng>
Nov 28 16:55:23 user nova-compute[75246]:     <filesystem supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='driverType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>path</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>handle</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtiofs</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </filesystem>
Nov 28 16:55:23 user nova-compute[75246]:     <tpm supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>tpm-tis</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>tpm-crb</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='backendModel'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>passthrough</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>emulator</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </tpm>
Nov 28 16:55:23 user nova-compute[75246]:   </devices>
Nov 28 16:55:23 user nova-compute[75246]:   <features>
Nov 28 16:55:23 user nova-compute[75246]:     <gic supported='no'/>
Nov 28 16:55:23 user nova-compute[75246]:     <vmcoreinfo supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <genid supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <backingStoreInput supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <backup supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <sev supported='no'/>
Nov 28 16:55:23 user nova-compute[75246]:   </features>
Nov 28 16:55:23 user nova-compute[75246]: </domainCapabilities>
Nov 28 16:55:23 user nova-compute[75246]:  {{(pid=75246) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 28 16:55:23 user nova-compute[75246]: <domainCapabilities>
Nov 28 16:55:23 user nova-compute[75246]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 16:55:23 user nova-compute[75246]:   <domain>kvm</domain>
Nov 28 16:55:23 user nova-compute[75246]:   <machine>pc-i440fx-jammy</machine>
Nov 28 16:55:23 user nova-compute[75246]:   <arch>i686</arch>
Nov 28 16:55:23 user nova-compute[75246]:   <vcpu max='255'/>
Nov 28 16:55:23 user nova-compute[75246]:   <iothreads supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:   <os supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:     <enum name='firmware'/>
Nov 28 16:55:23 user nova-compute[75246]:     <loader supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='type'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>rom</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>pflash</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='readonly'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>yes</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>no</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='secure'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>no</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </loader>
Nov 28 16:55:23 user nova-compute[75246]:   </os>
Nov 28 16:55:23 user nova-compute[75246]:   <cpu>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='host-passthrough' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='hostPassthroughMigratable'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>off</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='maximum' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='maximumMigratable'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>on</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>off</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='host-model' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <vendor>Intel</vendor>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ss'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='vmx'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='pcid'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='hypervisor'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='arat'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='umip'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='md-clear'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='stibp'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ssbd'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ibpb'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ibrs'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='amd-stibp'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='erms'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='lm'/>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='custom' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>qemu64</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>qemu32</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>phenom</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium3</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium2</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>n270</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>kvm64</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>kvm32</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>coreduo</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>core2duo</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>athlon</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Westmere</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Snowridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>SandyBridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Penryn</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G5</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G4</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G3</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G2</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G1</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Nehalem</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>IvyBridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Icelake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-Rome</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-Milan</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Dhyana</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cooperlake</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Conroe</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>486</model>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:   </cpu>
Nov 28 16:55:23 user nova-compute[75246]:   <memoryBacking supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:     <enum name='sourceType'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>file</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>anonymous</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>memfd</value>
Nov 28 16:55:23 user nova-compute[75246]:     </enum>
Nov 28 16:55:23 user nova-compute[75246]:   </memoryBacking>
Nov 28 16:55:23 user nova-compute[75246]:   <devices>
Nov 28 16:55:23 user nova-compute[75246]:     <disk supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='diskDevice'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>disk</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>cdrom</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>floppy</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>lun</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='bus'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>ide</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>fdc</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>scsi</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>usb</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>sata</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-non-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </disk>
Nov 28 16:55:23 user nova-compute[75246]:     <graphics supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='type'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>sdl</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vnc</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>spice</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>egl-headless</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </graphics>
Nov 28 16:55:23 user nova-compute[75246]:     <video supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='modelType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vga</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>cirrus</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vmvga</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>qxl</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>none</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>bochs</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>ramfb</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </video>
Nov 28 16:55:23 user nova-compute[75246]:     <hostdev supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='mode'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>subsystem</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='startupPolicy'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>default</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>mandatory</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>requisite</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>optional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='subsysType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>usb</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>pci</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>scsi</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='capsType'/>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='pciBackend'/>
Nov 28 16:55:23 user nova-compute[75246]:     </hostdev>
Nov 28 16:55:23 user nova-compute[75246]:     <rng supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-non-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='backendModel'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>random</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>egd</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>builtin</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </rng>
Nov 28 16:55:23 user nova-compute[75246]:     <filesystem supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='driverType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>path</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>handle</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtiofs</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </filesystem>
Nov 28 16:55:23 user nova-compute[75246]:     <tpm supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>tpm-tis</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>tpm-crb</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='backendModel'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>passthrough</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>emulator</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </tpm>
Nov 28 16:55:23 user nova-compute[75246]:   </devices>
Nov 28 16:55:23 user nova-compute[75246]:   <features>
Nov 28 16:55:23 user nova-compute[75246]:     <gic supported='no'/>
Nov 28 16:55:23 user nova-compute[75246]:     <vmcoreinfo supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <genid supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <backingStoreInput supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <backup supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <sev supported='no'/>
Nov 28 16:55:23 user nova-compute[75246]:   </features>
Nov 28 16:55:23 user nova-compute[75246]: </domainCapabilities>
Nov 28 16:55:23 user nova-compute[75246]:  {{(pid=75246) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 28 16:55:23 user nova-compute[75246]: <domainCapabilities>
Nov 28 16:55:23 user nova-compute[75246]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 16:55:23 user nova-compute[75246]:   <domain>kvm</domain>
Nov 28 16:55:23 user nova-compute[75246]:   <machine>pc-i440fx-6.2</machine>
Nov 28 16:55:23 user nova-compute[75246]:   <arch>x86_64</arch>
Nov 28 16:55:23 user nova-compute[75246]:   <vcpu max='255'/>
Nov 28 16:55:23 user nova-compute[75246]:   <iothreads supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:   <os supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:     <enum name='firmware'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>efi</value>
Nov 28 16:55:23 user nova-compute[75246]:     </enum>
Nov 28 16:55:23 user nova-compute[75246]:     <loader supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='type'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>rom</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>pflash</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='readonly'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>yes</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>no</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='secure'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>no</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </loader>
Nov 28 16:55:23 user nova-compute[75246]:   </os>
Nov 28 16:55:23 user nova-compute[75246]:   <cpu>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='host-passthrough' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='hostPassthroughMigratable'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>on</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>off</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='maximum' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='maximumMigratable'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>on</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>off</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='host-model' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <vendor>Intel</vendor>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ss'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='vmx'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='pcid'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='hypervisor'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='arat'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='umip'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='md-clear'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='stibp'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ssbd'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='invtsc'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ibpb'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ibrs'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='amd-stibp'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='rsba'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='erms'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='custom' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>qemu64</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>qemu32</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>phenom</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium3</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium2</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>n270</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>kvm64</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>kvm32</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>coreduo</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>core2duo</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>athlon</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Westmere</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Snowridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>SandyBridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Penryn</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G5</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G4</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G3</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G2</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Opteron_G1</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Nehalem</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>IvyBridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Icelake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-Rome</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-Milan</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Dhyana</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cooperlake</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Conroe</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>486</model>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:   </cpu>
Nov 28 16:55:23 user nova-compute[75246]:   <memoryBacking supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:     <enum name='sourceType'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>file</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>anonymous</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>memfd</value>
Nov 28 16:55:23 user nova-compute[75246]:     </enum>
Nov 28 16:55:23 user nova-compute[75246]:   </memoryBacking>
Nov 28 16:55:23 user nova-compute[75246]:   <devices>
Nov 28 16:55:23 user nova-compute[75246]:     <disk supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='diskDevice'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>disk</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>cdrom</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>floppy</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>lun</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='bus'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>ide</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>fdc</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>scsi</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>usb</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>sata</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-non-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </disk>
Nov 28 16:55:23 user nova-compute[75246]:     <graphics supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='type'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>sdl</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vnc</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>spice</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>egl-headless</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </graphics>
Nov 28 16:55:23 user nova-compute[75246]:     <video supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='modelType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vga</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>cirrus</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vmvga</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>qxl</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>none</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>bochs</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>ramfb</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </video>
Nov 28 16:55:23 user nova-compute[75246]:     <hostdev supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='mode'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>subsystem</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='startupPolicy'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>default</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>mandatory</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>requisite</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>optional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='subsysType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>usb</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>pci</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>scsi</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='capsType'/>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='pciBackend'/>
Nov 28 16:55:23 user nova-compute[75246]:     </hostdev>
Nov 28 16:55:23 user nova-compute[75246]:     <rng supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-non-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='backendModel'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>random</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>egd</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>builtin</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </rng>
Nov 28 16:55:23 user nova-compute[75246]:     <filesystem supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='driverType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>path</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>handle</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtiofs</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </filesystem>
Nov 28 16:55:23 user nova-compute[75246]:     <tpm supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>tpm-tis</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>tpm-crb</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='backendModel'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>passthrough</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>emulator</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </tpm>
Nov 28 16:55:23 user nova-compute[75246]:   </devices>
Nov 28 16:55:23 user nova-compute[75246]:   <features>
Nov 28 16:55:23 user nova-compute[75246]:     <gic supported='no'/>
Nov 28 16:55:23 user nova-compute[75246]:     <vmcoreinfo supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <genid supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <backingStoreInput supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <backup supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <sev supported='no'/>
Nov 28 16:55:23 user nova-compute[75246]:   </features>
Nov 28 16:55:23 user nova-compute[75246]: </domainCapabilities>
Nov 28 16:55:23 user nova-compute[75246]:  {{(pid=75246) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 28 16:55:23 user nova-compute[75246]: <domainCapabilities>
Nov 28 16:55:23 user nova-compute[75246]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 16:55:23 user nova-compute[75246]:   <domain>kvm</domain>
Nov 28 16:55:23 user nova-compute[75246]:   <machine>pc-q35-6.2</machine>
Nov 28 16:55:23 user nova-compute[75246]:   <arch>x86_64</arch>
Nov 28 16:55:23 user nova-compute[75246]:   <vcpu max='288'/>
Nov 28 16:55:23 user nova-compute[75246]:   <iothreads supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:   <os supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:     <enum name='firmware'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>efi</value>
Nov 28 16:55:23 user nova-compute[75246]:     </enum>
Nov 28 16:55:23 user nova-compute[75246]:     <loader supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='type'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>rom</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>pflash</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='readonly'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>yes</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>no</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='secure'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>yes</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>no</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </loader>
Nov 28 16:55:23 user nova-compute[75246]:   </os>
Nov 28 16:55:23 user nova-compute[75246]:   <cpu>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='host-passthrough' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='hostPassthroughMigratable'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>on</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>off</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='maximum' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='maximumMigratable'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>on</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>off</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='host-model' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <vendor>Intel</vendor>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ss'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='vmx'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='pcid'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='hypervisor'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='arat'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='umip'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='md-clear'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='stibp'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ssbd'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='invtsc'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ibpb'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ibrs'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='amd-stibp'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='rsba'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='erms'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='custom' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>qemu64</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>qemu32</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>phenom</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium3</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium2</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>n270</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>kvm64</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>kvm32</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>coreduo</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>core2duo</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>athlon</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Westmere</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Snowridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>SandyBridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Penryn</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G5</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G4</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G3</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G2</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Opteron_G1</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Nehalem</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>IvyBridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Icelake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-Rome</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-Milan</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Dhyana</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cooperlake</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Conroe</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>486</model>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:   </cpu>
Nov 28 16:55:23 user nova-compute[75246]:   <memoryBacking supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:     <enum name='sourceType'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>file</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>anonymous</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>memfd</value>
Nov 28 16:55:23 user nova-compute[75246]:     </enum>
Nov 28 16:55:23 user nova-compute[75246]:   </memoryBacking>
Nov 28 16:55:23 user nova-compute[75246]:   <devices>
Nov 28 16:55:23 user nova-compute[75246]:     <disk supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='diskDevice'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>disk</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>cdrom</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>floppy</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>lun</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='bus'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>fdc</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>scsi</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>usb</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>sata</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-non-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </disk>
Nov 28 16:55:23 user nova-compute[75246]:     <graphics supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='type'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>sdl</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vnc</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>spice</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>egl-headless</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </graphics>
Nov 28 16:55:23 user nova-compute[75246]:     <video supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='modelType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vga</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>cirrus</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vmvga</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>qxl</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>none</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>bochs</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>ramfb</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </video>
Nov 28 16:55:23 user nova-compute[75246]:     <hostdev supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='mode'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>subsystem</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='startupPolicy'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>default</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>mandatory</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>requisite</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>optional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='subsysType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>usb</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>pci</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>scsi</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='capsType'/>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='pciBackend'/>
Nov 28 16:55:23 user nova-compute[75246]:     </hostdev>
Nov 28 16:55:23 user nova-compute[75246]:     <rng supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-non-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='backendModel'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>random</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>egd</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>builtin</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </rng>
Nov 28 16:55:23 user nova-compute[75246]:     <filesystem supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='driverType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>path</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>handle</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtiofs</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </filesystem>
Nov 28 16:55:23 user nova-compute[75246]:     <tpm supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>tpm-tis</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>tpm-crb</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='backendModel'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>passthrough</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>emulator</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </tpm>
Nov 28 16:55:23 user nova-compute[75246]:   </devices>
Nov 28 16:55:23 user nova-compute[75246]:   <features>
Nov 28 16:55:23 user nova-compute[75246]:     <gic supported='no'/>
Nov 28 16:55:23 user nova-compute[75246]:     <vmcoreinfo supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <genid supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <backingStoreInput supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <backup supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <sev supported='no'/>
Nov 28 16:55:23 user nova-compute[75246]:   </features>
Nov 28 16:55:23 user nova-compute[75246]: </domainCapabilities>
Nov 28 16:55:23 user nova-compute[75246]:  {{(pid=75246) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 28 16:55:23 user nova-compute[75246]: <domainCapabilities>
Nov 28 16:55:23 user nova-compute[75246]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 16:55:23 user nova-compute[75246]:   <domain>kvm</domain>
Nov 28 16:55:23 user nova-compute[75246]:   <machine>pc-q35-jammy</machine>
Nov 28 16:55:23 user nova-compute[75246]:   <arch>x86_64</arch>
Nov 28 16:55:23 user nova-compute[75246]:   <vcpu max='288'/>
Nov 28 16:55:23 user nova-compute[75246]:   <iothreads supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:   <os supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:     <enum name='firmware'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>efi</value>
Nov 28 16:55:23 user nova-compute[75246]:     </enum>
Nov 28 16:55:23 user nova-compute[75246]:     <loader supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='type'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>rom</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>pflash</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='readonly'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>yes</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>no</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='secure'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>yes</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>no</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </loader>
Nov 28 16:55:23 user nova-compute[75246]:   </os>
Nov 28 16:55:23 user nova-compute[75246]:   <cpu>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='host-passthrough' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='hostPassthroughMigratable'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>on</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>off</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='maximum' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='maximumMigratable'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>on</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>off</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='host-model' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <vendor>Intel</vendor>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ss'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='vmx'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='pcid'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='hypervisor'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='arat'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='umip'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='md-clear'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='stibp'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ssbd'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='invtsc'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ibpb'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ibrs'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='amd-stibp'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='rsba'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='erms'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='custom' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>qemu64</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>qemu32</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>phenom</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium3</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium2</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>n270</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>kvm64</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>kvm32</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>coreduo</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>core2duo</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>athlon</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Westmere</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Snowridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>SandyBridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Penryn</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G5</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G4</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G3</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G2</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Opteron_G1</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Nehalem</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>IvyBridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Icelake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-Rome</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-Milan</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Dhyana</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cooperlake</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Conroe</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>486</model>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:   </cpu>
Nov 28 16:55:23 user nova-compute[75246]:   <memoryBacking supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:     <enum name='sourceType'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>file</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>anonymous</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>memfd</value>
Nov 28 16:55:23 user nova-compute[75246]:     </enum>
Nov 28 16:55:23 user nova-compute[75246]:   </memoryBacking>
Nov 28 16:55:23 user nova-compute[75246]:   <devices>
Nov 28 16:55:23 user nova-compute[75246]:     <disk supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='diskDevice'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>disk</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>cdrom</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>floppy</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>lun</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='bus'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>fdc</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>scsi</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>usb</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>sata</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-non-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </disk>
Nov 28 16:55:23 user nova-compute[75246]:     <graphics supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='type'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>sdl</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vnc</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>spice</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>egl-headless</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </graphics>
Nov 28 16:55:23 user nova-compute[75246]:     <video supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='modelType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vga</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>cirrus</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vmvga</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>qxl</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>none</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>bochs</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>ramfb</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </video>
Nov 28 16:55:23 user nova-compute[75246]:     <hostdev supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='mode'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>subsystem</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='startupPolicy'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>default</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>mandatory</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>requisite</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>optional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='subsysType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>usb</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>pci</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>scsi</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='capsType'/>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='pciBackend'/>
Nov 28 16:55:23 user nova-compute[75246]:     </hostdev>
Nov 28 16:55:23 user nova-compute[75246]:     <rng supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-non-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='backendModel'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>random</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>egd</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>builtin</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </rng>
Nov 28 16:55:23 user nova-compute[75246]:     <filesystem supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='driverType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>path</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>handle</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtiofs</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </filesystem>
Nov 28 16:55:23 user nova-compute[75246]:     <tpm supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>tpm-tis</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>tpm-crb</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='backendModel'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>passthrough</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>emulator</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </tpm>
Nov 28 16:55:23 user nova-compute[75246]:   </devices>
Nov 28 16:55:23 user nova-compute[75246]:   <features>
Nov 28 16:55:23 user nova-compute[75246]:     <gic supported='no'/>
Nov 28 16:55:23 user nova-compute[75246]:     <vmcoreinfo supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <genid supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <backingStoreInput supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <backup supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <sev supported='no'/>
Nov 28 16:55:23 user nova-compute[75246]:   </features>
Nov 28 16:55:23 user nova-compute[75246]: </domainCapabilities>
Nov 28 16:55:23 user nova-compute[75246]:  {{(pid=75246) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 28 16:55:23 user nova-compute[75246]: <domainCapabilities>
Nov 28 16:55:23 user nova-compute[75246]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 16:55:23 user nova-compute[75246]:   <domain>kvm</domain>
Nov 28 16:55:23 user nova-compute[75246]:   <machine>pc-i440fx-jammy</machine>
Nov 28 16:55:23 user nova-compute[75246]:   <arch>x86_64</arch>
Nov 28 16:55:23 user nova-compute[75246]:   <vcpu max='255'/>
Nov 28 16:55:23 user nova-compute[75246]:   <iothreads supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:   <os supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:     <enum name='firmware'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>efi</value>
Nov 28 16:55:23 user nova-compute[75246]:     </enum>
Nov 28 16:55:23 user nova-compute[75246]:     <loader supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='type'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>rom</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>pflash</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='readonly'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>yes</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>no</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='secure'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>no</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </loader>
Nov 28 16:55:23 user nova-compute[75246]:   </os>
Nov 28 16:55:23 user nova-compute[75246]:   <cpu>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='host-passthrough' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='hostPassthroughMigratable'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>on</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>off</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='maximum' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='maximumMigratable'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>on</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>off</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='host-model' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <vendor>Intel</vendor>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ss'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='vmx'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='pcid'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='hypervisor'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='arat'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='umip'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='md-clear'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='stibp'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ssbd'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='invtsc'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ibpb'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='ibrs'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='amd-stibp'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='rsba'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='erms'/>
Nov 28 16:55:23 user nova-compute[75246]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:     <mode name='custom' supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>qemu64</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>qemu32</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>phenom</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium3</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium2</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>pentium</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>n270</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>kvm64</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>kvm32</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>coreduo</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>core2duo</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>athlon</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Westmere</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Snowridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Skylake-Client</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>SandyBridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Penryn</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G5</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G4</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G3</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Opteron_G2</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Opteron_G1</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Nehalem</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>IvyBridge</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Icelake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Haswell</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-Rome</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-Milan</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>EPYC</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Dhyana</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cooperlake</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>Conroe</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='no'>Broadwell</model>
Nov 28 16:55:23 user nova-compute[75246]:       <model usable='yes'>486</model>
Nov 28 16:55:23 user nova-compute[75246]:     </mode>
Nov 28 16:55:23 user nova-compute[75246]:   </cpu>
Nov 28 16:55:23 user nova-compute[75246]:   <memoryBacking supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:     <enum name='sourceType'>
Nov 28 16:55:23 user nova-compute[75246]:       <value>file</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>anonymous</value>
Nov 28 16:55:23 user nova-compute[75246]:       <value>memfd</value>
Nov 28 16:55:23 user nova-compute[75246]:     </enum>
Nov 28 16:55:23 user nova-compute[75246]:   </memoryBacking>
Nov 28 16:55:23 user nova-compute[75246]:   <devices>
Nov 28 16:55:23 user nova-compute[75246]:     <disk supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='diskDevice'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>disk</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>cdrom</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>floppy</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>lun</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='bus'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>ide</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>fdc</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>scsi</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>usb</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>sata</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-non-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </disk>
Nov 28 16:55:23 user nova-compute[75246]:     <graphics supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='type'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>sdl</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vnc</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>spice</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>egl-headless</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </graphics>
Nov 28 16:55:23 user nova-compute[75246]:     <video supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='modelType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vga</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>cirrus</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>vmvga</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>qxl</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>none</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>bochs</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>ramfb</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </video>
Nov 28 16:55:23 user nova-compute[75246]:     <hostdev supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='mode'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>subsystem</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='startupPolicy'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>default</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>mandatory</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>requisite</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>optional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='subsysType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>usb</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>pci</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>scsi</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='capsType'/>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='pciBackend'/>
Nov 28 16:55:23 user nova-compute[75246]:     </hostdev>
Nov 28 16:55:23 user nova-compute[75246]:     <rng supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtio-non-transitional</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='backendModel'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>random</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>egd</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>builtin</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </rng>
Nov 28 16:55:23 user nova-compute[75246]:     <filesystem supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='driverType'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>path</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>handle</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>virtiofs</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </filesystem>
Nov 28 16:55:23 user nova-compute[75246]:     <tpm supported='yes'>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='model'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>tpm-tis</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>tpm-crb</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:       <enum name='backendModel'>
Nov 28 16:55:23 user nova-compute[75246]:         <value>passthrough</value>
Nov 28 16:55:23 user nova-compute[75246]:         <value>emulator</value>
Nov 28 16:55:23 user nova-compute[75246]:       </enum>
Nov 28 16:55:23 user nova-compute[75246]:     </tpm>
Nov 28 16:55:23 user nova-compute[75246]:   </devices>
Nov 28 16:55:23 user nova-compute[75246]:   <features>
Nov 28 16:55:23 user nova-compute[75246]:     <gic supported='no'/>
Nov 28 16:55:23 user nova-compute[75246]:     <vmcoreinfo supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <genid supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <backingStoreInput supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <backup supported='yes'/>
Nov 28 16:55:23 user nova-compute[75246]:     <sev supported='no'/>
Nov 28 16:55:23 user nova-compute[75246]:   </features>
Nov 28 16:55:23 user nova-compute[75246]: </domainCapabilities>
Nov 28 16:55:23 user nova-compute[75246]:  {{(pid=75246) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75246) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75246) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Checking secure boot support for host arch (x86_64) {{(pid=75246) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Checking secure boot support for host arch (x86_64) {{(pid=75246) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Checking secure boot support for host arch (x86_64) {{(pid=75246) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 28 16:55:23 user nova-compute[75246]: INFO nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Secure Boot support detected
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] cpu compare xml: <cpu match="exact">
Nov 28 16:55:23 user nova-compute[75246]:   <model>Nehalem</model>
Nov 28 16:55:23 user nova-compute[75246]: </cpu>
Nov 28 16:55:23 user nova-compute[75246]:  {{(pid=75246) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 28 16:55:23 user nova-compute[75246]: INFO nova.virt.node [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Generated node identity 241ad926-9deb-44ba-a618-a49e4ac21089
Nov 28 16:55:23 user nova-compute[75246]: INFO nova.virt.node [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Wrote node identity 241ad926-9deb-44ba-a618-a49e4ac21089 to /opt/stack/data/nova/compute_id
Nov 28 16:55:23 user nova-compute[75246]: WARNING nova.compute.manager [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Compute nodes ['241ad926-9deb-44ba-a618-a49e4ac21089'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 28 16:55:23 user nova-compute[75246]: INFO nova.compute.manager [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 28 16:55:23 user nova-compute[75246]: WARNING nova.compute.manager [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 28 16:55:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:55:23 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:55:23 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Hypervisor/Node resource view: name=user free_ram=10958MB free_disk=26.295818328857422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:55:23 user nova-compute[75246]: WARNING nova.compute.resource_tracker [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] No compute node record for user:241ad926-9deb-44ba-a618-a49e4ac21089: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 241ad926-9deb-44ba-a618-a49e4ac21089 could not be found.
Nov 28 16:55:23 user nova-compute[75246]: INFO nova.compute.resource_tracker [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Compute node record created for user:user with uuid: 241ad926-9deb-44ba-a618-a49e4ac21089
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:55:23 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] [req-e7b64345-a22d-4bf9-b4ee-482dfcbc011b] Created resource provider record via placement API for resource provider with UUID 241ad926-9deb-44ba-a618-a49e4ac21089 and name user.
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75246) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 28 16:55:23 user nova-compute[75246]: INFO nova.virt.libvirt.host [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] kernel doesn't support AMD SEV
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Updating inventory in ProviderTree for provider 241ad926-9deb-44ba-a618-a49e4ac21089 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 16:55:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Libvirt baseline CPU <cpu>
Nov 28 16:55:23 user nova-compute[75246]:   <arch>x86_64</arch>
Nov 28 16:55:23 user nova-compute[75246]:   <model>Nehalem</model>
Nov 28 16:55:23 user nova-compute[75246]:   <vendor>Intel</vendor>
Nov 28 16:55:23 user nova-compute[75246]:   <topology sockets="6" cores="1" threads="1"/>
Nov 28 16:55:23 user nova-compute[75246]: </cpu>
Nov 28 16:55:23 user nova-compute[75246]:  {{(pid=75246) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 28 16:55:24 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Updated inventory for provider 241ad926-9deb-44ba-a618-a49e4ac21089 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 28 16:55:24 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Updating resource provider 241ad926-9deb-44ba-a618-a49e4ac21089 generation from 0 to 1 during operation: update_inventory {{(pid=75246) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 28 16:55:24 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Updating inventory in ProviderTree for provider 241ad926-9deb-44ba-a618-a49e4ac21089 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 16:55:24 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Updating resource provider 241ad926-9deb-44ba-a618-a49e4ac21089 generation from 1 to 2 during operation: update_traits {{(pid=75246) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 28 16:55:24 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:55:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.685s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:55:24 user nova-compute[75246]: DEBUG nova.service [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Creating RPC server for service compute {{(pid=75246) start /opt/stack/nova/nova/service.py:182}}
Nov 28 16:55:24 user nova-compute[75246]: DEBUG nova.service [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] Join ServiceGroup membership for this service compute {{(pid=75246) start /opt/stack/nova/nova/service.py:199}}
Nov 28 16:55:24 user nova-compute[75246]: DEBUG nova.servicegroup.drivers.db [None req-84b0d36c-5270-48be-837a-3754492e4820 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75246) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:56:22 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:56:22 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:56:22 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=10271MB free_disk=26.199417114257812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:56:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:57:15 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:57:15 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:57:15 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:57:15 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:57:15 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:57:15 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:57:15 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:57:15 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 16:57:15 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:57:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:57:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:57:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:57:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:57:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:57:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:57:16 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:57:16 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:57:16 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:57:16 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=10284MB free_disk=26.264183044433594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:57:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:57:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:57:16 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:57:16 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:57:16 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:57:16 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:57:16 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:57:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:57:17 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:57:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:58:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:58:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:58:15 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:58:15 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:58:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:58:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:58:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:58:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 16:58:17 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:58:17 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:58:17 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:58:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:58:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:58:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:58:18 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:58:18 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:58:18 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:58:18 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=10333MB free_disk=26.01624298095703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:58:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:58:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:58:18 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:58:18 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:58:18 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:58:18 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:58:18 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:58:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:58:19 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:58:19 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:59:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:59:15 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:59:15 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:59:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:59:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:59:17 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:59:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:59:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:59:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 16:59:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:59:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:59:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:59:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:59:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:59:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:19 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:59:19 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:59:19 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:59:19 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9593MB free_disk=26.036800384521484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:59:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:19 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:59:19 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:59:19 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:59:19 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:59:19 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:59:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "25480185-8c9c-4aad-9c46-573cfbf65364" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "25480185-8c9c-4aad-9c46-573cfbf65364" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:27 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 16:59:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 16:59:27 user nova-compute[75246]: INFO nova.compute.claims [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Claim successful on node user
Nov 28 16:59:28 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:59:28 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:59:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:28 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 16:59:28 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 16:59:28 user nova-compute[75246]: DEBUG nova.network.neutron [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 16:59:28 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 16:59:28 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 16:59:28 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 16:59:28 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 16:59:28 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Creating image(s)
Nov 28 16:59:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "/opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "/opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "/opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9.part --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:29 user nova-compute[75246]: DEBUG nova.policy [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed5bb6d3f84b4c90990c68ed1d55b1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde1b5b56914297ab276a983b4dd56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 16:59:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9.part --force-share --output=json" returned: 0 in 0.168s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:29 user nova-compute[75246]: DEBUG nova.virt.images [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] 1ef2d77e-6c24-4e9a-ba2a-b6759061c14d was qcow2, converting to raw {{(pid=75246) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 16:59:29 user nova-compute[75246]: DEBUG nova.privsep.utils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75246) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 16:59:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9.part /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9.converted {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9.part /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9.converted" returned: 0 in 0.699s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9.converted --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9.converted --force-share --output=json" returned: 0 in 0.159s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.065s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:30 user nova-compute[75246]: INFO oslo.privsep.daemon [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpfn825t0r/privsep.sock']
Nov 28 16:59:30 user sudo[84487]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpfn825t0r/privsep.sock
Nov 28 16:59:30 user sudo[84487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 16:59:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "e1266470-c182-4c0c-a575-4c5043f54745" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "e1266470-c182-4c0c-a575-4c5043f54745" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:31 user nova-compute[75246]: DEBUG nova.compute.manager [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 16:59:31 user nova-compute[75246]: DEBUG nova.network.neutron [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Successfully created port: c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 16:59:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:31 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 16:59:31 user nova-compute[75246]: INFO nova.compute.claims [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Claim successful on node user
Nov 28 16:59:32 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:59:32 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:59:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:32 user nova-compute[75246]: DEBUG nova.compute.manager [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 16:59:32 user nova-compute[75246]: DEBUG nova.compute.manager [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 16:59:32 user nova-compute[75246]: DEBUG nova.network.neutron [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 16:59:32 user sudo[84487]: pam_unix(sudo:session): session closed for user root
Nov 28 16:59:32 user nova-compute[75246]: INFO oslo.privsep.daemon [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Spawned new privsep daemon via rootwrap
Nov 28 16:59:32 user nova-compute[75246]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 16:59:32 user nova-compute[75246]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 16:59:32 user nova-compute[75246]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 28 16:59:32 user nova-compute[75246]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84514
Nov 28 16:59:32 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 16:59:32 user nova-compute[75246]: DEBUG nova.compute.manager [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 16:59:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:32 user nova-compute[75246]: DEBUG nova.compute.manager [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 16:59:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 16:59:32 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Creating image(s)
Nov 28 16:59:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "/opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "/opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.214s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:32 user nova-compute[75246]: DEBUG nova.policy [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39d2eb0837eb4c729fe9ca2964cbe789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be06eee4e74a41b799f1df75ea55b955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.218s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.216s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk 1073741824" returned: 0 in 0.045s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.191s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.220s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.220s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk 1073741824" returned: 0 in 0.047s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Cannot resize image /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Ensure instance console log exists: /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.171s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Cannot resize image /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Ensure instance console log exists: /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:34 user nova-compute[75246]: DEBUG nova.network.neutron [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Successfully updated port: c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 16:59:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "refresh_cache-25480185-8c9c-4aad-9c46-573cfbf65364" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:59:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquired lock "refresh_cache-25480185-8c9c-4aad-9c46-573cfbf65364" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:59:34 user nova-compute[75246]: DEBUG nova.network.neutron [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 16:59:34 user nova-compute[75246]: DEBUG nova.network.neutron [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 16:59:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-3dc0b587-c59a-4ef6-acc5-8434cdd23fab req-6c5b78f8-ab0b-47cb-be2f-35e6f929135c service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Received event network-changed-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:59:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-3dc0b587-c59a-4ef6-acc5-8434cdd23fab req-6c5b78f8-ab0b-47cb-be2f-35e6f929135c service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Refreshing instance network info cache due to event network-changed-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:59:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3dc0b587-c59a-4ef6-acc5-8434cdd23fab req-6c5b78f8-ab0b-47cb-be2f-35e6f929135c service nova] Acquiring lock "refresh_cache-25480185-8c9c-4aad-9c46-573cfbf65364" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:59:34 user nova-compute[75246]: DEBUG nova.network.neutron [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Successfully created port: 459bf491-d464-42b1-be6c-282af882a38d {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.network.neutron [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Updating instance_info_cache with network_info: [{"id": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "address": "fa:16:3e:85:27:7b", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c6bdcd-7c", "ovs_interfaceid": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Releasing lock "refresh_cache-25480185-8c9c-4aad-9c46-573cfbf65364" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Instance network_info: |[{"id": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "address": "fa:16:3e:85:27:7b", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c6bdcd-7c", "ovs_interfaceid": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3dc0b587-c59a-4ef6-acc5-8434cdd23fab req-6c5b78f8-ab0b-47cb-be2f-35e6f929135c service nova] Acquired lock "refresh_cache-25480185-8c9c-4aad-9c46-573cfbf65364" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.network.neutron [req-3dc0b587-c59a-4ef6-acc5-8434cdd23fab req-6c5b78f8-ab0b-47cb-be2f-35e6f929135c service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Refreshing network info cache for port c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Start _get_guest_xml network_info=[{"id": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "address": "fa:16:3e:85:27:7b", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c6bdcd-7c", "ovs_interfaceid": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "4b650a57-5870-4f77-bca2-abe50d970b40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:35 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:59:35 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.privsep.utils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75246) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1442756255',display_name='tempest-ServersNegativeTestJSON-server-1442756255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1442756255',id=1,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbde1b5b56914297ab276a983b4dd56b',ramdisk_id='',reservation_id='r-xhi8yg0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-368898789',owner_user_name='tempest-ServersNegativeTestJSON-368898789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:59:28Z,user_data=None,user_id='ed5bb6d3f84b4c90990c68ed1d55b1c0',uuid=25480185-8c9c-4aad-9c46-573cfbf65364,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "address": "fa:16:3e:85:27:7b", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c6bdcd-7c", "ovs_interfaceid": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Converting VIF {"id": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "address": "fa:16:3e:85:27:7b", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c6bdcd-7c", "ovs_interfaceid": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8,network=Network(75d646d7-52d6-4455-8014-0381aa33c56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c6bdcd-7c') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.objects.instance [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lazy-loading 'pci_devices' on Instance uuid 25480185-8c9c-4aad-9c46-573cfbf65364 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] End _get_guest_xml xml=<domain type="kvm">
Nov 28 16:59:35 user nova-compute[75246]:   <uuid>25480185-8c9c-4aad-9c46-573cfbf65364</uuid>
Nov 28 16:59:35 user nova-compute[75246]:   <name>instance-00000001</name>
Nov 28 16:59:35 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 16:59:35 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 16:59:35 user nova-compute[75246]:   <metadata>
Nov 28 16:59:35 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 16:59:35 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 16:59:35 user nova-compute[75246]:       <nova:name>tempest-ServersNegativeTestJSON-server-1442756255</nova:name>
Nov 28 16:59:35 user nova-compute[75246]:       <nova:creationTime>2023-11-28 16:59:35</nova:creationTime>
Nov 28 16:59:35 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 16:59:35 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 16:59:35 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 16:59:35 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 16:59:35 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 16:59:35 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 16:59:35 user nova-compute[75246]:       </nova:flavor>
Nov 28 16:59:35 user nova-compute[75246]:       <nova:owner>
Nov 28 16:59:35 user nova-compute[75246]:         <nova:user uuid="ed5bb6d3f84b4c90990c68ed1d55b1c0">tempest-ServersNegativeTestJSON-368898789-project-member</nova:user>
Nov 28 16:59:35 user nova-compute[75246]:         <nova:project uuid="bbde1b5b56914297ab276a983b4dd56b">tempest-ServersNegativeTestJSON-368898789</nova:project>
Nov 28 16:59:35 user nova-compute[75246]:       </nova:owner>
Nov 28 16:59:35 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 16:59:35 user nova-compute[75246]:       <nova:ports>
Nov 28 16:59:35 user nova-compute[75246]:         <nova:port uuid="c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8">
Nov 28 16:59:35 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 16:59:35 user nova-compute[75246]:         </nova:port>
Nov 28 16:59:35 user nova-compute[75246]:       </nova:ports>
Nov 28 16:59:35 user nova-compute[75246]:     </nova:instance>
Nov 28 16:59:35 user nova-compute[75246]:   </metadata>
Nov 28 16:59:35 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 16:59:35 user nova-compute[75246]:     <system>
Nov 28 16:59:35 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 16:59:35 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 16:59:35 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 16:59:35 user nova-compute[75246]:       <entry name="serial">25480185-8c9c-4aad-9c46-573cfbf65364</entry>
Nov 28 16:59:35 user nova-compute[75246]:       <entry name="uuid">25480185-8c9c-4aad-9c46-573cfbf65364</entry>
Nov 28 16:59:35 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 16:59:35 user nova-compute[75246]:     </system>
Nov 28 16:59:35 user nova-compute[75246]:   </sysinfo>
Nov 28 16:59:35 user nova-compute[75246]:   <os>
Nov 28 16:59:35 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 16:59:35 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 16:59:35 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 16:59:35 user nova-compute[75246]:   </os>
Nov 28 16:59:35 user nova-compute[75246]:   <features>
Nov 28 16:59:35 user nova-compute[75246]:     <acpi/>
Nov 28 16:59:35 user nova-compute[75246]:     <apic/>
Nov 28 16:59:35 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 16:59:35 user nova-compute[75246]:   </features>
Nov 28 16:59:35 user nova-compute[75246]:   <clock offset="utc">
Nov 28 16:59:35 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 16:59:35 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 16:59:35 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 16:59:35 user nova-compute[75246]:   </clock>
Nov 28 16:59:35 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 16:59:35 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 16:59:35 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 16:59:35 user nova-compute[75246]:   </cpu>
Nov 28 16:59:35 user nova-compute[75246]:   <devices>
Nov 28 16:59:35 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 16:59:35 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 16:59:35 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk"/>
Nov 28 16:59:35 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 16:59:35 user nova-compute[75246]:     </disk>
Nov 28 16:59:35 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 16:59:35 user nova-compute[75246]:       <mac address="fa:16:3e:85:27:7b"/>
Nov 28 16:59:35 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 16:59:35 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 16:59:35 user nova-compute[75246]:       <target dev="tapc3c6bdcd-7c"/>
Nov 28 16:59:35 user nova-compute[75246]:     </interface>
Nov 28 16:59:35 user nova-compute[75246]:     <serial type="pty">
Nov 28 16:59:35 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/console.log" append="off"/>
Nov 28 16:59:35 user nova-compute[75246]:     </serial>
Nov 28 16:59:35 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 16:59:35 user nova-compute[75246]:     <video>
Nov 28 16:59:35 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 16:59:35 user nova-compute[75246]:     </video>
Nov 28 16:59:35 user nova-compute[75246]:     <rng model="virtio">
Nov 28 16:59:35 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 16:59:35 user nova-compute[75246]:     </rng>
Nov 28 16:59:35 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 16:59:35 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 16:59:35 user nova-compute[75246]:       <stats period="10"/>
Nov 28 16:59:35 user nova-compute[75246]:     </memballoon>
Nov 28 16:59:35 user nova-compute[75246]:   </devices>
Nov 28 16:59:35 user nova-compute[75246]: </domain>
Nov 28 16:59:35 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1442756255',display_name='tempest-ServersNegativeTestJSON-server-1442756255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1442756255',id=1,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbde1b5b56914297ab276a983b4dd56b',ramdisk_id='',reservation_id='r-xhi8yg0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-368898789',owner_user_name='tempest-ServersNegativeTestJSON-368898789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:59:28Z,user_data=None,user_id='ed5bb6d3f84b4c90990c68ed1d55b1c0',uuid=25480185-8c9c-4aad-9c46-573cfbf65364,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "address": "fa:16:3e:85:27:7b", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c6bdcd-7c", "ovs_interfaceid": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Converting VIF {"id": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "address": "fa:16:3e:85:27:7b", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c6bdcd-7c", "ovs_interfaceid": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8,network=Network(75d646d7-52d6-4455-8014-0381aa33c56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c6bdcd-7c') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG os_vif [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8,network=Network(75d646d7-52d6-4455-8014-0381aa33c56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c6bdcd-7c') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Created schema index Interface.name {{(pid=75246) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Created schema index Port.name {{(pid=75246) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Created schema index Bridge.name {{(pid=75246) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [POLLOUT] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e06cee3d-798d-5bcb-afa1-05ab9b2ea9b6', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:35 user nova-compute[75246]: INFO oslo.privsep.daemon [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpm0v38tqa/privsep.sock']
Nov 28 16:59:35 user sudo[84567]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpm0v38tqa/privsep.sock
Nov 28 16:59:35 user sudo[84567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 16:59:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:35 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 16:59:35 user nova-compute[75246]: INFO nova.compute.claims [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Claim successful on node user
Nov 28 16:59:36 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 16:59:36 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 16:59:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 16:59:36 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Creating image(s)
Nov 28 16:59:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "/opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "/opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG nova.policy [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec11d8eaa57441e4b1178c39dfccd51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3098a0e0fd3640d6b0c61303e10b9269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.210s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.169s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk 1073741824" returned: 0 in 0.051s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG nova.network.neutron [req-3dc0b587-c59a-4ef6-acc5-8434cdd23fab req-6c5b78f8-ab0b-47cb-be2f-35e6f929135c service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Updated VIF entry in instance network info cache for port c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG nova.network.neutron [req-3dc0b587-c59a-4ef6-acc5-8434cdd23fab req-6c5b78f8-ab0b-47cb-be2f-35e6f929135c service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Updating instance_info_cache with network_info: [{"id": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "address": "fa:16:3e:85:27:7b", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c6bdcd-7c", "ovs_interfaceid": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3dc0b587-c59a-4ef6-acc5-8434cdd23fab req-6c5b78f8-ab0b-47cb-be2f-35e6f929135c service nova] Releasing lock "refresh_cache-25480185-8c9c-4aad-9c46-573cfbf65364" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:59:37 user sudo[84567]: pam_unix(sudo:session): session closed for user root
Nov 28 16:59:37 user nova-compute[75246]: INFO oslo.privsep.daemon [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Spawned new privsep daemon via rootwrap
Nov 28 16:59:37 user nova-compute[75246]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 16:59:37 user nova-compute[75246]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 16:59:37 user nova-compute[75246]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 28 16:59:37 user nova-compute[75246]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84597
Nov 28 16:59:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Cannot resize image /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Ensure instance console log exists: /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG nova.network.neutron [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Successfully updated port: 459bf491-d464-42b1-be6c-282af882a38d {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquired lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG nova.network.neutron [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG nova.compute.manager [req-54ca6358-982b-4ab6-9c35-203522f1f26d req-3dff1102-0a29-49d4-83f4-bc5fdc483d64 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Received event network-changed-459bf491-d464-42b1-be6c-282af882a38d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG nova.compute.manager [req-54ca6358-982b-4ab6-9c35-203522f1f26d req-3dff1102-0a29-49d4-83f4-bc5fdc483d64 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Refreshing instance network info cache due to event network-changed-459bf491-d464-42b1-be6c-282af882a38d. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-54ca6358-982b-4ab6-9c35-203522f1f26d req-3dff1102-0a29-49d4-83f4-bc5fdc483d64 service nova] Acquiring lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG nova.network.neutron [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3c6bdcd-7c, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3c6bdcd-7c, col_values=(('qos', UUID('dfe44ef7-19b2-44f3-b1ef-719fa3e39324')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3c6bdcd-7c, col_values=(('external_ids', {'iface-id': 'c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:27:7b', 'vm-uuid': '25480185-8c9c-4aad-9c46-573cfbf65364'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:37 user nova-compute[75246]: INFO os_vif [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8,network=Network(75d646d7-52d6-4455-8014-0381aa33c56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c6bdcd-7c')
Nov 28 16:59:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:59:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] No VIF found with MAC fa:16:3e:85:27:7b, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.network.neutron [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Updating instance_info_cache with network_info: [{"id": "459bf491-d464-42b1-be6c-282af882a38d", "address": "fa:16:3e:4f:20:c2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459bf491-d4", "ovs_interfaceid": "459bf491-d464-42b1-be6c-282af882a38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Releasing lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.compute.manager [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Instance network_info: |[{"id": "459bf491-d464-42b1-be6c-282af882a38d", "address": "fa:16:3e:4f:20:c2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459bf491-d4", "ovs_interfaceid": "459bf491-d464-42b1-be6c-282af882a38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-54ca6358-982b-4ab6-9c35-203522f1f26d req-3dff1102-0a29-49d4-83f4-bc5fdc483d64 service nova] Acquired lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.network.neutron [req-54ca6358-982b-4ab6-9c35-203522f1f26d req-3dff1102-0a29-49d4-83f4-bc5fdc483d64 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Refreshing network info cache for port 459bf491-d464-42b1-be6c-282af882a38d {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Start _get_guest_xml network_info=[{"id": "459bf491-d464-42b1-be6c-282af882a38d", "address": "fa:16:3e:4f:20:c2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459bf491-d4", "ovs_interfaceid": "459bf491-d464-42b1-be6c-282af882a38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 16:59:38 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:59:38 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1210409474',display_name='tempest-ServerActionsTestOtherA-server-1210409474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1210409474',id=2,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5QoCu8z1J19YdF2KrIxtAcllUa+54ECbo+7UcXNC+vRRLTiAkI9KGg17d3KrbHvU7U2QxVzma0Ilz+ryH1d5iWfmR7mKkbwqDpkhmRExCuSVuBHZfoiX/4Pew1wkkhqw==',key_name='tempest-keypair-745476775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be06eee4e74a41b799f1df75ea55b955',ramdisk_id='',reservation_id='r-y588jx2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1554281978',owner_user_name='tempest-ServerActionsTestOtherA-1554281978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39d2eb0837eb4c729fe9ca2964cbe789',uuid=e1266470-c182-4c0c-a575-4c5043f54745,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "459bf491-d464-42b1-be6c-282af882a38d", "address": "fa:16:3e:4f:20:c2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459bf491-d4", "ovs_interfaceid": "459bf491-d464-42b1-be6c-282af882a38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converting VIF {"id": "459bf491-d464-42b1-be6c-282af882a38d", "address": "fa:16:3e:4f:20:c2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459bf491-d4", "ovs_interfaceid": "459bf491-d464-42b1-be6c-282af882a38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=459bf491-d464-42b1-be6c-282af882a38d,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459bf491-d4') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.objects.instance [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lazy-loading 'pci_devices' on Instance uuid e1266470-c182-4c0c-a575-4c5043f54745 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] End _get_guest_xml xml=<domain type="kvm">
Nov 28 16:59:38 user nova-compute[75246]:   <uuid>e1266470-c182-4c0c-a575-4c5043f54745</uuid>
Nov 28 16:59:38 user nova-compute[75246]:   <name>instance-00000002</name>
Nov 28 16:59:38 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 16:59:38 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 16:59:38 user nova-compute[75246]:   <metadata>
Nov 28 16:59:38 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 16:59:38 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 16:59:38 user nova-compute[75246]:       <nova:name>tempest-ServerActionsTestOtherA-server-1210409474</nova:name>
Nov 28 16:59:38 user nova-compute[75246]:       <nova:creationTime>2023-11-28 16:59:38</nova:creationTime>
Nov 28 16:59:38 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 16:59:38 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 16:59:38 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 16:59:38 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 16:59:38 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 16:59:38 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 16:59:38 user nova-compute[75246]:       </nova:flavor>
Nov 28 16:59:38 user nova-compute[75246]:       <nova:owner>
Nov 28 16:59:38 user nova-compute[75246]:         <nova:user uuid="39d2eb0837eb4c729fe9ca2964cbe789">tempest-ServerActionsTestOtherA-1554281978-project-member</nova:user>
Nov 28 16:59:38 user nova-compute[75246]:         <nova:project uuid="be06eee4e74a41b799f1df75ea55b955">tempest-ServerActionsTestOtherA-1554281978</nova:project>
Nov 28 16:59:38 user nova-compute[75246]:       </nova:owner>
Nov 28 16:59:38 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 16:59:38 user nova-compute[75246]:       <nova:ports>
Nov 28 16:59:38 user nova-compute[75246]:         <nova:port uuid="459bf491-d464-42b1-be6c-282af882a38d">
Nov 28 16:59:38 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 16:59:38 user nova-compute[75246]:         </nova:port>
Nov 28 16:59:38 user nova-compute[75246]:       </nova:ports>
Nov 28 16:59:38 user nova-compute[75246]:     </nova:instance>
Nov 28 16:59:38 user nova-compute[75246]:   </metadata>
Nov 28 16:59:38 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 16:59:38 user nova-compute[75246]:     <system>
Nov 28 16:59:38 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 16:59:38 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 16:59:38 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 16:59:38 user nova-compute[75246]:       <entry name="serial">e1266470-c182-4c0c-a575-4c5043f54745</entry>
Nov 28 16:59:38 user nova-compute[75246]:       <entry name="uuid">e1266470-c182-4c0c-a575-4c5043f54745</entry>
Nov 28 16:59:38 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 16:59:38 user nova-compute[75246]:     </system>
Nov 28 16:59:38 user nova-compute[75246]:   </sysinfo>
Nov 28 16:59:38 user nova-compute[75246]:   <os>
Nov 28 16:59:38 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 16:59:38 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 16:59:38 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 16:59:38 user nova-compute[75246]:   </os>
Nov 28 16:59:38 user nova-compute[75246]:   <features>
Nov 28 16:59:38 user nova-compute[75246]:     <acpi/>
Nov 28 16:59:38 user nova-compute[75246]:     <apic/>
Nov 28 16:59:38 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 16:59:38 user nova-compute[75246]:   </features>
Nov 28 16:59:38 user nova-compute[75246]:   <clock offset="utc">
Nov 28 16:59:38 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 16:59:38 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 16:59:38 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 16:59:38 user nova-compute[75246]:   </clock>
Nov 28 16:59:38 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 16:59:38 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 16:59:38 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 16:59:38 user nova-compute[75246]:   </cpu>
Nov 28 16:59:38 user nova-compute[75246]:   <devices>
Nov 28 16:59:38 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 16:59:38 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 16:59:38 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk"/>
Nov 28 16:59:38 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 16:59:38 user nova-compute[75246]:     </disk>
Nov 28 16:59:38 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 16:59:38 user nova-compute[75246]:       <mac address="fa:16:3e:4f:20:c2"/>
Nov 28 16:59:38 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 16:59:38 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 16:59:38 user nova-compute[75246]:       <target dev="tap459bf491-d4"/>
Nov 28 16:59:38 user nova-compute[75246]:     </interface>
Nov 28 16:59:38 user nova-compute[75246]:     <serial type="pty">
Nov 28 16:59:38 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/console.log" append="off"/>
Nov 28 16:59:38 user nova-compute[75246]:     </serial>
Nov 28 16:59:38 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 16:59:38 user nova-compute[75246]:     <video>
Nov 28 16:59:38 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 16:59:38 user nova-compute[75246]:     </video>
Nov 28 16:59:38 user nova-compute[75246]:     <rng model="virtio">
Nov 28 16:59:38 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 16:59:38 user nova-compute[75246]:     </rng>
Nov 28 16:59:38 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 16:59:38 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 16:59:38 user nova-compute[75246]:       <stats period="10"/>
Nov 28 16:59:38 user nova-compute[75246]:     </memballoon>
Nov 28 16:59:38 user nova-compute[75246]:   </devices>
Nov 28 16:59:38 user nova-compute[75246]: </domain>
Nov 28 16:59:38 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1210409474',display_name='tempest-ServerActionsTestOtherA-server-1210409474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1210409474',id=2,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5QoCu8z1J19YdF2KrIxtAcllUa+54ECbo+7UcXNC+vRRLTiAkI9KGg17d3KrbHvU7U2QxVzma0Ilz+ryH1d5iWfmR7mKkbwqDpkhmRExCuSVuBHZfoiX/4Pew1wkkhqw==',key_name='tempest-keypair-745476775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be06eee4e74a41b799f1df75ea55b955',ramdisk_id='',reservation_id='r-y588jx2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1554281978',owner_user_name='tempest-ServerActionsTestOtherA-1554281978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39d2eb0837eb4c729fe9ca2964cbe789',uuid=e1266470-c182-4c0c-a575-4c5043f54745,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "459bf491-d464-42b1-be6c-282af882a38d", "address": "fa:16:3e:4f:20:c2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459bf491-d4", "ovs_interfaceid": "459bf491-d464-42b1-be6c-282af882a38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converting VIF {"id": "459bf491-d464-42b1-be6c-282af882a38d", "address": "fa:16:3e:4f:20:c2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459bf491-d4", "ovs_interfaceid": "459bf491-d464-42b1-be6c-282af882a38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=459bf491-d464-42b1-be6c-282af882a38d,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459bf491-d4') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG os_vif [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=459bf491-d464-42b1-be6c-282af882a38d,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459bf491-d4') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '159ae1c8-be76-5330-a075-0ac740a868a9', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap459bf491-d4, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap459bf491-d4, col_values=(('qos', UUID('cdf75c3d-8c6e-4a55-9ee6-68e667c90019')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap459bf491-d4, col_values=(('external_ids', {'iface-id': '459bf491-d464-42b1-be6c-282af882a38d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:20:c2', 'vm-uuid': 'e1266470-c182-4c0c-a575-4c5043f54745'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:38 user nova-compute[75246]: INFO os_vif [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=459bf491-d464-42b1-be6c-282af882a38d,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459bf491-d4')
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] No VIF found with MAC fa:16:3e:4f:20:c2, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:38 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Successfully created port: 3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 16:59:39 user nova-compute[75246]: DEBUG nova.network.neutron [req-54ca6358-982b-4ab6-9c35-203522f1f26d req-3dff1102-0a29-49d4-83f4-bc5fdc483d64 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Updated VIF entry in instance network info cache for port 459bf491-d464-42b1-be6c-282af882a38d. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:59:39 user nova-compute[75246]: DEBUG nova.network.neutron [req-54ca6358-982b-4ab6-9c35-203522f1f26d req-3dff1102-0a29-49d4-83f4-bc5fdc483d64 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Updating instance_info_cache with network_info: [{"id": "459bf491-d464-42b1-be6c-282af882a38d", "address": "fa:16:3e:4f:20:c2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459bf491-d4", "ovs_interfaceid": "459bf491-d464-42b1-be6c-282af882a38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:59:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-54ca6358-982b-4ab6-9c35-203522f1f26d req-3dff1102-0a29-49d4-83f4-bc5fdc483d64 service nova] Releasing lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:59:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:40 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Successfully updated port: 3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 16:59:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:59:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquired lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:59:40 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 16:59:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:40 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 16:59:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-41c1d684-f933-43bd-854c-ee522d7671d3 req-51481209-31fa-46eb-a913-39978919c47d service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received event network-changed-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:59:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-41c1d684-f933-43bd-854c-ee522d7671d3 req-51481209-31fa-46eb-a913-39978919c47d service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Refreshing instance network info cache due to event network-changed-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:59:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-41c1d684-f933-43bd-854c-ee522d7671d3 req-51481209-31fa-46eb-a913-39978919c47d service nova] Acquiring lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:59:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Updating instance_info_cache with network_info: [{"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Releasing lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Instance network_info: |[{"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-41c1d684-f933-43bd-854c-ee522d7671d3 req-51481209-31fa-46eb-a913-39978919c47d service nova] Acquired lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.network.neutron [req-41c1d684-f933-43bd-854c-ee522d7671d3 req-51481209-31fa-46eb-a913-39978919c47d service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Refreshing network info cache for port 3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Start _get_guest_xml network_info=[{"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 16:59:41 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:59:41 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-511980533',display_name='tempest-ServerActionsTestOtherB-server-511980533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-511980533',id=3,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeYN/HSLFqD4XGGEXJ9b8W5tTZ1Q+j1Wl9INcd9I7zBrxI2z/wVXkIvtrK7OKu4ZT8jqxkECEhWOY/LUm6Wr8yFYH+XfgjPLkBJ3Cg5yb8oaGQFI8Npp1mQPS7budj7Eg==',key_name='tempest-keypair-789293158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3098a0e0fd3640d6b0c61303e10b9269',ramdisk_id='',reservation_id='r-ibzp3hny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-779885367',owner_user_name='tempest-ServerActionsTestOtherB-779885367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:59:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec11d8eaa57441e4b1178c39dfccd51f',uuid=4b650a57-5870-4f77-bca2-abe50d970b40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Converting VIF {"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.objects.instance [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b650a57-5870-4f77-bca2-abe50d970b40 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] End _get_guest_xml xml=<domain type="kvm">
Nov 28 16:59:41 user nova-compute[75246]:   <uuid>4b650a57-5870-4f77-bca2-abe50d970b40</uuid>
Nov 28 16:59:41 user nova-compute[75246]:   <name>instance-00000003</name>
Nov 28 16:59:41 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 16:59:41 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 16:59:41 user nova-compute[75246]:   <metadata>
Nov 28 16:59:41 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 16:59:41 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 16:59:41 user nova-compute[75246]:       <nova:name>tempest-ServerActionsTestOtherB-server-511980533</nova:name>
Nov 28 16:59:41 user nova-compute[75246]:       <nova:creationTime>2023-11-28 16:59:41</nova:creationTime>
Nov 28 16:59:41 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 16:59:41 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 16:59:41 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 16:59:41 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 16:59:41 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 16:59:41 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 16:59:41 user nova-compute[75246]:       </nova:flavor>
Nov 28 16:59:41 user nova-compute[75246]:       <nova:owner>
Nov 28 16:59:41 user nova-compute[75246]:         <nova:user uuid="ec11d8eaa57441e4b1178c39dfccd51f">tempest-ServerActionsTestOtherB-779885367-project-member</nova:user>
Nov 28 16:59:41 user nova-compute[75246]:         <nova:project uuid="3098a0e0fd3640d6b0c61303e10b9269">tempest-ServerActionsTestOtherB-779885367</nova:project>
Nov 28 16:59:41 user nova-compute[75246]:       </nova:owner>
Nov 28 16:59:41 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 16:59:41 user nova-compute[75246]:       <nova:ports>
Nov 28 16:59:41 user nova-compute[75246]:         <nova:port uuid="3b26f892-a21c-4c9f-b4f2-627ed62fb2c0">
Nov 28 16:59:41 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 16:59:41 user nova-compute[75246]:         </nova:port>
Nov 28 16:59:41 user nova-compute[75246]:       </nova:ports>
Nov 28 16:59:41 user nova-compute[75246]:     </nova:instance>
Nov 28 16:59:41 user nova-compute[75246]:   </metadata>
Nov 28 16:59:41 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 16:59:41 user nova-compute[75246]:     <system>
Nov 28 16:59:41 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 16:59:41 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 16:59:41 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 16:59:41 user nova-compute[75246]:       <entry name="serial">4b650a57-5870-4f77-bca2-abe50d970b40</entry>
Nov 28 16:59:41 user nova-compute[75246]:       <entry name="uuid">4b650a57-5870-4f77-bca2-abe50d970b40</entry>
Nov 28 16:59:41 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 16:59:41 user nova-compute[75246]:     </system>
Nov 28 16:59:41 user nova-compute[75246]:   </sysinfo>
Nov 28 16:59:41 user nova-compute[75246]:   <os>
Nov 28 16:59:41 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 16:59:41 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 16:59:41 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 16:59:41 user nova-compute[75246]:   </os>
Nov 28 16:59:41 user nova-compute[75246]:   <features>
Nov 28 16:59:41 user nova-compute[75246]:     <acpi/>
Nov 28 16:59:41 user nova-compute[75246]:     <apic/>
Nov 28 16:59:41 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 16:59:41 user nova-compute[75246]:   </features>
Nov 28 16:59:41 user nova-compute[75246]:   <clock offset="utc">
Nov 28 16:59:41 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 16:59:41 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 16:59:41 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 16:59:41 user nova-compute[75246]:   </clock>
Nov 28 16:59:41 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 16:59:41 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 16:59:41 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 16:59:41 user nova-compute[75246]:   </cpu>
Nov 28 16:59:41 user nova-compute[75246]:   <devices>
Nov 28 16:59:41 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 16:59:41 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 16:59:41 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk"/>
Nov 28 16:59:41 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 16:59:41 user nova-compute[75246]:     </disk>
Nov 28 16:59:41 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 16:59:41 user nova-compute[75246]:       <mac address="fa:16:3e:d2:1a:3a"/>
Nov 28 16:59:41 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 16:59:41 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 16:59:41 user nova-compute[75246]:       <target dev="tap3b26f892-a2"/>
Nov 28 16:59:41 user nova-compute[75246]:     </interface>
Nov 28 16:59:41 user nova-compute[75246]:     <serial type="pty">
Nov 28 16:59:41 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/console.log" append="off"/>
Nov 28 16:59:41 user nova-compute[75246]:     </serial>
Nov 28 16:59:41 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 16:59:41 user nova-compute[75246]:     <video>
Nov 28 16:59:41 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 16:59:41 user nova-compute[75246]:     </video>
Nov 28 16:59:41 user nova-compute[75246]:     <rng model="virtio">
Nov 28 16:59:41 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 16:59:41 user nova-compute[75246]:     </rng>
Nov 28 16:59:41 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 16:59:41 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 16:59:41 user nova-compute[75246]:       <stats period="10"/>
Nov 28 16:59:41 user nova-compute[75246]:     </memballoon>
Nov 28 16:59:41 user nova-compute[75246]:   </devices>
Nov 28 16:59:41 user nova-compute[75246]: </domain>
Nov 28 16:59:41 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-511980533',display_name='tempest-ServerActionsTestOtherB-server-511980533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-511980533',id=3,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeYN/HSLFqD4XGGEXJ9b8W5tTZ1Q+j1Wl9INcd9I7zBrxI2z/wVXkIvtrK7OKu4ZT8jqxkECEhWOY/LUm6Wr8yFYH+XfgjPLkBJ3Cg5yb8oaGQFI8Npp1mQPS7budj7Eg==',key_name='tempest-keypair-789293158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3098a0e0fd3640d6b0c61303e10b9269',ramdisk_id='',reservation_id='r-ibzp3hny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-779885367',owner_user_name='tempest-ServerActionsTestOtherB-779885367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:59:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec11d8eaa57441e4b1178c39dfccd51f',uuid=4b650a57-5870-4f77-bca2-abe50d970b40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Converting VIF {"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG os_vif [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab6fb5da-1db5-5550-9a5a-f117fb67053e', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b26f892-a2, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b26f892-a2, col_values=(('qos', UUID('ed2099d0-06dc-4a05-a2f0-e4f1d9318711')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b26f892-a2, col_values=(('external_ids', {'iface-id': '3b26f892-a21c-4c9f-b4f2-627ed62fb2c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:1a:3a', 'vm-uuid': '4b650a57-5870-4f77-bca2-abe50d970b40'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:41 user nova-compute[75246]: INFO os_vif [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2')
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:59:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] No VIF found with MAC fa:16:3e:d2:1a:3a, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:59:42 user nova-compute[75246]: DEBUG nova.network.neutron [req-41c1d684-f933-43bd-854c-ee522d7671d3 req-51481209-31fa-46eb-a913-39978919c47d service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Updated VIF entry in instance network info cache for port 3b26f892-a21c-4c9f-b4f2-627ed62fb2c0. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:59:42 user nova-compute[75246]: DEBUG nova.network.neutron [req-41c1d684-f933-43bd-854c-ee522d7671d3 req-51481209-31fa-46eb-a913-39978919c47d service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Updating instance_info_cache with network_info: [{"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:59:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-41c1d684-f933-43bd-854c-ee522d7671d3 req-51481209-31fa-46eb-a913-39978919c47d service nova] Releasing lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:59:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.compute.manager [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 16:59:43 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Instance spawned successfully.
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 16:59:43 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Instance spawned successfully.
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 16:59:43 user nova-compute[75246]: INFO nova.compute.manager [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Took 10.42 seconds to spawn the instance on the hypervisor.
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.compute.manager [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:59:43 user nova-compute[75246]: INFO nova.compute.manager [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Took 14.91 seconds to spawn the instance on the hypervisor.
Nov 28 16:59:43 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:59:43 user nova-compute[75246]: INFO nova.compute.manager [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Took 11.48 seconds to build instance.
Nov 28 16:59:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d804b652-8134-4205-8cd3-0ef0c901a08a tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "e1266470-c182-4c0c-a575-4c5043f54745" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.719s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:43 user nova-compute[75246]: INFO nova.compute.manager [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Took 16.02 seconds to build instance.
Nov 28 16:59:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b4162509-8ce4-4cce-93a0-1a600093856b tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "25480185-8c9c-4aad-9c46-573cfbf65364" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.221s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:45 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 16:59:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 16:59:45 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Instance spawned successfully.
Nov 28 16:59:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 16:59:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:59:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:59:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:59:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:59:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:59:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:59:45 user nova-compute[75246]: INFO nova.compute.manager [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Took 9.29 seconds to spawn the instance on the hypervisor.
Nov 28 16:59:45 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:59:46 user nova-compute[75246]: INFO nova.compute.manager [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Took 10.23 seconds to build instance.
Nov 28 16:59:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c68a286d-aeab-4bb9-ac3b-665c26e7ce73 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "4b650a57-5870-4f77-bca2-abe50d970b40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.535s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:48 user nova-compute[75246]: DEBUG nova.compute.manager [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 16:59:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:48 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 16:59:48 user nova-compute[75246]: INFO nova.compute.claims [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Claim successful on node user
Nov 28 16:59:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:49 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:59:49 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:59:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.898s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:49 user nova-compute[75246]: DEBUG nova.compute.manager [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 16:59:49 user nova-compute[75246]: DEBUG nova.compute.manager [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 16:59:49 user nova-compute[75246]: DEBUG nova.network.neutron [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 16:59:50 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 16:59:50 user nova-compute[75246]: DEBUG nova.compute.manager [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 16:59:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:50 user nova-compute[75246]: DEBUG nova.compute.manager [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 16:59:50 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 16:59:50 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Creating image(s)
Nov 28 16:59:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "/opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "/opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "/opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:50 user nova-compute[75246]: DEBUG nova.policy [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '136ea37d7d6a4cd1a2f4779f8e8c4cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559858a844e64c6c80e194efd0b71c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 16:59:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.250s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.227s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk 1073741824" returned: 0 in 0.078s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:51 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.258s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:51 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Checking if we can resize image /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 16:59:51 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:51 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:51 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Cannot resize image /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 16:59:51 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 16:59:51 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Ensure instance console log exists: /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 16:59:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:51 user nova-compute[75246]: DEBUG nova.compute.manager [req-498f1ad3-76dc-4aa2-be08-79530827a922 req-137100ac-f727-4798-8bf0-562572d9e0ae service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Received event network-vif-plugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:59:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-498f1ad3-76dc-4aa2-be08-79530827a922 req-137100ac-f727-4798-8bf0-562572d9e0ae service nova] Acquiring lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-498f1ad3-76dc-4aa2-be08-79530827a922 req-137100ac-f727-4798-8bf0-562572d9e0ae service nova] Lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-498f1ad3-76dc-4aa2-be08-79530827a922 req-137100ac-f727-4798-8bf0-562572d9e0ae service nova] Lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:51 user nova-compute[75246]: DEBUG nova.compute.manager [req-498f1ad3-76dc-4aa2-be08-79530827a922 req-137100ac-f727-4798-8bf0-562572d9e0ae service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] No waiting events found dispatching network-vif-plugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:59:51 user nova-compute[75246]: WARNING nova.compute.manager [req-498f1ad3-76dc-4aa2-be08-79530827a922 req-137100ac-f727-4798-8bf0-562572d9e0ae service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Received unexpected event network-vif-plugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 for instance with vm_state active and task_state None.
Nov 28 16:59:52 user nova-compute[75246]: DEBUG nova.network.neutron [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Successfully created port: 40798d97-9143-4283-90ba-2bf3f34c1f51 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 16:59:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Acquiring lock "f6fe7bf7-782c-4660-9612-101c9f277903" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "f6fe7bf7-782c-4660-9612-101c9f277903" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:52 user nova-compute[75246]: DEBUG nova.compute.manager [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 16:59:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:52 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 16:59:52 user nova-compute[75246]: INFO nova.compute.claims [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Claim successful on node user
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.888s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.compute.manager [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.compute.manager [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.network.neutron [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Acquiring lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:53 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.compute.manager [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.network.neutron [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Successfully updated port: 40798d97-9143-4283-90ba-2bf3f34c1f51 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "refresh_cache-915bc61e-eaea-40c0-a5ed-4d2a677477f8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquired lock "refresh_cache-915bc61e-eaea-40c0-a5ed-4d2a677477f8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.network.neutron [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-46889245-9ca9-4002-b00c-f23701898aeb req-64862a85-10f5-4376-b1ba-53b2cf28c9e5 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Received event network-changed-40798d97-9143-4283-90ba-2bf3f34c1f51 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-46889245-9ca9-4002-b00c-f23701898aeb req-64862a85-10f5-4376-b1ba-53b2cf28c9e5 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Refreshing instance network info cache due to event network-changed-40798d97-9143-4283-90ba-2bf3f34c1f51. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-46889245-9ca9-4002-b00c-f23701898aeb req-64862a85-10f5-4376-b1ba-53b2cf28c9e5 service nova] Acquiring lock "refresh_cache-915bc61e-eaea-40c0-a5ed-4d2a677477f8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-26007cc6-f52b-4aad-8ef3-cfac633aa2bd req-1d232e5b-86e2-40c6-945e-3f60b4aad15b service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Received event network-vif-plugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-26007cc6-f52b-4aad-8ef3-cfac633aa2bd req-1d232e5b-86e2-40c6-945e-3f60b4aad15b service nova] Acquiring lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-26007cc6-f52b-4aad-8ef3-cfac633aa2bd req-1d232e5b-86e2-40c6-945e-3f60b4aad15b service nova] Lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-26007cc6-f52b-4aad-8ef3-cfac633aa2bd req-1d232e5b-86e2-40c6-945e-3f60b4aad15b service nova] Lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-26007cc6-f52b-4aad-8ef3-cfac633aa2bd req-1d232e5b-86e2-40c6-945e-3f60b4aad15b service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] No waiting events found dispatching network-vif-plugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:59:53 user nova-compute[75246]: WARNING nova.compute.manager [req-26007cc6-f52b-4aad-8ef3-cfac633aa2bd req-1d232e5b-86e2-40c6-945e-3f60b4aad15b service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Received unexpected event network-vif-plugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 for instance with vm_state active and task_state None.
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-26007cc6-f52b-4aad-8ef3-cfac633aa2bd req-1d232e5b-86e2-40c6-945e-3f60b4aad15b service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received event network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-26007cc6-f52b-4aad-8ef3-cfac633aa2bd req-1d232e5b-86e2-40c6-945e-3f60b4aad15b service nova] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-26007cc6-f52b-4aad-8ef3-cfac633aa2bd req-1d232e5b-86e2-40c6-945e-3f60b4aad15b service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-26007cc6-f52b-4aad-8ef3-cfac633aa2bd req-1d232e5b-86e2-40c6-945e-3f60b4aad15b service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-26007cc6-f52b-4aad-8ef3-cfac633aa2bd req-1d232e5b-86e2-40c6-945e-3f60b4aad15b service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] No waiting events found dispatching network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:59:53 user nova-compute[75246]: WARNING nova.compute.manager [req-26007cc6-f52b-4aad-8ef3-cfac633aa2bd req-1d232e5b-86e2-40c6-945e-3f60b4aad15b service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received unexpected event network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 for instance with vm_state active and task_state None.
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-26007cc6-f52b-4aad-8ef3-cfac633aa2bd req-1d232e5b-86e2-40c6-945e-3f60b4aad15b service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received event network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-26007cc6-f52b-4aad-8ef3-cfac633aa2bd req-1d232e5b-86e2-40c6-945e-3f60b4aad15b service nova] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-26007cc6-f52b-4aad-8ef3-cfac633aa2bd req-1d232e5b-86e2-40c6-945e-3f60b4aad15b service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-26007cc6-f52b-4aad-8ef3-cfac633aa2bd req-1d232e5b-86e2-40c6-945e-3f60b4aad15b service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-26007cc6-f52b-4aad-8ef3-cfac633aa2bd req-1d232e5b-86e2-40c6-945e-3f60b4aad15b service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] No waiting events found dispatching network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:59:53 user nova-compute[75246]: WARNING nova.compute.manager [req-26007cc6-f52b-4aad-8ef3-cfac633aa2bd req-1d232e5b-86e2-40c6-945e-3f60b4aad15b service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received unexpected event network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 for instance with vm_state active and task_state None.
Nov 28 16:59:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 16:59:53 user nova-compute[75246]: INFO nova.compute.claims [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Claim successful on node user
Nov 28 16:59:53 user nova-compute[75246]: DEBUG nova.policy [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90e382903dea418ab2ff2ac4b0fd193a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710057a2ce0441d3a6d78aab651ee091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.compute.manager [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 16:59:54 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Creating image(s)
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "/opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "/opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.network.neutron [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.220s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Acquiring lock "a3fe15c9-36ab-404e-876e-e6241cca05f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.227s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.615s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk 1073741824" returned: 0 in 0.101s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.network.neutron [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Updating instance_info_cache with network_info: [{"id": "40798d97-9143-4283-90ba-2bf3f34c1f51", "address": "fa:16:3e:14:c6:95", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40798d97-91", "ovs_interfaceid": "40798d97-9143-4283-90ba-2bf3f34c1f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.network.neutron [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 16:59:54 user nova-compute[75246]: INFO nova.compute.claims [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Claim successful on node user
Nov 28 16:59:54 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Releasing lock "refresh_cache-915bc61e-eaea-40c0-a5ed-4d2a677477f8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.compute.manager [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Instance network_info: |[{"id": "40798d97-9143-4283-90ba-2bf3f34c1f51", "address": "fa:16:3e:14:c6:95", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40798d97-91", "ovs_interfaceid": "40798d97-9143-4283-90ba-2bf3f34c1f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-46889245-9ca9-4002-b00c-f23701898aeb req-64862a85-10f5-4376-b1ba-53b2cf28c9e5 service nova] Acquired lock "refresh_cache-915bc61e-eaea-40c0-a5ed-4d2a677477f8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.network.neutron [req-46889245-9ca9-4002-b00c-f23701898aeb req-64862a85-10f5-4376-b1ba-53b2cf28c9e5 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Refreshing network info cache for port 40798d97-9143-4283-90ba-2bf3f34c1f51 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Start _get_guest_xml network_info=[{"id": "40798d97-9143-4283-90ba-2bf3f34c1f51", "address": "fa:16:3e:14:c6:95", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40798d97-91", "ovs_interfaceid": "40798d97-9143-4283-90ba-2bf3f34c1f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.233s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:54 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:59:54 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 16:59:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1751311461',display_name='tempest-VolumesAdminNegativeTest-server-1751311461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1751311461',id=4,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZKL+VkKY4OwVImc8Jb4XnsPg1fehSD9ODJlEpJcUUBLi46TMEK4jjhP2FRqo1gZUepmLvGKzsbq/6Fmek3gp7nNID5q2WoX+z5IwK9dtfbb7xje3Q4cpFCB0lex8vkvw==',key_name='tempest-keypair-13715404',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='559858a844e64c6c80e194efd0b71c9c',ramdisk_id='',reservation_id='r-j8wyt9sr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-996939064',owner_user_name='tempest-VolumesAdminNegativeTest-996939064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:59:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='136ea37d7d6a4cd1a2f4779f8e8c4cb7',uuid=915bc61e-eaea-40c0-a5ed-4d2a677477f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40798d97-9143-4283-90ba-2bf3f34c1f51", "address": "fa:16:3e:14:c6:95", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40798d97-91", "ovs_interfaceid": "40798d97-9143-4283-90ba-2bf3f34c1f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Converting VIF {"id": "40798d97-9143-4283-90ba-2bf3f34c1f51", "address": "fa:16:3e:14:c6:95", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40798d97-91", "ovs_interfaceid": "40798d97-9143-4283-90ba-2bf3f34c1f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:c6:95,bridge_name='br-int',has_traffic_filtering=True,id=40798d97-9143-4283-90ba-2bf3f34c1f51,network=Network(7c4b4f14-738c-4741-a7d1-b831c7557206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40798d97-91') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.objects.instance [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lazy-loading 'pci_devices' on Instance uuid 915bc61e-eaea-40c0-a5ed-4d2a677477f8 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.policy [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbd0260065a347f7a0256138a726607a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8690f10b04e44af49d2a459f88573ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 16:59:55 user nova-compute[75246]:   <uuid>915bc61e-eaea-40c0-a5ed-4d2a677477f8</uuid>
Nov 28 16:59:55 user nova-compute[75246]:   <name>instance-00000004</name>
Nov 28 16:59:55 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 16:59:55 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 16:59:55 user nova-compute[75246]:   <metadata>
Nov 28 16:59:55 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 16:59:55 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 16:59:55 user nova-compute[75246]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1751311461</nova:name>
Nov 28 16:59:55 user nova-compute[75246]:       <nova:creationTime>2023-11-28 16:59:54</nova:creationTime>
Nov 28 16:59:55 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 16:59:55 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 16:59:55 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 16:59:55 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 16:59:55 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 16:59:55 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 16:59:55 user nova-compute[75246]:       </nova:flavor>
Nov 28 16:59:55 user nova-compute[75246]:       <nova:owner>
Nov 28 16:59:55 user nova-compute[75246]:         <nova:user uuid="136ea37d7d6a4cd1a2f4779f8e8c4cb7">tempest-VolumesAdminNegativeTest-996939064-project-member</nova:user>
Nov 28 16:59:55 user nova-compute[75246]:         <nova:project uuid="559858a844e64c6c80e194efd0b71c9c">tempest-VolumesAdminNegativeTest-996939064</nova:project>
Nov 28 16:59:55 user nova-compute[75246]:       </nova:owner>
Nov 28 16:59:55 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 16:59:55 user nova-compute[75246]:       <nova:ports>
Nov 28 16:59:55 user nova-compute[75246]:         <nova:port uuid="40798d97-9143-4283-90ba-2bf3f34c1f51">
Nov 28 16:59:55 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 16:59:55 user nova-compute[75246]:         </nova:port>
Nov 28 16:59:55 user nova-compute[75246]:       </nova:ports>
Nov 28 16:59:55 user nova-compute[75246]:     </nova:instance>
Nov 28 16:59:55 user nova-compute[75246]:   </metadata>
Nov 28 16:59:55 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 16:59:55 user nova-compute[75246]:     <system>
Nov 28 16:59:55 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 16:59:55 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 16:59:55 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 16:59:55 user nova-compute[75246]:       <entry name="serial">915bc61e-eaea-40c0-a5ed-4d2a677477f8</entry>
Nov 28 16:59:55 user nova-compute[75246]:       <entry name="uuid">915bc61e-eaea-40c0-a5ed-4d2a677477f8</entry>
Nov 28 16:59:55 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 16:59:55 user nova-compute[75246]:     </system>
Nov 28 16:59:55 user nova-compute[75246]:   </sysinfo>
Nov 28 16:59:55 user nova-compute[75246]:   <os>
Nov 28 16:59:55 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 16:59:55 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 16:59:55 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 16:59:55 user nova-compute[75246]:   </os>
Nov 28 16:59:55 user nova-compute[75246]:   <features>
Nov 28 16:59:55 user nova-compute[75246]:     <acpi/>
Nov 28 16:59:55 user nova-compute[75246]:     <apic/>
Nov 28 16:59:55 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 16:59:55 user nova-compute[75246]:   </features>
Nov 28 16:59:55 user nova-compute[75246]:   <clock offset="utc">
Nov 28 16:59:55 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 16:59:55 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 16:59:55 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 16:59:55 user nova-compute[75246]:   </clock>
Nov 28 16:59:55 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 16:59:55 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 16:59:55 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 16:59:55 user nova-compute[75246]:   </cpu>
Nov 28 16:59:55 user nova-compute[75246]:   <devices>
Nov 28 16:59:55 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 16:59:55 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 16:59:55 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk"/>
Nov 28 16:59:55 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 16:59:55 user nova-compute[75246]:     </disk>
Nov 28 16:59:55 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 16:59:55 user nova-compute[75246]:       <mac address="fa:16:3e:14:c6:95"/>
Nov 28 16:59:55 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 16:59:55 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 16:59:55 user nova-compute[75246]:       <target dev="tap40798d97-91"/>
Nov 28 16:59:55 user nova-compute[75246]:     </interface>
Nov 28 16:59:55 user nova-compute[75246]:     <serial type="pty">
Nov 28 16:59:55 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/console.log" append="off"/>
Nov 28 16:59:55 user nova-compute[75246]:     </serial>
Nov 28 16:59:55 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 16:59:55 user nova-compute[75246]:     <video>
Nov 28 16:59:55 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 16:59:55 user nova-compute[75246]:     </video>
Nov 28 16:59:55 user nova-compute[75246]:     <rng model="virtio">
Nov 28 16:59:55 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 16:59:55 user nova-compute[75246]:     </rng>
Nov 28 16:59:55 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 16:59:55 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 16:59:55 user nova-compute[75246]:       <stats period="10"/>
Nov 28 16:59:55 user nova-compute[75246]:     </memballoon>
Nov 28 16:59:55 user nova-compute[75246]:   </devices>
Nov 28 16:59:55 user nova-compute[75246]: </domain>
Nov 28 16:59:55 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1751311461',display_name='tempest-VolumesAdminNegativeTest-server-1751311461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1751311461',id=4,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZKL+VkKY4OwVImc8Jb4XnsPg1fehSD9ODJlEpJcUUBLi46TMEK4jjhP2FRqo1gZUepmLvGKzsbq/6Fmek3gp7nNID5q2WoX+z5IwK9dtfbb7xje3Q4cpFCB0lex8vkvw==',key_name='tempest-keypair-13715404',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='559858a844e64c6c80e194efd0b71c9c',ramdisk_id='',reservation_id='r-j8wyt9sr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-996939064',owner_user_name='tempest-VolumesAdminNegativeTest-996939064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:59:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='136ea37d7d6a4cd1a2f4779f8e8c4cb7',uuid=915bc61e-eaea-40c0-a5ed-4d2a677477f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40798d97-9143-4283-90ba-2bf3f34c1f51", "address": "fa:16:3e:14:c6:95", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40798d97-91", "ovs_interfaceid": "40798d97-9143-4283-90ba-2bf3f34c1f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Converting VIF {"id": "40798d97-9143-4283-90ba-2bf3f34c1f51", "address": "fa:16:3e:14:c6:95", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40798d97-91", "ovs_interfaceid": "40798d97-9143-4283-90ba-2bf3f34c1f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:c6:95,bridge_name='br-int',has_traffic_filtering=True,id=40798d97-9143-4283-90ba-2bf3f34c1f51,network=Network(7c4b4f14-738c-4741-a7d1-b831c7557206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40798d97-91') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG os_vif [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:c6:95,bridge_name='br-int',has_traffic_filtering=True,id=40798d97-9143-4283-90ba-2bf3f34c1f51,network=Network(7c4b4f14-738c-4741-a7d1-b831c7557206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40798d97-91') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Cannot resize image /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Ensure instance console log exists: /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6af429b8-694c-5749-852f-7266c203b1e4', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40798d97-91, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40798d97-91, col_values=(('qos', UUID('da7e5e23-fe7f-466b-8989-c5b31ba75312')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40798d97-91, col_values=(('external_ids', {'iface-id': '40798d97-9143-4283-90ba-2bf3f34c1f51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:c6:95', 'vm-uuid': '915bc61e-eaea-40c0-a5ed-4d2a677477f8'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:55 user nova-compute[75246]: INFO os_vif [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:c6:95,bridge_name='br-int',has_traffic_filtering=True,id=40798d97-9143-4283-90ba-2bf3f34c1f51,network=Network(7c4b4f14-738c-4741-a7d1-b831c7557206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40798d97-91')
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 16:59:55 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Creating image(s)
Nov 28 16:59:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "/opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "/opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Acquiring lock "348aa57f1044b5ca43d018011788b8dcb09c945d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "348aa57f1044b5ca43d018011788b8dcb09c945d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:59:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] No VIF found with MAC fa:16:3e:14:c6:95, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:59:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d.part --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:56 user nova-compute[75246]: DEBUG nova.network.neutron [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Successfully created port: 5fe78c0a-025c-4ce0-b370-83959a0e2df7 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 16:59:56 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:59:56 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:59:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.682s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:56 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 16:59:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d.part --force-share --output=json" returned: 0 in 0.306s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:56 user nova-compute[75246]: DEBUG nova.virt.images [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] 6ec16204-ddec-48db-8b46-68c22470c751 was qcow2, converting to raw {{(pid=75246) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 16:59:56 user nova-compute[75246]: DEBUG nova.privsep.utils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75246) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 16:59:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d.part /opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d.converted {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:56 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 16:59:56 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 16:59:56 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 16:59:56 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 16:59:56 user nova-compute[75246]: DEBUG nova.network.neutron [req-46889245-9ca9-4002-b00c-f23701898aeb req-64862a85-10f5-4376-b1ba-53b2cf28c9e5 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Updated VIF entry in instance network info cache for port 40798d97-9143-4283-90ba-2bf3f34c1f51. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:59:56 user nova-compute[75246]: DEBUG nova.network.neutron [req-46889245-9ca9-4002-b00c-f23701898aeb req-64862a85-10f5-4376-b1ba-53b2cf28c9e5 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Updating instance_info_cache with network_info: [{"id": "40798d97-9143-4283-90ba-2bf3f34c1f51", "address": "fa:16:3e:14:c6:95", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40798d97-91", "ovs_interfaceid": "40798d97-9143-4283-90ba-2bf3f34c1f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:59:56 user nova-compute[75246]: DEBUG nova.policy [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dfa371d2b74849bcaa6d181975484b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e482757bdc6447e6bbb8023603b840bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 16:59:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-46889245-9ca9-4002-b00c-f23701898aeb req-64862a85-10f5-4376-b1ba-53b2cf28c9e5 service nova] Releasing lock "refresh_cache-915bc61e-eaea-40c0-a5ed-4d2a677477f8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:59:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d.part /opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d.converted" returned: 0 in 0.489s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d.converted --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 16:59:57 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Creating image(s)
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "/opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "/opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d.converted --force-share --output=json" returned: 0 in 0.349s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "348aa57f1044b5ca43d018011788b8dcb09c945d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.039s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.256s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d --force-share --output=json" returned: 0 in 0.206s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Acquiring lock "348aa57f1044b5ca43d018011788b8dcb09c945d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "348aa57f1044b5ca43d018011788b8dcb09c945d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG nova.network.neutron [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Successfully updated port: 5fe78c0a-025c-4ce0-b370-83959a0e2df7 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG nova.network.neutron [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Successfully created port: 26780137-c1a5-41f0-9c41-e2b2cf450405 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.281s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-0ed36596-0e3e-4e79-a613-50cad6a0691f req-c0c4cab0-fd4d-4d55-9ce2-c0030c8801bf service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Received event network-changed-5fe78c0a-025c-4ce0-b370-83959a0e2df7 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-0ed36596-0e3e-4e79-a613-50cad6a0691f req-c0c4cab0-fd4d-4d55-9ce2-c0030c8801bf service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Refreshing instance network info cache due to event network-changed-5fe78c0a-025c-4ce0-b370-83959a0e2df7. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0ed36596-0e3e-4e79-a613-50cad6a0691f req-c0c4cab0-fd4d-4d55-9ce2-c0030c8801bf service nova] Acquiring lock "refresh_cache-f6fe7bf7-782c-4660-9612-101c9f277903" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0ed36596-0e3e-4e79-a613-50cad6a0691f req-c0c4cab0-fd4d-4d55-9ce2-c0030c8801bf service nova] Acquired lock "refresh_cache-f6fe7bf7-782c-4660-9612-101c9f277903" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG nova.network.neutron [req-0ed36596-0e3e-4e79-a613-50cad6a0691f req-c0c4cab0-fd4d-4d55-9ce2-c0030c8801bf service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Refreshing network info cache for port 5fe78c0a-025c-4ce0-b370-83959a0e2df7 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Acquiring lock "refresh_cache-f6fe7bf7-782c-4660-9612-101c9f277903" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk 1073741824" returned: 0 in 0.171s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d --force-share --output=json" returned: 0 in 0.296s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.465s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d,backing_fmt=raw /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d,backing_fmt=raw /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk 1073741824" returned: 0 in 0.064s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "348aa57f1044b5ca43d018011788b8dcb09c945d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.429s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.208s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG nova.network.neutron [req-0ed36596-0e3e-4e79-a613-50cad6a0691f req-c0c4cab0-fd4d-4d55-9ce2-c0030c8801bf service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d --force-share --output=json" returned: 0 in 0.308s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Cannot resize image /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Ensure instance console log exists: /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Cannot resize image /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Ensure instance console log exists: /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG nova.network.neutron [req-0ed36596-0e3e-4e79-a613-50cad6a0691f req-c0c4cab0-fd4d-4d55-9ce2-c0030c8801bf service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0ed36596-0e3e-4e79-a613-50cad6a0691f req-c0c4cab0-fd4d-4d55-9ce2-c0030c8801bf service nova] Releasing lock "refresh_cache-f6fe7bf7-782c-4660-9612-101c9f277903" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Acquired lock "refresh_cache-f6fe7bf7-782c-4660-9612-101c9f277903" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG nova.network.neutron [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG nova.network.neutron [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 16:59:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Successfully created port: 768ccf6f-fd61-45d1-b92f-1757a17dd630 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.network.neutron [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Updating instance_info_cache with network_info: [{"id": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "address": "fa:16:3e:d6:6b:75", "network": {"id": "d5b830a2-9940-49dc-947f-accb65b0f73a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1793539391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710057a2ce0441d3a6d78aab651ee091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe78c0a-02", "ovs_interfaceid": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Releasing lock "refresh_cache-f6fe7bf7-782c-4660-9612-101c9f277903" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.compute.manager [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Instance network_info: |[{"id": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "address": "fa:16:3e:d6:6b:75", "network": {"id": "d5b830a2-9940-49dc-947f-accb65b0f73a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1793539391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710057a2ce0441d3a6d78aab651ee091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe78c0a-02", "ovs_interfaceid": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Start _get_guest_xml network_info=[{"id": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "address": "fa:16:3e:d6:6b:75", "network": {"id": "d5b830a2-9940-49dc-947f-accb65b0f73a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1793539391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710057a2ce0441d3a6d78aab651ee091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe78c0a-02", "ovs_interfaceid": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 16:59:59 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:59:59 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-438192936',display_name='tempest-TestVolumeSwap-server-438192936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-438192936',id=5,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmb9iqAq8cVkq7Ta/yQKi954GQnH4/8zXmeyg2DZAENLt1AW1tNEDN9dQR2uXAryz0lRMSTv41jDirlVXQgg3NbMHiHxHeOr8GwPTx7DVZeiC04q2Yb279wpEfNqukqpw==',key_name='tempest-keypair-1299658914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='710057a2ce0441d3a6d78aab651ee091',ramdisk_id='',reservation_id='r-v78zfrog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-84820142',owner_user_name='tempest-TestVolumeSwap-84820142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:59:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e382903dea418ab2ff2ac4b0fd193a',uuid=f6fe7bf7-782c-4660-9612-101c9f277903,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "address": "fa:16:3e:d6:6b:75", "network": {"id": "d5b830a2-9940-49dc-947f-accb65b0f73a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1793539391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710057a2ce0441d3a6d78aab651ee091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe78c0a-02", "ovs_interfaceid": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Converting VIF {"id": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "address": "fa:16:3e:d6:6b:75", "network": {"id": "d5b830a2-9940-49dc-947f-accb65b0f73a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1793539391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710057a2ce0441d3a6d78aab651ee091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe78c0a-02", "ovs_interfaceid": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6b:75,bridge_name='br-int',has_traffic_filtering=True,id=5fe78c0a-025c-4ce0-b370-83959a0e2df7,network=Network(d5b830a2-9940-49dc-947f-accb65b0f73a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe78c0a-02') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.objects.instance [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lazy-loading 'pci_devices' on Instance uuid f6fe7bf7-782c-4660-9612-101c9f277903 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] End _get_guest_xml xml=<domain type="kvm">
Nov 28 16:59:59 user nova-compute[75246]:   <uuid>f6fe7bf7-782c-4660-9612-101c9f277903</uuid>
Nov 28 16:59:59 user nova-compute[75246]:   <name>instance-00000005</name>
Nov 28 16:59:59 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 16:59:59 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 16:59:59 user nova-compute[75246]:   <metadata>
Nov 28 16:59:59 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 16:59:59 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 16:59:59 user nova-compute[75246]:       <nova:name>tempest-TestVolumeSwap-server-438192936</nova:name>
Nov 28 16:59:59 user nova-compute[75246]:       <nova:creationTime>2023-11-28 16:59:59</nova:creationTime>
Nov 28 16:59:59 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 16:59:59 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 16:59:59 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 16:59:59 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 16:59:59 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 16:59:59 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 16:59:59 user nova-compute[75246]:       </nova:flavor>
Nov 28 16:59:59 user nova-compute[75246]:       <nova:owner>
Nov 28 16:59:59 user nova-compute[75246]:         <nova:user uuid="90e382903dea418ab2ff2ac4b0fd193a">tempest-TestVolumeSwap-84820142-project-member</nova:user>
Nov 28 16:59:59 user nova-compute[75246]:         <nova:project uuid="710057a2ce0441d3a6d78aab651ee091">tempest-TestVolumeSwap-84820142</nova:project>
Nov 28 16:59:59 user nova-compute[75246]:       </nova:owner>
Nov 28 16:59:59 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 16:59:59 user nova-compute[75246]:       <nova:ports>
Nov 28 16:59:59 user nova-compute[75246]:         <nova:port uuid="5fe78c0a-025c-4ce0-b370-83959a0e2df7">
Nov 28 16:59:59 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 16:59:59 user nova-compute[75246]:         </nova:port>
Nov 28 16:59:59 user nova-compute[75246]:       </nova:ports>
Nov 28 16:59:59 user nova-compute[75246]:     </nova:instance>
Nov 28 16:59:59 user nova-compute[75246]:   </metadata>
Nov 28 16:59:59 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 16:59:59 user nova-compute[75246]:     <system>
Nov 28 16:59:59 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 16:59:59 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 16:59:59 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 16:59:59 user nova-compute[75246]:       <entry name="serial">f6fe7bf7-782c-4660-9612-101c9f277903</entry>
Nov 28 16:59:59 user nova-compute[75246]:       <entry name="uuid">f6fe7bf7-782c-4660-9612-101c9f277903</entry>
Nov 28 16:59:59 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 16:59:59 user nova-compute[75246]:     </system>
Nov 28 16:59:59 user nova-compute[75246]:   </sysinfo>
Nov 28 16:59:59 user nova-compute[75246]:   <os>
Nov 28 16:59:59 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 16:59:59 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 16:59:59 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 16:59:59 user nova-compute[75246]:   </os>
Nov 28 16:59:59 user nova-compute[75246]:   <features>
Nov 28 16:59:59 user nova-compute[75246]:     <acpi/>
Nov 28 16:59:59 user nova-compute[75246]:     <apic/>
Nov 28 16:59:59 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 16:59:59 user nova-compute[75246]:   </features>
Nov 28 16:59:59 user nova-compute[75246]:   <clock offset="utc">
Nov 28 16:59:59 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 16:59:59 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 16:59:59 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 16:59:59 user nova-compute[75246]:   </clock>
Nov 28 16:59:59 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 16:59:59 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 16:59:59 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 16:59:59 user nova-compute[75246]:   </cpu>
Nov 28 16:59:59 user nova-compute[75246]:   <devices>
Nov 28 16:59:59 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 16:59:59 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 16:59:59 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk"/>
Nov 28 16:59:59 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 16:59:59 user nova-compute[75246]:     </disk>
Nov 28 16:59:59 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 16:59:59 user nova-compute[75246]:       <mac address="fa:16:3e:d6:6b:75"/>
Nov 28 16:59:59 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 16:59:59 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 16:59:59 user nova-compute[75246]:       <target dev="tap5fe78c0a-02"/>
Nov 28 16:59:59 user nova-compute[75246]:     </interface>
Nov 28 16:59:59 user nova-compute[75246]:     <serial type="pty">
Nov 28 16:59:59 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/console.log" append="off"/>
Nov 28 16:59:59 user nova-compute[75246]:     </serial>
Nov 28 16:59:59 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 16:59:59 user nova-compute[75246]:     <video>
Nov 28 16:59:59 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 16:59:59 user nova-compute[75246]:     </video>
Nov 28 16:59:59 user nova-compute[75246]:     <rng model="virtio">
Nov 28 16:59:59 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 16:59:59 user nova-compute[75246]:     </rng>
Nov 28 16:59:59 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 16:59:59 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 16:59:59 user nova-compute[75246]:       <stats period="10"/>
Nov 28 16:59:59 user nova-compute[75246]:     </memballoon>
Nov 28 16:59:59 user nova-compute[75246]:   </devices>
Nov 28 16:59:59 user nova-compute[75246]: </domain>
Nov 28 16:59:59 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-438192936',display_name='tempest-TestVolumeSwap-server-438192936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-438192936',id=5,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmb9iqAq8cVkq7Ta/yQKi954GQnH4/8zXmeyg2DZAENLt1AW1tNEDN9dQR2uXAryz0lRMSTv41jDirlVXQgg3NbMHiHxHeOr8GwPTx7DVZeiC04q2Yb279wpEfNqukqpw==',key_name='tempest-keypair-1299658914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='710057a2ce0441d3a6d78aab651ee091',ramdisk_id='',reservation_id='r-v78zfrog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-84820142',owner_user_name='tempest-TestVolumeSwap-84820142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:59:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e382903dea418ab2ff2ac4b0fd193a',uuid=f6fe7bf7-782c-4660-9612-101c9f277903,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "address": "fa:16:3e:d6:6b:75", "network": {"id": "d5b830a2-9940-49dc-947f-accb65b0f73a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1793539391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710057a2ce0441d3a6d78aab651ee091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe78c0a-02", "ovs_interfaceid": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Converting VIF {"id": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "address": "fa:16:3e:d6:6b:75", "network": {"id": "d5b830a2-9940-49dc-947f-accb65b0f73a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1793539391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710057a2ce0441d3a6d78aab651ee091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe78c0a-02", "ovs_interfaceid": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6b:75,bridge_name='br-int',has_traffic_filtering=True,id=5fe78c0a-025c-4ce0-b370-83959a0e2df7,network=Network(d5b830a2-9940-49dc-947f-accb65b0f73a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe78c0a-02') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG os_vif [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6b:75,bridge_name='br-int',has_traffic_filtering=True,id=5fe78c0a-025c-4ce0-b370-83959a0e2df7,network=Network(d5b830a2-9940-49dc-947f-accb65b0f73a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe78c0a-02') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c9c3e61-52a9-5da4-a091-12742460a96b', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fe78c0a-02, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5fe78c0a-02, col_values=(('qos', UUID('4a2707c9-ec2f-4817-9713-240cf1964c83')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5fe78c0a-02, col_values=(('external_ids', {'iface-id': '5fe78c0a-025c-4ce0-b370-83959a0e2df7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:6b:75', 'vm-uuid': 'f6fe7bf7-782c-4660-9612-101c9f277903'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:59:59 user nova-compute[75246]: INFO os_vif [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6b:75,bridge_name='br-int',has_traffic_filtering=True,id=5fe78c0a-025c-4ce0-b370-83959a0e2df7,network=Network(d5b830a2-9940-49dc-947f-accb65b0f73a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe78c0a-02')
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] No VIF found with MAC fa:16:3e:d6:6b:75, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.network.neutron [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Successfully updated port: 26780137-c1a5-41f0-9c41-e2b2cf450405 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Acquiring lock "refresh_cache-e0df8b51-bda3-4c45-ab54-c6097f6136ad" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Acquired lock "refresh_cache-e0df8b51-bda3-4c45-ab54-c6097f6136ad" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.network.neutron [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-8561f155-e91a-442e-b1fe-915a6ba172b2 req-ee1f1d68-eaa5-43c1-91aa-ae789b484934 service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Received event network-changed-26780137-c1a5-41f0-9c41-e2b2cf450405 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-8561f155-e91a-442e-b1fe-915a6ba172b2 req-ee1f1d68-eaa5-43c1-91aa-ae789b484934 service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Refreshing instance network info cache due to event network-changed-26780137-c1a5-41f0-9c41-e2b2cf450405. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8561f155-e91a-442e-b1fe-915a6ba172b2 req-ee1f1d68-eaa5-43c1-91aa-ae789b484934 service nova] Acquiring lock "refresh_cache-e0df8b51-bda3-4c45-ab54-c6097f6136ad" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-8fe3a0df-aa84-4ca7-bf46-e6020f79e31f req-b527eab0-2ab8-4607-8a98-56141b974ff1 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Received event network-vif-plugged-40798d97-9143-4283-90ba-2bf3f34c1f51 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8fe3a0df-aa84-4ca7-bf46-e6020f79e31f req-b527eab0-2ab8-4607-8a98-56141b974ff1 service nova] Acquiring lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8fe3a0df-aa84-4ca7-bf46-e6020f79e31f req-b527eab0-2ab8-4607-8a98-56141b974ff1 service nova] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8fe3a0df-aa84-4ca7-bf46-e6020f79e31f req-b527eab0-2ab8-4607-8a98-56141b974ff1 service nova] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-8fe3a0df-aa84-4ca7-bf46-e6020f79e31f req-b527eab0-2ab8-4607-8a98-56141b974ff1 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] No waiting events found dispatching network-vif-plugged-40798d97-9143-4283-90ba-2bf3f34c1f51 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:59:59 user nova-compute[75246]: WARNING nova.compute.manager [req-8fe3a0df-aa84-4ca7-bf46-e6020f79e31f req-b527eab0-2ab8-4607-8a98-56141b974ff1 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Received unexpected event network-vif-plugged-40798d97-9143-4283-90ba-2bf3f34c1f51 for instance with vm_state building and task_state spawning.
Nov 28 16:59:59 user nova-compute[75246]: DEBUG nova.network.neutron [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.compute.manager [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:00:00 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Instance spawned successfully.
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:00 user nova-compute[75246]: INFO nova.compute.manager [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Took 10.06 seconds to spawn the instance on the hypervisor.
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.compute.manager [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:00:00 user nova-compute[75246]: INFO nova.compute.manager [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Took 11.68 seconds to build instance.
Nov 28 17:00:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bffc7c5b-53a1-4961-9717-664226562525 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.918s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.network.neutron [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Updating instance_info_cache with network_info: [{"id": "26780137-c1a5-41f0-9c41-e2b2cf450405", "address": "fa:16:3e:b2:ec:27", "network": {"id": "a530cf40-41ff-4ed1-8b02-264d7b7830c8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-656328324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8690f10b04e44af49d2a459f88573ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26780137-c1", "ovs_interfaceid": "26780137-c1a5-41f0-9c41-e2b2cf450405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Releasing lock "refresh_cache-e0df8b51-bda3-4c45-ab54-c6097f6136ad" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Instance network_info: |[{"id": "26780137-c1a5-41f0-9c41-e2b2cf450405", "address": "fa:16:3e:b2:ec:27", "network": {"id": "a530cf40-41ff-4ed1-8b02-264d7b7830c8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-656328324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8690f10b04e44af49d2a459f88573ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26780137-c1", "ovs_interfaceid": "26780137-c1a5-41f0-9c41-e2b2cf450405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8561f155-e91a-442e-b1fe-915a6ba172b2 req-ee1f1d68-eaa5-43c1-91aa-ae789b484934 service nova] Acquired lock "refresh_cache-e0df8b51-bda3-4c45-ab54-c6097f6136ad" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.network.neutron [req-8561f155-e91a-442e-b1fe-915a6ba172b2 req-ee1f1d68-eaa5-43c1-91aa-ae789b484934 service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Refreshing network info cache for port 26780137-c1a5-41f0-9c41-e2b2cf450405 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Start _get_guest_xml network_info=[{"id": "26780137-c1a5-41f0-9c41-e2b2cf450405", "address": "fa:16:3e:b2:ec:27", "network": {"id": "a530cf40-41ff-4ed1-8b02-264d7b7830c8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-656328324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8690f10b04e44af49d2a459f88573ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26780137-c1", "ovs_interfaceid": "26780137-c1a5-41f0-9c41-e2b2cf450405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:59:44Z,direct_url=<?>,disk_format='qcow2',id=6ec16204-ddec-48db-8b46-68c22470c751,min_disk=0,min_ram=0,name='',owner='cbd3efb3aef7426795f742d623b18872',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:59:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'boot_index': 0, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '6ec16204-ddec-48db-8b46-68c22470c751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:00:00 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:00:00 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:59:44Z,direct_url=<?>,disk_format='qcow2',id=6ec16204-ddec-48db-8b46-68c22470c751,min_disk=0,min_ram=0,name='',owner='cbd3efb3aef7426795f742d623b18872',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:59:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T16:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-837581652',display_name='tempest-AttachSCSIVolumeTestJSON-server-837581652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-837581652',id=6,image_ref='6ec16204-ddec-48db-8b46-68c22470c751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWDNMUX1bRPsmt/iVFeejvhXsdDdxxYQeAutD/RP2MdG599hA1KhdrBKcVjNx2MlkxRinQObD5H7uB4twopw3/j8vacwCw4mwnnxuFJraohMJG4xrZaP5eVkd9ib2Ab5A==',key_name='tempest-keypair-18747782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8690f10b04e44af49d2a459f88573ecd',ramdisk_id='',reservation_id='r-3z30xpqt',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec16204-ddec-48db-8b46-68c22470c751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-884776922',owner_user_name='tempest-AttachSCSIVolumeTestJSON-884776922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbd0260065a347f7a0256138a726607a',uuid=e0df8b51-bda3-4c45-ab54-c6097f6136ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26780137-c1a5-41f0-9c41-e2b2cf450405", "address": "fa:16:3e:b2:ec:27", "network": {"id": "a530cf40-41ff-4ed1-8b02-264d7b7830c8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-656328324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8690f10b04e44af49d2a459f88573ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26780137-c1", "ovs_interfaceid": "26780137-c1a5-41f0-9c41-e2b2cf450405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Converting VIF {"id": "26780137-c1a5-41f0-9c41-e2b2cf450405", "address": "fa:16:3e:b2:ec:27", "network": {"id": "a530cf40-41ff-4ed1-8b02-264d7b7830c8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-656328324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8690f10b04e44af49d2a459f88573ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26780137-c1", "ovs_interfaceid": "26780137-c1a5-41f0-9c41-e2b2cf450405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ec:27,bridge_name='br-int',has_traffic_filtering=True,id=26780137-c1a5-41f0-9c41-e2b2cf450405,network=Network(a530cf40-41ff-4ed1-8b02-264d7b7830c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26780137-c1') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.objects.instance [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lazy-loading 'pci_devices' on Instance uuid e0df8b51-bda3-4c45-ab54-c6097f6136ad {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:00:00 user nova-compute[75246]:   <uuid>e0df8b51-bda3-4c45-ab54-c6097f6136ad</uuid>
Nov 28 17:00:00 user nova-compute[75246]:   <name>instance-00000006</name>
Nov 28 17:00:00 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:00:00 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:00:00 user nova-compute[75246]:   <metadata>
Nov 28 17:00:00 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:00:00 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:00:00 user nova-compute[75246]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-837581652</nova:name>
Nov 28 17:00:00 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:00:00</nova:creationTime>
Nov 28 17:00:00 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:00:00 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:00:00 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:00:00 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:00:00 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:00:00 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:00:00 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:00:00 user nova-compute[75246]:       <nova:owner>
Nov 28 17:00:00 user nova-compute[75246]:         <nova:user uuid="bbd0260065a347f7a0256138a726607a">tempest-AttachSCSIVolumeTestJSON-884776922-project-member</nova:user>
Nov 28 17:00:00 user nova-compute[75246]:         <nova:project uuid="8690f10b04e44af49d2a459f88573ecd">tempest-AttachSCSIVolumeTestJSON-884776922</nova:project>
Nov 28 17:00:00 user nova-compute[75246]:       </nova:owner>
Nov 28 17:00:00 user nova-compute[75246]:       <nova:root type="image" uuid="6ec16204-ddec-48db-8b46-68c22470c751"/>
Nov 28 17:00:00 user nova-compute[75246]:       <nova:ports>
Nov 28 17:00:00 user nova-compute[75246]:         <nova:port uuid="26780137-c1a5-41f0-9c41-e2b2cf450405">
Nov 28 17:00:00 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 17:00:00 user nova-compute[75246]:         </nova:port>
Nov 28 17:00:00 user nova-compute[75246]:       </nova:ports>
Nov 28 17:00:00 user nova-compute[75246]:     </nova:instance>
Nov 28 17:00:00 user nova-compute[75246]:   </metadata>
Nov 28 17:00:00 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:00:00 user nova-compute[75246]:     <system>
Nov 28 17:00:00 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:00:00 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:00:00 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:00:00 user nova-compute[75246]:       <entry name="serial">e0df8b51-bda3-4c45-ab54-c6097f6136ad</entry>
Nov 28 17:00:00 user nova-compute[75246]:       <entry name="uuid">e0df8b51-bda3-4c45-ab54-c6097f6136ad</entry>
Nov 28 17:00:00 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:00:00 user nova-compute[75246]:     </system>
Nov 28 17:00:00 user nova-compute[75246]:   </sysinfo>
Nov 28 17:00:00 user nova-compute[75246]:   <os>
Nov 28 17:00:00 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:00:00 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:00:00 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:00:00 user nova-compute[75246]:   </os>
Nov 28 17:00:00 user nova-compute[75246]:   <features>
Nov 28 17:00:00 user nova-compute[75246]:     <acpi/>
Nov 28 17:00:00 user nova-compute[75246]:     <apic/>
Nov 28 17:00:00 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:00:00 user nova-compute[75246]:   </features>
Nov 28 17:00:00 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:00:00 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:00:00 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:00:00 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:00:00 user nova-compute[75246]:   </clock>
Nov 28 17:00:00 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:00:00 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:00:00 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:00:00 user nova-compute[75246]:   </cpu>
Nov 28 17:00:00 user nova-compute[75246]:   <devices>
Nov 28 17:00:00 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:00:00 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:00:00 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk"/>
Nov 28 17:00:00 user nova-compute[75246]:       <target dev="sda" bus="scsi"/>
Nov 28 17:00:00 user nova-compute[75246]:       <address type="drive" controller="0" unit="0"/>
Nov 28 17:00:00 user nova-compute[75246]:     </disk>
Nov 28 17:00:00 user nova-compute[75246]:     <disk type="file" device="cdrom">
Nov 28 17:00:00 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 17:00:00 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk.config"/>
Nov 28 17:00:00 user nova-compute[75246]:       <target dev="sdb" bus="scsi"/>
Nov 28 17:00:00 user nova-compute[75246]:       <address type="drive" controller="0" unit="1"/>
Nov 28 17:00:00 user nova-compute[75246]:     </disk>
Nov 28 17:00:00 user nova-compute[75246]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 28 17:00:00 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:00:00 user nova-compute[75246]:       <mac address="fa:16:3e:b2:ec:27"/>
Nov 28 17:00:00 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:00:00 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:00:00 user nova-compute[75246]:       <target dev="tap26780137-c1"/>
Nov 28 17:00:00 user nova-compute[75246]:     </interface>
Nov 28 17:00:00 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:00:00 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/console.log" append="off"/>
Nov 28 17:00:00 user nova-compute[75246]:     </serial>
Nov 28 17:00:00 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:00:00 user nova-compute[75246]:     <video>
Nov 28 17:00:00 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:00:00 user nova-compute[75246]:     </video>
Nov 28 17:00:00 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:00:00 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:00:00 user nova-compute[75246]:     </rng>
Nov 28 17:00:00 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:00:00 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:00:00 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:00:00 user nova-compute[75246]:     </memballoon>
Nov 28 17:00:00 user nova-compute[75246]:   </devices>
Nov 28 17:00:00 user nova-compute[75246]: </domain>
Nov 28 17:00:00 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T16:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-837581652',display_name='tempest-AttachSCSIVolumeTestJSON-server-837581652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-837581652',id=6,image_ref='6ec16204-ddec-48db-8b46-68c22470c751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWDNMUX1bRPsmt/iVFeejvhXsdDdxxYQeAutD/RP2MdG599hA1KhdrBKcVjNx2MlkxRinQObD5H7uB4twopw3/j8vacwCw4mwnnxuFJraohMJG4xrZaP5eVkd9ib2Ab5A==',key_name='tempest-keypair-18747782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8690f10b04e44af49d2a459f88573ecd',ramdisk_id='',reservation_id='r-3z30xpqt',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec16204-ddec-48db-8b46-68c22470c751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-884776922',owner_user_name='tempest-AttachSCSIVolumeTestJSON-884776922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbd0260065a347f7a0256138a726607a',uuid=e0df8b51-bda3-4c45-ab54-c6097f6136ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26780137-c1a5-41f0-9c41-e2b2cf450405", "address": "fa:16:3e:b2:ec:27", "network": {"id": "a530cf40-41ff-4ed1-8b02-264d7b7830c8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-656328324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8690f10b04e44af49d2a459f88573ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26780137-c1", "ovs_interfaceid": "26780137-c1a5-41f0-9c41-e2b2cf450405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Converting VIF {"id": "26780137-c1a5-41f0-9c41-e2b2cf450405", "address": "fa:16:3e:b2:ec:27", "network": {"id": "a530cf40-41ff-4ed1-8b02-264d7b7830c8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-656328324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8690f10b04e44af49d2a459f88573ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26780137-c1", "ovs_interfaceid": "26780137-c1a5-41f0-9c41-e2b2cf450405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ec:27,bridge_name='br-int',has_traffic_filtering=True,id=26780137-c1a5-41f0-9c41-e2b2cf450405,network=Network(a530cf40-41ff-4ed1-8b02-264d7b7830c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26780137-c1') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG os_vif [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ec:27,bridge_name='br-int',has_traffic_filtering=True,id=26780137-c1a5-41f0-9c41-e2b2cf450405,network=Network(a530cf40-41ff-4ed1-8b02-264d7b7830c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26780137-c1') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aff68be1-eb3b-54e2-be02-7c1a17f90351', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26780137-c1, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26780137-c1, col_values=(('qos', UUID('ae062476-6c20-4d02-8cea-766154d79751')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26780137-c1, col_values=(('external_ids', {'iface-id': '26780137-c1a5-41f0-9c41-e2b2cf450405', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:ec:27', 'vm-uuid': 'e0df8b51-bda3-4c45-ab54-c6097f6136ad'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:00 user nova-compute[75246]: INFO os_vif [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ec:27,bridge_name='br-int',has_traffic_filtering=True,id=26780137-c1a5-41f0-9c41-e2b2cf450405,network=Network(a530cf40-41ff-4ed1-8b02-264d7b7830c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26780137-c1')
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] No BDM found with device name sda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:00:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] No VIF found with MAC fa:16:3e:b2:ec:27, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:00:00 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Using config drive
Nov 28 17:00:01 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Successfully updated port: 768ccf6f-fd61-45d1-b92f-1757a17dd630 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:00:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Acquiring lock "refresh_cache-a3fe15c9-36ab-404e-876e-e6241cca05f4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:00:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Acquired lock "refresh_cache-a3fe15c9-36ab-404e-876e-e6241cca05f4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:00:01 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:00:01 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:00:01 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Creating config drive at /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk.config
Nov 28 17:00:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyx26nl7n {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyx26nl7n" returned: 0 in 0.067s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:01 user nova-compute[75246]: DEBUG nova.network.neutron [req-8561f155-e91a-442e-b1fe-915a6ba172b2 req-ee1f1d68-eaa5-43c1-91aa-ae789b484934 service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Updated VIF entry in instance network info cache for port 26780137-c1a5-41f0-9c41-e2b2cf450405. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:00:01 user nova-compute[75246]: DEBUG nova.network.neutron [req-8561f155-e91a-442e-b1fe-915a6ba172b2 req-ee1f1d68-eaa5-43c1-91aa-ae789b484934 service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Updating instance_info_cache with network_info: [{"id": "26780137-c1a5-41f0-9c41-e2b2cf450405", "address": "fa:16:3e:b2:ec:27", "network": {"id": "a530cf40-41ff-4ed1-8b02-264d7b7830c8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-656328324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8690f10b04e44af49d2a459f88573ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26780137-c1", "ovs_interfaceid": "26780137-c1a5-41f0-9c41-e2b2cf450405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-c460a8d7-30fa-4910-8fd0-925b9bcab9d3 req-391c33b9-c2ef-45f4-9874-5319a69593c3 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received event network-changed-768ccf6f-fd61-45d1-b92f-1757a17dd630 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-c460a8d7-30fa-4910-8fd0-925b9bcab9d3 req-391c33b9-c2ef-45f4-9874-5319a69593c3 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Refreshing instance network info cache due to event network-changed-768ccf6f-fd61-45d1-b92f-1757a17dd630. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:00:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c460a8d7-30fa-4910-8fd0-925b9bcab9d3 req-391c33b9-c2ef-45f4-9874-5319a69593c3 service nova] Acquiring lock "refresh_cache-a3fe15c9-36ab-404e-876e-e6241cca05f4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:00:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8561f155-e91a-442e-b1fe-915a6ba172b2 req-ee1f1d68-eaa5-43c1-91aa-ae789b484934 service nova] Releasing lock "refresh_cache-e0df8b51-bda3-4c45-ab54-c6097f6136ad" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-7a3276a8-0e7c-4384-b05b-c85563ec36a5 req-4d89c0dc-1a96-4982-98d2-61740b57e343 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Received event network-vif-plugged-40798d97-9143-4283-90ba-2bf3f34c1f51 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7a3276a8-0e7c-4384-b05b-c85563ec36a5 req-4d89c0dc-1a96-4982-98d2-61740b57e343 service nova] Acquiring lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7a3276a8-0e7c-4384-b05b-c85563ec36a5 req-4d89c0dc-1a96-4982-98d2-61740b57e343 service nova] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7a3276a8-0e7c-4384-b05b-c85563ec36a5 req-4d89c0dc-1a96-4982-98d2-61740b57e343 service nova] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-7a3276a8-0e7c-4384-b05b-c85563ec36a5 req-4d89c0dc-1a96-4982-98d2-61740b57e343 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] No waiting events found dispatching network-vif-plugged-40798d97-9143-4283-90ba-2bf3f34c1f51 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:00:01 user nova-compute[75246]: WARNING nova.compute.manager [req-7a3276a8-0e7c-4384-b05b-c85563ec36a5 req-4d89c0dc-1a96-4982-98d2-61740b57e343 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Received unexpected event network-vif-plugged-40798d97-9143-4283-90ba-2bf3f34c1f51 for instance with vm_state active and task_state None.
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Updating instance_info_cache with network_info: [{"id": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "address": "fa:16:3e:4a:b0:8a", "network": {"id": "ab6145d5-6573-4554-af98-a03fc795d945", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1474432451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768ccf6f-fd", "ovs_interfaceid": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Releasing lock "refresh_cache-a3fe15c9-36ab-404e-876e-e6241cca05f4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Instance network_info: |[{"id": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "address": "fa:16:3e:4a:b0:8a", "network": {"id": "ab6145d5-6573-4554-af98-a03fc795d945", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1474432451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768ccf6f-fd", "ovs_interfaceid": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c460a8d7-30fa-4910-8fd0-925b9bcab9d3 req-391c33b9-c2ef-45f4-9874-5319a69593c3 service nova] Acquired lock "refresh_cache-a3fe15c9-36ab-404e-876e-e6241cca05f4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.network.neutron [req-c460a8d7-30fa-4910-8fd0-925b9bcab9d3 req-391c33b9-c2ef-45f4-9874-5319a69593c3 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Refreshing network info cache for port 768ccf6f-fd61-45d1-b92f-1757a17dd630 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Start _get_guest_xml network_info=[{"id": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "address": "fa:16:3e:4a:b0:8a", "network": {"id": "ab6145d5-6573-4554-af98-a03fc795d945", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1474432451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768ccf6f-fd", "ovs_interfaceid": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:00:02 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:00:02 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T16:59:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1290677406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1290677406',id=7,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJrFX4bITMkrby6ETDsYezBUA5h8p9LH12srNxdHviTlhXQIetTlR232xA8XXoc1vY6KV19PrW1yPWXcJCSTPwYRjwnPlIkcljll7OFMOW+nMc0PmFuhGMeQsruLDksRA==',key_name='tempest-keypair-693413544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e482757bdc6447e6bbb8023603b840bf',ramdisk_id='',reservation_id='r-ib8ql4t7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1447929950',owner_user_name='tempest-TaggedAttachmentsTest-1447929950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfa371d2b74849bcaa6d181975484b66',uuid=a3fe15c9-36ab-404e-876e-e6241cca05f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "address": "fa:16:3e:4a:b0:8a", "network": {"id": "ab6145d5-6573-4554-af98-a03fc795d945", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1474432451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768ccf6f-fd", "ovs_interfaceid": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Converting VIF {"id": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "address": "fa:16:3e:4a:b0:8a", "network": {"id": "ab6145d5-6573-4554-af98-a03fc795d945", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1474432451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768ccf6f-fd", "ovs_interfaceid": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:b0:8a,bridge_name='br-int',has_traffic_filtering=True,id=768ccf6f-fd61-45d1-b92f-1757a17dd630,network=Network(ab6145d5-6573-4554-af98-a03fc795d945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768ccf6f-fd') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.objects.instance [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lazy-loading 'pci_devices' on Instance uuid a3fe15c9-36ab-404e-876e-e6241cca05f4 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:00:02 user nova-compute[75246]:   <uuid>a3fe15c9-36ab-404e-876e-e6241cca05f4</uuid>
Nov 28 17:00:02 user nova-compute[75246]:   <name>instance-00000007</name>
Nov 28 17:00:02 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:00:02 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:00:02 user nova-compute[75246]:   <metadata>
Nov 28 17:00:02 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:00:02 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:00:02 user nova-compute[75246]:       <nova:name>tempest-device-tagging-server-1290677406</nova:name>
Nov 28 17:00:02 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:00:02</nova:creationTime>
Nov 28 17:00:02 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:00:02 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:00:02 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:00:02 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:00:02 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:00:02 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:00:02 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:00:02 user nova-compute[75246]:       <nova:owner>
Nov 28 17:00:02 user nova-compute[75246]:         <nova:user uuid="dfa371d2b74849bcaa6d181975484b66">tempest-TaggedAttachmentsTest-1447929950-project-member</nova:user>
Nov 28 17:00:02 user nova-compute[75246]:         <nova:project uuid="e482757bdc6447e6bbb8023603b840bf">tempest-TaggedAttachmentsTest-1447929950</nova:project>
Nov 28 17:00:02 user nova-compute[75246]:       </nova:owner>
Nov 28 17:00:02 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:00:02 user nova-compute[75246]:       <nova:ports>
Nov 28 17:00:02 user nova-compute[75246]:         <nova:port uuid="768ccf6f-fd61-45d1-b92f-1757a17dd630">
Nov 28 17:00:02 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 17:00:02 user nova-compute[75246]:         </nova:port>
Nov 28 17:00:02 user nova-compute[75246]:       </nova:ports>
Nov 28 17:00:02 user nova-compute[75246]:     </nova:instance>
Nov 28 17:00:02 user nova-compute[75246]:   </metadata>
Nov 28 17:00:02 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:00:02 user nova-compute[75246]:     <system>
Nov 28 17:00:02 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:00:02 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:00:02 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:00:02 user nova-compute[75246]:       <entry name="serial">a3fe15c9-36ab-404e-876e-e6241cca05f4</entry>
Nov 28 17:00:02 user nova-compute[75246]:       <entry name="uuid">a3fe15c9-36ab-404e-876e-e6241cca05f4</entry>
Nov 28 17:00:02 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:00:02 user nova-compute[75246]:     </system>
Nov 28 17:00:02 user nova-compute[75246]:   </sysinfo>
Nov 28 17:00:02 user nova-compute[75246]:   <os>
Nov 28 17:00:02 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:00:02 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:00:02 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:00:02 user nova-compute[75246]:   </os>
Nov 28 17:00:02 user nova-compute[75246]:   <features>
Nov 28 17:00:02 user nova-compute[75246]:     <acpi/>
Nov 28 17:00:02 user nova-compute[75246]:     <apic/>
Nov 28 17:00:02 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:00:02 user nova-compute[75246]:   </features>
Nov 28 17:00:02 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:00:02 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:00:02 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:00:02 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:00:02 user nova-compute[75246]:   </clock>
Nov 28 17:00:02 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:00:02 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:00:02 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:00:02 user nova-compute[75246]:   </cpu>
Nov 28 17:00:02 user nova-compute[75246]:   <devices>
Nov 28 17:00:02 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:00:02 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:00:02 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk"/>
Nov 28 17:00:02 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:00:02 user nova-compute[75246]:     </disk>
Nov 28 17:00:02 user nova-compute[75246]:     <disk type="file" device="cdrom">
Nov 28 17:00:02 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 17:00:02 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk.config"/>
Nov 28 17:00:02 user nova-compute[75246]:       <target dev="hda" bus="ide"/>
Nov 28 17:00:02 user nova-compute[75246]:     </disk>
Nov 28 17:00:02 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:00:02 user nova-compute[75246]:       <mac address="fa:16:3e:4a:b0:8a"/>
Nov 28 17:00:02 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:00:02 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:00:02 user nova-compute[75246]:       <target dev="tap768ccf6f-fd"/>
Nov 28 17:00:02 user nova-compute[75246]:     </interface>
Nov 28 17:00:02 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:00:02 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/console.log" append="off"/>
Nov 28 17:00:02 user nova-compute[75246]:     </serial>
Nov 28 17:00:02 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:00:02 user nova-compute[75246]:     <video>
Nov 28 17:00:02 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:00:02 user nova-compute[75246]:     </video>
Nov 28 17:00:02 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:00:02 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:00:02 user nova-compute[75246]:     </rng>
Nov 28 17:00:02 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:00:02 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:00:02 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:00:02 user nova-compute[75246]:     </memballoon>
Nov 28 17:00:02 user nova-compute[75246]:   </devices>
Nov 28 17:00:02 user nova-compute[75246]: </domain>
Nov 28 17:00:02 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T16:59:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1290677406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1290677406',id=7,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJrFX4bITMkrby6ETDsYezBUA5h8p9LH12srNxdHviTlhXQIetTlR232xA8XXoc1vY6KV19PrW1yPWXcJCSTPwYRjwnPlIkcljll7OFMOW+nMc0PmFuhGMeQsruLDksRA==',key_name='tempest-keypair-693413544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e482757bdc6447e6bbb8023603b840bf',ramdisk_id='',reservation_id='r-ib8ql4t7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1447929950',owner_user_name='tempest-TaggedAttachmentsTest-1447929950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfa371d2b74849bcaa6d181975484b66',uuid=a3fe15c9-36ab-404e-876e-e6241cca05f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "address": "fa:16:3e:4a:b0:8a", "network": {"id": "ab6145d5-6573-4554-af98-a03fc795d945", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1474432451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768ccf6f-fd", "ovs_interfaceid": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Converting VIF {"id": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "address": "fa:16:3e:4a:b0:8a", "network": {"id": "ab6145d5-6573-4554-af98-a03fc795d945", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1474432451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768ccf6f-fd", "ovs_interfaceid": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:b0:8a,bridge_name='br-int',has_traffic_filtering=True,id=768ccf6f-fd61-45d1-b92f-1757a17dd630,network=Network(ab6145d5-6573-4554-af98-a03fc795d945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768ccf6f-fd') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG os_vif [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:b0:8a,bridge_name='br-int',has_traffic_filtering=True,id=768ccf6f-fd61-45d1-b92f-1757a17dd630,network=Network(ab6145d5-6573-4554-af98-a03fc795d945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768ccf6f-fd') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd452399-837b-52a6-985b-e823d5dc0cd0', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap768ccf6f-fd, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap768ccf6f-fd, col_values=(('qos', UUID('6b0d5279-659b-48c5-b9e9-0001db41e331')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap768ccf6f-fd, col_values=(('external_ids', {'iface-id': '768ccf6f-fd61-45d1-b92f-1757a17dd630', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:b0:8a', 'vm-uuid': 'a3fe15c9-36ab-404e-876e-e6241cca05f4'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:02 user nova-compute[75246]: INFO os_vif [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:b0:8a,bridge_name='br-int',has_traffic_filtering=True,id=768ccf6f-fd61-45d1-b92f-1757a17dd630,network=Network(ab6145d5-6573-4554-af98-a03fc795d945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768ccf6f-fd')
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] No BDM found with device name hda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:00:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] No VIF found with MAC fa:16:3e:4a:b0:8a, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:00:02 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Using config drive
Nov 28 17:00:03 user nova-compute[75246]: DEBUG nova.network.neutron [req-c460a8d7-30fa-4910-8fd0-925b9bcab9d3 req-391c33b9-c2ef-45f4-9874-5319a69593c3 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Updated VIF entry in instance network info cache for port 768ccf6f-fd61-45d1-b92f-1757a17dd630. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:00:03 user nova-compute[75246]: DEBUG nova.network.neutron [req-c460a8d7-30fa-4910-8fd0-925b9bcab9d3 req-391c33b9-c2ef-45f4-9874-5319a69593c3 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Updating instance_info_cache with network_info: [{"id": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "address": "fa:16:3e:4a:b0:8a", "network": {"id": "ab6145d5-6573-4554-af98-a03fc795d945", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1474432451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768ccf6f-fd", "ovs_interfaceid": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:03 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Creating config drive at /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk.config
Nov 28 17:00:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2b5hh2hz {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c460a8d7-30fa-4910-8fd0-925b9bcab9d3 req-391c33b9-c2ef-45f4-9874-5319a69593c3 service nova] Releasing lock "refresh_cache-a3fe15c9-36ab-404e-876e-e6241cca05f4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2b5hh2hz" returned: 0 in 0.060s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-30d9a0b3-3f1e-41ea-b82b-1c7715eb1a41 req-ba58d59c-8ab6-4bfb-a9d7-7098b614974a service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Received event network-vif-plugged-5fe78c0a-025c-4ce0-b370-83959a0e2df7 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-30d9a0b3-3f1e-41ea-b82b-1c7715eb1a41 req-ba58d59c-8ab6-4bfb-a9d7-7098b614974a service nova] Acquiring lock "f6fe7bf7-782c-4660-9612-101c9f277903-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-30d9a0b3-3f1e-41ea-b82b-1c7715eb1a41 req-ba58d59c-8ab6-4bfb-a9d7-7098b614974a service nova] Lock "f6fe7bf7-782c-4660-9612-101c9f277903-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-30d9a0b3-3f1e-41ea-b82b-1c7715eb1a41 req-ba58d59c-8ab6-4bfb-a9d7-7098b614974a service nova] Lock "f6fe7bf7-782c-4660-9612-101c9f277903-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-30d9a0b3-3f1e-41ea-b82b-1c7715eb1a41 req-ba58d59c-8ab6-4bfb-a9d7-7098b614974a service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] No waiting events found dispatching network-vif-plugged-5fe78c0a-025c-4ce0-b370-83959a0e2df7 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:00:04 user nova-compute[75246]: WARNING nova.compute.manager [req-30d9a0b3-3f1e-41ea-b82b-1c7715eb1a41 req-ba58d59c-8ab6-4bfb-a9d7-7098b614974a service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Received unexpected event network-vif-plugged-5fe78c0a-025c-4ce0-b370-83959a0e2df7 for instance with vm_state building and task_state spawning.
Nov 28 17:00:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-30d9a0b3-3f1e-41ea-b82b-1c7715eb1a41 req-ba58d59c-8ab6-4bfb-a9d7-7098b614974a service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Received event network-vif-plugged-5fe78c0a-025c-4ce0-b370-83959a0e2df7 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-30d9a0b3-3f1e-41ea-b82b-1c7715eb1a41 req-ba58d59c-8ab6-4bfb-a9d7-7098b614974a service nova] Acquiring lock "f6fe7bf7-782c-4660-9612-101c9f277903-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-30d9a0b3-3f1e-41ea-b82b-1c7715eb1a41 req-ba58d59c-8ab6-4bfb-a9d7-7098b614974a service nova] Lock "f6fe7bf7-782c-4660-9612-101c9f277903-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-30d9a0b3-3f1e-41ea-b82b-1c7715eb1a41 req-ba58d59c-8ab6-4bfb-a9d7-7098b614974a service nova] Lock "f6fe7bf7-782c-4660-9612-101c9f277903-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-30d9a0b3-3f1e-41ea-b82b-1c7715eb1a41 req-ba58d59c-8ab6-4bfb-a9d7-7098b614974a service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] No waiting events found dispatching network-vif-plugged-5fe78c0a-025c-4ce0-b370-83959a0e2df7 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:00:04 user nova-compute[75246]: WARNING nova.compute.manager [req-30d9a0b3-3f1e-41ea-b82b-1c7715eb1a41 req-ba58d59c-8ab6-4bfb-a9d7-7098b614974a service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Received unexpected event network-vif-plugged-5fe78c0a-025c-4ce0-b370-83959a0e2df7 for instance with vm_state building and task_state spawning.
Nov 28 17:00:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-37dce6d6-b77c-4ece-b745-691a7cd589be req-e4fab1b4-dd2c-4910-807a-17c3ad303cc6 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received event network-vif-plugged-768ccf6f-fd61-45d1-b92f-1757a17dd630 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-37dce6d6-b77c-4ece-b745-691a7cd589be req-e4fab1b4-dd2c-4910-807a-17c3ad303cc6 service nova] Acquiring lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-37dce6d6-b77c-4ece-b745-691a7cd589be req-e4fab1b4-dd2c-4910-807a-17c3ad303cc6 service nova] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-37dce6d6-b77c-4ece-b745-691a7cd589be req-e4fab1b4-dd2c-4910-807a-17c3ad303cc6 service nova] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-37dce6d6-b77c-4ece-b745-691a7cd589be req-e4fab1b4-dd2c-4910-807a-17c3ad303cc6 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] No waiting events found dispatching network-vif-plugged-768ccf6f-fd61-45d1-b92f-1757a17dd630 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:00:06 user nova-compute[75246]: WARNING nova.compute.manager [req-37dce6d6-b77c-4ece-b745-691a7cd589be req-e4fab1b4-dd2c-4910-807a-17c3ad303cc6 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received unexpected event network-vif-plugged-768ccf6f-fd61-45d1-b92f-1757a17dd630 for instance with vm_state building and task_state spawning.
Nov 28 17:00:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-37dce6d6-b77c-4ece-b745-691a7cd589be req-e4fab1b4-dd2c-4910-807a-17c3ad303cc6 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received event network-vif-plugged-768ccf6f-fd61-45d1-b92f-1757a17dd630 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-37dce6d6-b77c-4ece-b745-691a7cd589be req-e4fab1b4-dd2c-4910-807a-17c3ad303cc6 service nova] Acquiring lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-37dce6d6-b77c-4ece-b745-691a7cd589be req-e4fab1b4-dd2c-4910-807a-17c3ad303cc6 service nova] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-37dce6d6-b77c-4ece-b745-691a7cd589be req-e4fab1b4-dd2c-4910-807a-17c3ad303cc6 service nova] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-37dce6d6-b77c-4ece-b745-691a7cd589be req-e4fab1b4-dd2c-4910-807a-17c3ad303cc6 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] No waiting events found dispatching network-vif-plugged-768ccf6f-fd61-45d1-b92f-1757a17dd630 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:00:06 user nova-compute[75246]: WARNING nova.compute.manager [req-37dce6d6-b77c-4ece-b745-691a7cd589be req-e4fab1b4-dd2c-4910-807a-17c3ad303cc6 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received unexpected event network-vif-plugged-768ccf6f-fd61-45d1-b92f-1757a17dd630 for instance with vm_state building and task_state spawning.
Nov 28 17:00:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:00:06 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Instance spawned successfully.
Nov 28 17:00:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:06 user nova-compute[75246]: INFO nova.compute.manager [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Took 12.64 seconds to spawn the instance on the hypervisor.
Nov 28 17:00:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:00:06 user nova-compute[75246]: INFO nova.compute.manager [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Took 14.20 seconds to build instance.
Nov 28 17:00:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-88726f2e-a615-497b-adf0-a57fcb9d7041 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "f6fe7bf7-782c-4660-9612-101c9f277903" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.378s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Acquiring lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:00:07 user nova-compute[75246]: INFO nova.compute.claims [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Claim successful on node user
Nov 28 17:00:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquiring lock "9f306608-7716-41e0-9aa0-afa8ba173a04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.319s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:00:07 user nova-compute[75246]: INFO nova.compute.claims [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Claim successful on node user
Nov 28 17:00:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG nova.network.neutron [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:00:07 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Instance spawned successfully.
Nov 28 17:00:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:07 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:00:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.compute.manager [req-ac10f2a5-a36e-4e2b-9248-147c188487b7 req-85a514ff-9c19-4248-a634-c06790b39033 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Received event network-vif-plugged-459bf491-d464-42b1-be6c-282af882a38d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ac10f2a5-a36e-4e2b-9248-147c188487b7 req-85a514ff-9c19-4248-a634-c06790b39033 service nova] Acquiring lock "e1266470-c182-4c0c-a575-4c5043f54745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ac10f2a5-a36e-4e2b-9248-147c188487b7 req-85a514ff-9c19-4248-a634-c06790b39033 service nova] Lock "e1266470-c182-4c0c-a575-4c5043f54745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ac10f2a5-a36e-4e2b-9248-147c188487b7 req-85a514ff-9c19-4248-a634-c06790b39033 service nova] Lock "e1266470-c182-4c0c-a575-4c5043f54745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.compute.manager [req-ac10f2a5-a36e-4e2b-9248-147c188487b7 req-85a514ff-9c19-4248-a634-c06790b39033 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] No waiting events found dispatching network-vif-plugged-459bf491-d464-42b1-be6c-282af882a38d {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:00:08 user nova-compute[75246]: WARNING nova.compute.manager [req-ac10f2a5-a36e-4e2b-9248-147c188487b7 req-85a514ff-9c19-4248-a634-c06790b39033 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Received unexpected event network-vif-plugged-459bf491-d464-42b1-be6c-282af882a38d for instance with vm_state active and task_state None.
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.policy [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45b2d3471ff74cdca08768d09ca4ee0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b53fb281648c79ad65e38978a7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:00:08 user nova-compute[75246]: INFO nova.compute.manager [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Took 12.78 seconds to spawn the instance on the hypervisor.
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:00:08 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Creating image(s)
Nov 28 17:00:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Acquiring lock "/opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Lock "/opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Lock "/opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:08 user nova-compute[75246]: INFO nova.compute.manager [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Took 14.30 seconds to build instance.
Nov 28 17:00:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e1245ed-d180-4db7-ab2e-675bdd078c7d tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.603s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.236s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.880s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:00:08 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Instance spawned successfully.
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.292s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:08 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:00:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk 1073741824" returned: 0 in 0.133s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.435s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:09 user nova-compute[75246]: INFO nova.compute.manager [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Took 11.96 seconds to spawn the instance on the hypervisor.
Nov 28 17:00:09 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:00:09 user nova-compute[75246]: INFO nova.virt.block_device [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Booting with volume 5a955b08-0696-4533-b17d-0e99d36216e1 at /dev/vda
Nov 28 17:00:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:09 user nova-compute[75246]: DEBUG nova.policy [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3465e183420e4370a02046024827d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37d00748c91a42a9aa255f62e207a41c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:00:09 user nova-compute[75246]: DEBUG nova.network.neutron [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Successfully created port: ac51a369-6c87-41c1-8b7c-a313a3b72ee3 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:00:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.365s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:09 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:00:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:09 user nova-compute[75246]: DEBUG os_brick.utils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:00:09 user nova-compute[75246]: INFO oslo.privsep.daemon [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpznqemp1k/privsep.sock']
Nov 28 17:00:09 user sudo[85736]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpznqemp1k/privsep.sock
Nov 28 17:00:09 user sudo[85736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 17:00:09 user nova-compute[75246]: INFO nova.compute.manager [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Took 14.77 seconds to build instance.
Nov 28 17:00:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c7f75db8-54ca-44d9-be32-d470f38b9dc8 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.066s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk --force-share --output=json" returned: 0 in 0.324s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:09 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Cannot resize image /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:00:09 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:00:09 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Ensure instance console log exists: /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:00:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-8883ab4c-88bb-4387-9aa3-55e2c04383b5 req-f8eaabd4-0e7f-415b-946d-38505c247e1c service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Received event network-vif-plugged-459bf491-d464-42b1-be6c-282af882a38d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8883ab4c-88bb-4387-9aa3-55e2c04383b5 req-f8eaabd4-0e7f-415b-946d-38505c247e1c service nova] Acquiring lock "e1266470-c182-4c0c-a575-4c5043f54745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8883ab4c-88bb-4387-9aa3-55e2c04383b5 req-f8eaabd4-0e7f-415b-946d-38505c247e1c service nova] Lock "e1266470-c182-4c0c-a575-4c5043f54745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8883ab4c-88bb-4387-9aa3-55e2c04383b5 req-f8eaabd4-0e7f-415b-946d-38505c247e1c service nova] Lock "e1266470-c182-4c0c-a575-4c5043f54745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-8883ab4c-88bb-4387-9aa3-55e2c04383b5 req-f8eaabd4-0e7f-415b-946d-38505c247e1c service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] No waiting events found dispatching network-vif-plugged-459bf491-d464-42b1-be6c-282af882a38d {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:00:10 user nova-compute[75246]: WARNING nova.compute.manager [req-8883ab4c-88bb-4387-9aa3-55e2c04383b5 req-f8eaabd4-0e7f-415b-946d-38505c247e1c service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Received unexpected event network-vif-plugged-459bf491-d464-42b1-be6c-282af882a38d for instance with vm_state active and task_state None.
Nov 28 17:00:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-8883ab4c-88bb-4387-9aa3-55e2c04383b5 req-f8eaabd4-0e7f-415b-946d-38505c247e1c service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Received event network-vif-plugged-26780137-c1a5-41f0-9c41-e2b2cf450405 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8883ab4c-88bb-4387-9aa3-55e2c04383b5 req-f8eaabd4-0e7f-415b-946d-38505c247e1c service nova] Acquiring lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8883ab4c-88bb-4387-9aa3-55e2c04383b5 req-f8eaabd4-0e7f-415b-946d-38505c247e1c service nova] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8883ab4c-88bb-4387-9aa3-55e2c04383b5 req-f8eaabd4-0e7f-415b-946d-38505c247e1c service nova] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-8883ab4c-88bb-4387-9aa3-55e2c04383b5 req-f8eaabd4-0e7f-415b-946d-38505c247e1c service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] No waiting events found dispatching network-vif-plugged-26780137-c1a5-41f0-9c41-e2b2cf450405 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:00:10 user nova-compute[75246]: WARNING nova.compute.manager [req-8883ab4c-88bb-4387-9aa3-55e2c04383b5 req-f8eaabd4-0e7f-415b-946d-38505c247e1c service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Received unexpected event network-vif-plugged-26780137-c1a5-41f0-9c41-e2b2cf450405 for instance with vm_state active and task_state None.
Nov 28 17:00:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-8883ab4c-88bb-4387-9aa3-55e2c04383b5 req-f8eaabd4-0e7f-415b-946d-38505c247e1c service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Received event network-vif-plugged-26780137-c1a5-41f0-9c41-e2b2cf450405 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8883ab4c-88bb-4387-9aa3-55e2c04383b5 req-f8eaabd4-0e7f-415b-946d-38505c247e1c service nova] Acquiring lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8883ab4c-88bb-4387-9aa3-55e2c04383b5 req-f8eaabd4-0e7f-415b-946d-38505c247e1c service nova] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8883ab4c-88bb-4387-9aa3-55e2c04383b5 req-f8eaabd4-0e7f-415b-946d-38505c247e1c service nova] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-8883ab4c-88bb-4387-9aa3-55e2c04383b5 req-f8eaabd4-0e7f-415b-946d-38505c247e1c service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] No waiting events found dispatching network-vif-plugged-26780137-c1a5-41f0-9c41-e2b2cf450405 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:00:10 user nova-compute[75246]: WARNING nova.compute.manager [req-8883ab4c-88bb-4387-9aa3-55e2c04383b5 req-f8eaabd4-0e7f-415b-946d-38505c247e1c service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Received unexpected event network-vif-plugged-26780137-c1a5-41f0-9c41-e2b2cf450405 for instance with vm_state active and task_state None.
Nov 28 17:00:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG nova.network.neutron [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Successfully updated port: ac51a369-6c87-41c1-8b7c-a313a3b72ee3 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Acquiring lock "refresh_cache-24d45b28-61df-43cb-bdae-f8ce6b3aaca3" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Acquired lock "refresh_cache-24d45b28-61df-43cb-bdae-f8ce6b3aaca3" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG nova.network.neutron [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-f50cdf4a-9af8-4578-a1f1-32f94f7f3b80 req-2d8396e3-025a-425c-9862-032b67f99395 service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Received event network-changed-ac51a369-6c87-41c1-8b7c-a313a3b72ee3 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-f50cdf4a-9af8-4578-a1f1-32f94f7f3b80 req-2d8396e3-025a-425c-9862-032b67f99395 service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Refreshing instance network info cache due to event network-changed-ac51a369-6c87-41c1-8b7c-a313a3b72ee3. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:00:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f50cdf4a-9af8-4578-a1f1-32f94f7f3b80 req-2d8396e3-025a-425c-9862-032b67f99395 service nova] Acquiring lock "refresh_cache-24d45b28-61df-43cb-bdae-f8ce6b3aaca3" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:00:11 user nova-compute[75246]: DEBUG nova.network.neutron [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:00:11 user sudo[85736]: pam_unix(sudo:session): session closed for user root
Nov 28 17:00:11 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Successfully created port: 8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:00:11 user nova-compute[75246]: INFO oslo.privsep.daemon [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Spawned new privsep daemon via rootwrap
Nov 28 17:00:11 user nova-compute[75246]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 17:00:11 user nova-compute[75246]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 17:00:11 user nova-compute[75246]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 28 17:00:11 user nova-compute[75246]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85745
Nov 28 17:00:11 user nova-compute[75246]: DEBUG nova.network.neutron [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Updating instance_info_cache with network_info: [{"id": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "address": "fa:16:3e:54:89:d5", "network": {"id": "52ca7b7f-3ab7-4a79-a471-baeb55da51eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1832570935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131b53fb281648c79ad65e38978a7c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac51a369-6c", "ovs_interfaceid": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:11 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f46e669-2de9-479d-8eef-910908164670]: (2,) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Releasing lock "refresh_cache-24d45b28-61df-43cb-bdae-f8ce6b3aaca3" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:11 user nova-compute[75246]: DEBUG nova.compute.manager [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Instance network_info: |[{"id": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "address": "fa:16:3e:54:89:d5", "network": {"id": "52ca7b7f-3ab7-4a79-a471-baeb55da51eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1832570935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131b53fb281648c79ad65e38978a7c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac51a369-6c", "ovs_interfaceid": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:00:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f50cdf4a-9af8-4578-a1f1-32f94f7f3b80 req-2d8396e3-025a-425c-9862-032b67f99395 service nova] Acquired lock "refresh_cache-24d45b28-61df-43cb-bdae-f8ce6b3aaca3" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:00:11 user nova-compute[75246]: DEBUG nova.network.neutron [req-f50cdf4a-9af8-4578-a1f1-32f94f7f3b80 req-2d8396e3-025a-425c-9862-032b67f99395 service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Refreshing network info cache for port ac51a369-6c87-41c1-8b7c-a313a3b72ee3 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:00:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Start _get_guest_xml network_info=[{"id": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "address": "fa:16:3e:54:89:d5", "network": {"id": "52ca7b7f-3ab7-4a79-a471-baeb55da51eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1832570935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131b53fb281648c79ad65e38978a7c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac51a369-6c", "ovs_interfaceid": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:00:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:11 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2310ad3-3c49-487a-bdf3-32fb85f06563]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:11 user nova-compute[75246]: WARNING os_brick.initiator.connectors.nvmeof [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 28 17:00:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:11 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:00:11 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:00:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:00:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:00:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:11 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7875057-4a3c-4b22-9ed6-fc1619777090]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:00:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-431930084',display_name='tempest-VolumesAssistedSnapshotsTest-server-431930084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-431930084',id=8,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzOrOPbbIAYO+R2rf6r1TtZhub/aUKWWdBbYdczir+SVyqYlLhnLFVioE7anmQ4XMimHE1WLBBQZ5JEZpp08+lr2ifeSLV/IYz1Pw8xmcN4Cy/0HjYrxAju7Jo0juw+EQ==',key_name='tempest-keypair-1417787953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='131b53fb281648c79ad65e38978a7c3b',ramdisk_id='',reservation_id='r-0vpp7evw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-97764733',owner_user_name='tempest-VolumesAssistedSnapshotsTest-97764733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45b2d3471ff74cdca08768d09ca4ee0a',uuid=24d45b28-61df-43cb-bdae-f8ce6b3aaca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "address": "fa:16:3e:54:89:d5", "network": {"id": "52ca7b7f-3ab7-4a79-a471-baeb55da51eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1832570935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131b53fb281648c79ad65e38978a7c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac51a369-6c", "ovs_interfaceid": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Converting VIF {"id": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "address": "fa:16:3e:54:89:d5", "network": {"id": "52ca7b7f-3ab7-4a79-a471-baeb55da51eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1832570935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131b53fb281648c79ad65e38978a7c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac51a369-6c", "ovs_interfaceid": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:89:d5,bridge_name='br-int',has_traffic_filtering=True,id=ac51a369-6c87-41c1-8b7c-a313a3b72ee3,network=Network(52ca7b7f-3ab7-4a79-a471-baeb55da51eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac51a369-6c') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.objects.instance [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Lazy-loading 'pci_devices' on Instance uuid 24d45b28-61df-43cb-bdae-f8ce6b3aaca3 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6adb07-83d1-4f39-a86d-dc46daefe62a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e26de79-d627-47a8-a350-b7c59ceac202]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:00:12 user nova-compute[75246]:   <uuid>24d45b28-61df-43cb-bdae-f8ce6b3aaca3</uuid>
Nov 28 17:00:12 user nova-compute[75246]:   <name>instance-00000008</name>
Nov 28 17:00:12 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:00:12 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:00:12 user nova-compute[75246]:   <metadata>
Nov 28 17:00:12 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:00:12 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:00:12 user nova-compute[75246]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-431930084</nova:name>
Nov 28 17:00:12 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:00:11</nova:creationTime>
Nov 28 17:00:12 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:00:12 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:00:12 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:00:12 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:00:12 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:00:12 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:00:12 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:00:12 user nova-compute[75246]:       <nova:owner>
Nov 28 17:00:12 user nova-compute[75246]:         <nova:user uuid="45b2d3471ff74cdca08768d09ca4ee0a">tempest-VolumesAssistedSnapshotsTest-97764733-project-member</nova:user>
Nov 28 17:00:12 user nova-compute[75246]:         <nova:project uuid="131b53fb281648c79ad65e38978a7c3b">tempest-VolumesAssistedSnapshotsTest-97764733</nova:project>
Nov 28 17:00:12 user nova-compute[75246]:       </nova:owner>
Nov 28 17:00:12 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:00:12 user nova-compute[75246]:       <nova:ports>
Nov 28 17:00:12 user nova-compute[75246]:         <nova:port uuid="ac51a369-6c87-41c1-8b7c-a313a3b72ee3">
Nov 28 17:00:12 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 17:00:12 user nova-compute[75246]:         </nova:port>
Nov 28 17:00:12 user nova-compute[75246]:       </nova:ports>
Nov 28 17:00:12 user nova-compute[75246]:     </nova:instance>
Nov 28 17:00:12 user nova-compute[75246]:   </metadata>
Nov 28 17:00:12 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:00:12 user nova-compute[75246]:     <system>
Nov 28 17:00:12 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:00:12 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:00:12 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:00:12 user nova-compute[75246]:       <entry name="serial">24d45b28-61df-43cb-bdae-f8ce6b3aaca3</entry>
Nov 28 17:00:12 user nova-compute[75246]:       <entry name="uuid">24d45b28-61df-43cb-bdae-f8ce6b3aaca3</entry>
Nov 28 17:00:12 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:00:12 user nova-compute[75246]:     </system>
Nov 28 17:00:12 user nova-compute[75246]:   </sysinfo>
Nov 28 17:00:12 user nova-compute[75246]:   <os>
Nov 28 17:00:12 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:00:12 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:00:12 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:00:12 user nova-compute[75246]:   </os>
Nov 28 17:00:12 user nova-compute[75246]:   <features>
Nov 28 17:00:12 user nova-compute[75246]:     <acpi/>
Nov 28 17:00:12 user nova-compute[75246]:     <apic/>
Nov 28 17:00:12 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:00:12 user nova-compute[75246]:   </features>
Nov 28 17:00:12 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:00:12 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:00:12 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:00:12 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:00:12 user nova-compute[75246]:   </clock>
Nov 28 17:00:12 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:00:12 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:00:12 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:00:12 user nova-compute[75246]:   </cpu>
Nov 28 17:00:12 user nova-compute[75246]:   <devices>
Nov 28 17:00:12 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:00:12 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:00:12 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk"/>
Nov 28 17:00:12 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:00:12 user nova-compute[75246]:     </disk>
Nov 28 17:00:12 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:00:12 user nova-compute[75246]:       <mac address="fa:16:3e:54:89:d5"/>
Nov 28 17:00:12 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:00:12 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:00:12 user nova-compute[75246]:       <target dev="tapac51a369-6c"/>
Nov 28 17:00:12 user nova-compute[75246]:     </interface>
Nov 28 17:00:12 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:00:12 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/console.log" append="off"/>
Nov 28 17:00:12 user nova-compute[75246]:     </serial>
Nov 28 17:00:12 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:00:12 user nova-compute[75246]:     <video>
Nov 28 17:00:12 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:00:12 user nova-compute[75246]:     </video>
Nov 28 17:00:12 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:00:12 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:00:12 user nova-compute[75246]:     </rng>
Nov 28 17:00:12 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:00:12 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:00:12 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:00:12 user nova-compute[75246]:     </memballoon>
Nov 28 17:00:12 user nova-compute[75246]:   </devices>
Nov 28 17:00:12 user nova-compute[75246]: </domain>
Nov 28 17:00:12 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:00:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-431930084',display_name='tempest-VolumesAssistedSnapshotsTest-server-431930084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-431930084',id=8,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzOrOPbbIAYO+R2rf6r1TtZhub/aUKWWdBbYdczir+SVyqYlLhnLFVioE7anmQ4XMimHE1WLBBQZ5JEZpp08+lr2ifeSLV/IYz1Pw8xmcN4Cy/0HjYrxAju7Jo0juw+EQ==',key_name='tempest-keypair-1417787953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='131b53fb281648c79ad65e38978a7c3b',ramdisk_id='',reservation_id='r-0vpp7evw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-97764733',owner_user_name='tempest-VolumesAssistedSnapshotsTest-97764733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45b2d3471ff74cdca08768d09ca4ee0a',uuid=24d45b28-61df-43cb-bdae-f8ce6b3aaca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "address": "fa:16:3e:54:89:d5", "network": {"id": "52ca7b7f-3ab7-4a79-a471-baeb55da51eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1832570935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131b53fb281648c79ad65e38978a7c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac51a369-6c", "ovs_interfaceid": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Converting VIF {"id": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "address": "fa:16:3e:54:89:d5", "network": {"id": "52ca7b7f-3ab7-4a79-a471-baeb55da51eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1832570935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131b53fb281648c79ad65e38978a7c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac51a369-6c", "ovs_interfaceid": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:89:d5,bridge_name='br-int',has_traffic_filtering=True,id=ac51a369-6c87-41c1-8b7c-a313a3b72ee3,network=Network(52ca7b7f-3ab7-4a79-a471-baeb55da51eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac51a369-6c') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG os_vif [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:89:d5,bridge_name='br-int',has_traffic_filtering=True,id=ac51a369-6c87-41c1-8b7c-a313a3b72ee3,network=Network(52ca7b7f-3ab7-4a79-a471-baeb55da51eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac51a369-6c') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57700dde-9dc0-5163-8858-e9c7961d3562', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac51a369-6c, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac51a369-6c, col_values=(('qos', UUID('07357e4d-cf31-4865-a8d6-b9d7e71515a2')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac51a369-6c, col_values=(('external_ids', {'iface-id': 'ac51a369-6c87-41c1-8b7c-a313a3b72ee3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:89:d5', 'vm-uuid': '24d45b28-61df-43cb-bdae-f8ce6b3aaca3'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:00:12 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:00:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfafd27-8ff3-4942-9ef9-4294bd5c58ff]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG os_brick.utils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] <== get_connector_properties: return (2883ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Updating existing volume attachment record: efa8a97d-cbbc-42fd-9e04-f66ab082d61c {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:12 user nova-compute[75246]: INFO os_vif [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:89:d5,bridge_name='br-int',has_traffic_filtering=True,id=ac51a369-6c87-41c1-8b7c-a313a3b72ee3,network=Network(52ca7b7f-3ab7-4a79-a471-baeb55da51eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac51a369-6c')
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] No VIF found with MAC fa:16:3e:54:89:d5, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.network.neutron [req-f50cdf4a-9af8-4578-a1f1-32f94f7f3b80 req-2d8396e3-025a-425c-9862-032b67f99395 service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Updated VIF entry in instance network info cache for port ac51a369-6c87-41c1-8b7c-a313a3b72ee3. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.network.neutron [req-f50cdf4a-9af8-4578-a1f1-32f94f7f3b80 req-2d8396e3-025a-425c-9862-032b67f99395 service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Updating instance_info_cache with network_info: [{"id": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "address": "fa:16:3e:54:89:d5", "network": {"id": "52ca7b7f-3ab7-4a79-a471-baeb55da51eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1832570935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131b53fb281648c79ad65e38978a7c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac51a369-6c", "ovs_interfaceid": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f50cdf4a-9af8-4578-a1f1-32f94f7f3b80 req-2d8396e3-025a-425c-9862-032b67f99395 service nova] Releasing lock "refresh_cache-24d45b28-61df-43cb-bdae-f8ce6b3aaca3" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:12 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Successfully updated port: 8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:00:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquiring lock "refresh_cache-9f306608-7716-41e0-9aa0-afa8ba173a04" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:00:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquired lock "refresh_cache-9f306608-7716-41e0-9aa0-afa8ba173a04" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:00:13 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:00:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-988f15ac-0484-4c50-b32f-8a093667f0f6 req-43e99117-bb59-4b20-9eb9-572e2f3eeebf service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received event network-changed-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-988f15ac-0484-4c50-b32f-8a093667f0f6 req-43e99117-bb59-4b20-9eb9-572e2f3eeebf service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Refreshing instance network info cache due to event network-changed-8ccf37bb-28f1-4f69-ba57-e168eff668e4. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:00:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-988f15ac-0484-4c50-b32f-8a093667f0f6 req-43e99117-bb59-4b20-9eb9-572e2f3eeebf service nova] Acquiring lock "refresh_cache-9f306608-7716-41e0-9aa0-afa8ba173a04" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:00:13 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:00:13 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Updating instance_info_cache with network_info: [{"id": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "address": "fa:16:3e:df:ac:3a", "network": {"id": "06579a46-8d95-4c64-940c-00a80ce64cf2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-824652166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37d00748c91a42a9aa255f62e207a41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf37bb-28", "ovs_interfaceid": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Releasing lock "refresh_cache-9f306608-7716-41e0-9aa0-afa8ba173a04" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:13 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Instance network_info: |[{"id": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "address": "fa:16:3e:df:ac:3a", "network": {"id": "06579a46-8d95-4c64-940c-00a80ce64cf2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-824652166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37d00748c91a42a9aa255f62e207a41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf37bb-28", "ovs_interfaceid": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:00:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-988f15ac-0484-4c50-b32f-8a093667f0f6 req-43e99117-bb59-4b20-9eb9-572e2f3eeebf service nova] Acquired lock "refresh_cache-9f306608-7716-41e0-9aa0-afa8ba173a04" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:00:13 user nova-compute[75246]: DEBUG nova.network.neutron [req-988f15ac-0484-4c50-b32f-8a093667f0f6 req-43e99117-bb59-4b20-9eb9-572e2f3eeebf service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Refreshing network info cache for port 8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:00:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:14 user nova-compute[75246]: DEBUG nova.network.neutron [req-988f15ac-0484-4c50-b32f-8a093667f0f6 req-43e99117-bb59-4b20-9eb9-572e2f3eeebf service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Updated VIF entry in instance network info cache for port 8ccf37bb-28f1-4f69-ba57-e168eff668e4. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:00:14 user nova-compute[75246]: DEBUG nova.network.neutron [req-988f15ac-0484-4c50-b32f-8a093667f0f6 req-43e99117-bb59-4b20-9eb9-572e2f3eeebf service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Updating instance_info_cache with network_info: [{"id": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "address": "fa:16:3e:df:ac:3a", "network": {"id": "06579a46-8d95-4c64-940c-00a80ce64cf2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-824652166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37d00748c91a42a9aa255f62e207a41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf37bb-28", "ovs_interfaceid": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-988f15ac-0484-4c50-b32f-8a093667f0f6 req-43e99117-bb59-4b20-9eb9-572e2f3eeebf service nova] Releasing lock "refresh_cache-9f306608-7716-41e0-9aa0-afa8ba173a04" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:00:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:00:14 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 17:00:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-da4989c5-505b-483b-8bdc-7634b63139ba req-c7d2635d-ffeb-4add-9117-8a98684daebf service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Received event network-vif-plugged-ac51a369-6c87-41c1-8b7c-a313a3b72ee3 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-da4989c5-505b-483b-8bdc-7634b63139ba req-c7d2635d-ffeb-4add-9117-8a98684daebf service nova] Acquiring lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-da4989c5-505b-483b-8bdc-7634b63139ba req-c7d2635d-ffeb-4add-9117-8a98684daebf service nova] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-da4989c5-505b-483b-8bdc-7634b63139ba req-c7d2635d-ffeb-4add-9117-8a98684daebf service nova] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-da4989c5-505b-483b-8bdc-7634b63139ba req-c7d2635d-ffeb-4add-9117-8a98684daebf service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] No waiting events found dispatching network-vif-plugged-ac51a369-6c87-41c1-8b7c-a313a3b72ee3 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:00:15 user nova-compute[75246]: WARNING nova.compute.manager [req-da4989c5-505b-483b-8bdc-7634b63139ba req-c7d2635d-ffeb-4add-9117-8a98684daebf service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Received unexpected event network-vif-plugged-ac51a369-6c87-41c1-8b7c-a313a3b72ee3 for instance with vm_state building and task_state spawning.
Nov 28 17:00:15 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] There are 0 instances to clean {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 17:00:15 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:00:15 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75246) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 17:00:15 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:00:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-b4ab86c1-4f78-48a3-b472-fb088a91d4e5 req-fa8fffa1-4a4d-42bc-91a2-3a20b72d8b8b service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Received event network-vif-plugged-ac51a369-6c87-41c1-8b7c-a313a3b72ee3 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b4ab86c1-4f78-48a3-b472-fb088a91d4e5 req-fa8fffa1-4a4d-42bc-91a2-3a20b72d8b8b service nova] Acquiring lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b4ab86c1-4f78-48a3-b472-fb088a91d4e5 req-fa8fffa1-4a4d-42bc-91a2-3a20b72d8b8b service nova] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b4ab86c1-4f78-48a3-b472-fb088a91d4e5 req-fa8fffa1-4a4d-42bc-91a2-3a20b72d8b8b service nova] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-b4ab86c1-4f78-48a3-b472-fb088a91d4e5 req-fa8fffa1-4a4d-42bc-91a2-3a20b72d8b8b service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] No waiting events found dispatching network-vif-plugged-ac51a369-6c87-41c1-8b7c-a313a3b72ee3 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:00:17 user nova-compute[75246]: WARNING nova.compute.manager [req-b4ab86c1-4f78-48a3-b472-fb088a91d4e5 req-fa8fffa1-4a4d-42bc-91a2-3a20b72d8b8b service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Received unexpected event network-vif-plugged-ac51a369-6c87-41c1-8b7c-a313a3b72ee3 for instance with vm_state building and task_state spawning.
Nov 28 17:00:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:00:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:00:17 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:00:17 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:00:17 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Instance spawned successfully.
Nov 28 17:00:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:00:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:17 user nova-compute[75246]: INFO nova.compute.manager [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Took 9.10 seconds to spawn the instance on the hypervisor.
Nov 28 17:00:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:00:17 user nova-compute[75246]: INFO nova.compute.manager [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Took 10.35 seconds to build instance.
Nov 28 17:00:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48ab31c5-0f75-4fb0-97e7-5d9fb626642e tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.494s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:17 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:00:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:00:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:00:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:00:19 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Skipping network cache update for instance because it is Building. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 28 17:00:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-25480185-8c9c-4aad-9c46-573cfbf65364" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:00:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-25480185-8c9c-4aad-9c46-573cfbf65364" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:00:19 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:00:19 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lazy-loading 'info_cache' on Instance uuid 25480185-8c9c-4aad-9c46-573cfbf65364 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:00:19 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Updating instance_info_cache with network_info: [{"id": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "address": "fa:16:3e:85:27:7b", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c6bdcd-7c", "ovs_interfaceid": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-25480185-8c9c-4aad-9c46-573cfbf65364" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:19 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:00:19 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:00:19 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:00:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:19 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:00:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json" returned: 0 in 0.321s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:24 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:00:24 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:00:24 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=7656MB free_disk=25.79051971435547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:00:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:24 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 25480185-8c9c-4aad-9c46-573cfbf65364 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:00:24 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e1266470-c182-4c0c-a575-4c5043f54745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:00:24 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 4b650a57-5870-4f77-bca2-abe50d970b40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:00:24 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 915bc61e-eaea-40c0-a5ed-4d2a677477f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:00:24 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance f6fe7bf7-782c-4660-9612-101c9f277903 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:00:24 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e0df8b51-bda3-4c45-ab54-c6097f6136ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:00:24 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a3fe15c9-36ab-404e-876e-e6241cca05f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:00:24 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 24d45b28-61df-43cb-bdae-f8ce6b3aaca3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:00:24 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 9f306608-7716-41e0-9aa0-afa8ba173a04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:00:24 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:00:24 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:00:24 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing inventories for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 17:00:25 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating ProviderTree inventory for provider 241ad926-9deb-44ba-a618-a49e4ac21089 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 17:00:25 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating inventory in ProviderTree for provider 241ad926-9deb-44ba-a618-a49e4ac21089 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 17:00:25 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing aggregate associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, aggregates: None {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 17:00:25 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing trait associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 17:00:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:25 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:00:25 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:00:25 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:00:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.938s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:25 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:00:25 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:00:25 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:00:27 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Creating image(s)
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Did not create local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Ensure instance console log exists: /opt/stack/data/nova/instances/9f306608-7716-41e0-9aa0-afa8ba173a04/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Start _get_guest_xml network_info=[{"id": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "address": "fa:16:3e:df:ac:3a", "network": {"id": "06579a46-8d95-4c64-940c-00a80ce64cf2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-824652166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37d00748c91a42a9aa255f62e207a41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf37bb-28", "ovs_interfaceid": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'efa8a97d-cbbc-42fd-9e04-f66ab082d61c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbstSmKj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9f306608-7716-41e0-9aa0-afa8ba173a04', 'attached_at': '', 'detached_at': '', 'volume_id': '5a955b08-0696-4533-b17d-0e99d36216e1', 'serial': '5a955b08-0696-4533-b17d-0e99d36216e1'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:00:27 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:00:27 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connector [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Factory for ISCSI on None {{(pid=75246) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.010s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbstSmKj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:00:27 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:00:27 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:00:27 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adcc8cb-8083-4401-bc6b-81eb70c417d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:00:27 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5df5248-1f47-4e34-83af-7db27de41ac3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1] added
Nov 28 17:00:27 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1723703-5914-40ae-bde7-f85b26b79ed7]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[15441672-389a-4aa0-8c95-3cb4dfcd8b88]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kbstSmKj {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kbstSmKj" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac6173e-7ee4-4a33-97db-425c20b133e7]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kbstSmKj'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[784aab11-c29f-476d-b452-ac1beb2e72de]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5a2de4-29ae-466e-9cb9-5f82fc7b5395]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 17:00:27 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 17:00:27 user nova-compute[75246]:  {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:00:27 user nova-compute[75246]: WARNING os_brick.initiator.connectors.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 17:00:27 user nova-compute[75246]: 
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[63419cdf-2551-40e5-a546-686902c51690]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1, portal: 172.16.0.220,3260]
Nov 28 17:00:27 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1, portal: 172.16.0.220,3260] successful.
Nov 28 17:00:27 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dff6109-e8b8-43e6-9bdd-e3d0b59cda1d]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ba72ec-7b0c-4b15-8ed3-6649240efc0b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:00:27 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:00:27 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[569214b7-01ad-4527-aa67-a11d32cc49a1]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:00:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbstSmKj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23965346666303434', 'path': '/dev/sdb'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965346666303434', 'path': '/dev/sdb'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:00:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1449270168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1449270168',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/bT5nFFmbZrOpaZ0HmyZXCELWLX9dTZ/XfZD4hqIrK3t2MR0LlLUdxpI/bFXzxh3UZ4VIGEMreeSaxuGWiHlXx7TOkvrFpJoQFIrSk/kIxGBFPzpcWuMsi8ubkeEskCA==',key_name='tempest-keypair-1686207482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37d00748c91a42a9aa255f62e207a41c',ramdisk_id='',reservation_id='r-r7anrgfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1837306517',owner_user_name='tempest-ServerActionsV293TestJSON-1837306517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3465e183420e4370a02046024827d21f',uuid=9f306608-7716-41e0-9aa0-afa8ba173a04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "address": "fa:16:3e:df:ac:3a", "network": {"id": "06579a46-8d95-4c64-940c-00a80ce64cf2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-824652166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37d00748c91a42a9aa255f62e207a41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf37bb-28", "ovs_interfaceid": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Converting VIF {"id": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "address": "fa:16:3e:df:ac:3a", "network": {"id": "06579a46-8d95-4c64-940c-00a80ce64cf2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-824652166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37d00748c91a42a9aa255f62e207a41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf37bb-28", "ovs_interfaceid": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ac:3a,bridge_name='br-int',has_traffic_filtering=True,id=8ccf37bb-28f1-4f69-ba57-e168eff668e4,network=Network(06579a46-8d95-4c64-940c-00a80ce64cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf37bb-28') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG nova.objects.instance [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f306608-7716-41e0-9aa0-afa8ba173a04 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:00:28 user nova-compute[75246]:   <uuid>9f306608-7716-41e0-9aa0-afa8ba173a04</uuid>
Nov 28 17:00:28 user nova-compute[75246]:   <name>instance-00000009</name>
Nov 28 17:00:28 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:00:28 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:00:28 user nova-compute[75246]:   <metadata>
Nov 28 17:00:28 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:00:28 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:00:28 user nova-compute[75246]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1449270168</nova:name>
Nov 28 17:00:28 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:00:27</nova:creationTime>
Nov 28 17:00:28 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:00:28 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:00:28 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:00:28 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:00:28 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:00:28 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:00:28 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:00:28 user nova-compute[75246]:       <nova:owner>
Nov 28 17:00:28 user nova-compute[75246]:         <nova:user uuid="3465e183420e4370a02046024827d21f">tempest-ServerActionsV293TestJSON-1837306517-project-member</nova:user>
Nov 28 17:00:28 user nova-compute[75246]:         <nova:project uuid="37d00748c91a42a9aa255f62e207a41c">tempest-ServerActionsV293TestJSON-1837306517</nova:project>
Nov 28 17:00:28 user nova-compute[75246]:       </nova:owner>
Nov 28 17:00:28 user nova-compute[75246]:       <nova:ports>
Nov 28 17:00:28 user nova-compute[75246]:         <nova:port uuid="8ccf37bb-28f1-4f69-ba57-e168eff668e4">
Nov 28 17:00:28 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 17:00:28 user nova-compute[75246]:         </nova:port>
Nov 28 17:00:28 user nova-compute[75246]:       </nova:ports>
Nov 28 17:00:28 user nova-compute[75246]:     </nova:instance>
Nov 28 17:00:28 user nova-compute[75246]:   </metadata>
Nov 28 17:00:28 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:00:28 user nova-compute[75246]:     <system>
Nov 28 17:00:28 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:00:28 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:00:28 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:00:28 user nova-compute[75246]:       <entry name="serial">9f306608-7716-41e0-9aa0-afa8ba173a04</entry>
Nov 28 17:00:28 user nova-compute[75246]:       <entry name="uuid">9f306608-7716-41e0-9aa0-afa8ba173a04</entry>
Nov 28 17:00:28 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:00:28 user nova-compute[75246]:     </system>
Nov 28 17:00:28 user nova-compute[75246]:   </sysinfo>
Nov 28 17:00:28 user nova-compute[75246]:   <os>
Nov 28 17:00:28 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:00:28 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:00:28 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:00:28 user nova-compute[75246]:   </os>
Nov 28 17:00:28 user nova-compute[75246]:   <features>
Nov 28 17:00:28 user nova-compute[75246]:     <acpi/>
Nov 28 17:00:28 user nova-compute[75246]:     <apic/>
Nov 28 17:00:28 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:00:28 user nova-compute[75246]:   </features>
Nov 28 17:00:28 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:00:28 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:00:28 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:00:28 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:00:28 user nova-compute[75246]:   </clock>
Nov 28 17:00:28 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:00:28 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:00:28 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:00:28 user nova-compute[75246]:   </cpu>
Nov 28 17:00:28 user nova-compute[75246]:   <devices>
Nov 28 17:00:28 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:00:28 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:00:28 user nova-compute[75246]:       <source dev="/dev/sdb"/>
Nov 28 17:00:28 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:00:28 user nova-compute[75246]:       <serial>5a955b08-0696-4533-b17d-0e99d36216e1</serial>
Nov 28 17:00:28 user nova-compute[75246]:     </disk>
Nov 28 17:00:28 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:00:28 user nova-compute[75246]:       <mac address="fa:16:3e:df:ac:3a"/>
Nov 28 17:00:28 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:00:28 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:00:28 user nova-compute[75246]:       <target dev="tap8ccf37bb-28"/>
Nov 28 17:00:28 user nova-compute[75246]:     </interface>
Nov 28 17:00:28 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:00:28 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/9f306608-7716-41e0-9aa0-afa8ba173a04/console.log" append="off"/>
Nov 28 17:00:28 user nova-compute[75246]:     </serial>
Nov 28 17:00:28 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:00:28 user nova-compute[75246]:     <video>
Nov 28 17:00:28 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:00:28 user nova-compute[75246]:     </video>
Nov 28 17:00:28 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:00:28 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:00:28 user nova-compute[75246]:     </rng>
Nov 28 17:00:28 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:00:28 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:00:28 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:00:28 user nova-compute[75246]:     </memballoon>
Nov 28 17:00:28 user nova-compute[75246]:   </devices>
Nov 28 17:00:28 user nova-compute[75246]: </domain>
Nov 28 17:00:28 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:00:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1449270168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1449270168',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/bT5nFFmbZrOpaZ0HmyZXCELWLX9dTZ/XfZD4hqIrK3t2MR0LlLUdxpI/bFXzxh3UZ4VIGEMreeSaxuGWiHlXx7TOkvrFpJoQFIrSk/kIxGBFPzpcWuMsi8ubkeEskCA==',key_name='tempest-keypair-1686207482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37d00748c91a42a9aa255f62e207a41c',ramdisk_id='',reservation_id='r-r7anrgfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1837306517',owner_user_name='tempest-ServerActionsV293TestJSON-1837306517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3465e183420e4370a02046024827d21f',uuid=9f306608-7716-41e0-9aa0-afa8ba173a04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "address": "fa:16:3e:df:ac:3a", "network": {"id": "06579a46-8d95-4c64-940c-00a80ce64cf2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-824652166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37d00748c91a42a9aa255f62e207a41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf37bb-28", "ovs_interfaceid": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Converting VIF {"id": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "address": "fa:16:3e:df:ac:3a", "network": {"id": "06579a46-8d95-4c64-940c-00a80ce64cf2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-824652166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37d00748c91a42a9aa255f62e207a41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf37bb-28", "ovs_interfaceid": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ac:3a,bridge_name='br-int',has_traffic_filtering=True,id=8ccf37bb-28f1-4f69-ba57-e168eff668e4,network=Network(06579a46-8d95-4c64-940c-00a80ce64cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf37bb-28') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG os_vif [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ac:3a,bridge_name='br-int',has_traffic_filtering=True,id=8ccf37bb-28f1-4f69-ba57-e168eff668e4,network=Network(06579a46-8d95-4c64-940c-00a80ce64cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf37bb-28') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c3826b0-bae8-5658-9624-1bb0042830a7', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ccf37bb-28, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ccf37bb-28, col_values=(('qos', UUID('4a943cd9-c31e-46fe-b95f-f188578a6e62')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ccf37bb-28, col_values=(('external_ids', {'iface-id': '8ccf37bb-28f1-4f69-ba57-e168eff668e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:ac:3a', 'vm-uuid': '9f306608-7716-41e0-9aa0-afa8ba173a04'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:00:28 user nova-compute[75246]: INFO os_vif [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ac:3a,bridge_name='br-int',has_traffic_filtering=True,id=8ccf37bb-28f1-4f69-ba57-e168eff668e4,network=Network(06579a46-8d95-4c64-940c-00a80ce64cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf37bb-28')
Nov 28 17:00:28 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:00:28 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] No VIF found with MAC fa:16:3e:df:ac:3a, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:00:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "04c31ea4-faaa-4289-8930-9406865e6705" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:29 user nova-compute[75246]: DEBUG nova.compute.manager [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:00:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:29 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:00:29 user nova-compute[75246]: INFO nova.compute.claims [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Claim successful on node user
Nov 28 17:00:29 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:00:29 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:00:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG nova.compute.manager [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG nova.compute.manager [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG nova.network.neutron [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:00:30 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:00:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-50fe4dbe-0c9c-48e9-88a9-50ed93cdcac1 req-1ef269c9-c6f8-48c5-a9e5-73a761aa41ee service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received event network-vif-plugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-50fe4dbe-0c9c-48e9-88a9-50ed93cdcac1 req-1ef269c9-c6f8-48c5-a9e5-73a761aa41ee service nova] Acquiring lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-50fe4dbe-0c9c-48e9-88a9-50ed93cdcac1 req-1ef269c9-c6f8-48c5-a9e5-73a761aa41ee service nova] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-50fe4dbe-0c9c-48e9-88a9-50ed93cdcac1 req-1ef269c9-c6f8-48c5-a9e5-73a761aa41ee service nova] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-50fe4dbe-0c9c-48e9-88a9-50ed93cdcac1 req-1ef269c9-c6f8-48c5-a9e5-73a761aa41ee service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] No waiting events found dispatching network-vif-plugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:00:30 user nova-compute[75246]: WARNING nova.compute.manager [req-50fe4dbe-0c9c-48e9-88a9-50ed93cdcac1 req-1ef269c9-c6f8-48c5-a9e5-73a761aa41ee service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received unexpected event network-vif-plugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 for instance with vm_state building and task_state spawning.
Nov 28 17:00:30 user nova-compute[75246]: DEBUG nova.compute.manager [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG nova.policy [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a47e1ecec64748caab24532ade08a57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3301e46ecb36426a9225385c1fd6c6b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:00:30 user nova-compute[75246]: INFO nova.virt.block_device [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Booting with volume 3fa9362a-51ef-4ae5-8ea5-6001b754eb8c at /dev/vda
Nov 28 17:00:30 user nova-compute[75246]: DEBUG os_brick.utils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbf14b8-ef27-4996-92af-7870979b47c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e151f589-5ced-4ed9-957b-508cc04630ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9f7952-87ec-4401-bad4-829693ddccf7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d51b94d-9fd4-47c4-ac31-d89ae5b708dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:00:30 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:00:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a749b7d3-b256-4639-a420-19f607903175]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG os_brick.utils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Updating existing volume attachment record: b8b5674b-00d3-4f2c-8d13-6950968db77a {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:31 user nova-compute[75246]: DEBUG nova.network.neutron [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Successfully created port: 7f38967b-bb53-4627-ad7f-6324098159a9 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:00:32 user nova-compute[75246]: DEBUG nova.network.neutron [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Successfully created port: 53ae7951-da14-4dcb-bf28-16f035e3d01b {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:00:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-02858b29-5e51-4b54-a846-41ef9e4eabc5 req-e6a0e776-1810-4eae-bc47-72e4ad5bf86c service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received event network-vif-plugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-02858b29-5e51-4b54-a846-41ef9e4eabc5 req-e6a0e776-1810-4eae-bc47-72e4ad5bf86c service nova] Acquiring lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-02858b29-5e51-4b54-a846-41ef9e4eabc5 req-e6a0e776-1810-4eae-bc47-72e4ad5bf86c service nova] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-02858b29-5e51-4b54-a846-41ef9e4eabc5 req-e6a0e776-1810-4eae-bc47-72e4ad5bf86c service nova] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-02858b29-5e51-4b54-a846-41ef9e4eabc5 req-e6a0e776-1810-4eae-bc47-72e4ad5bf86c service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] No waiting events found dispatching network-vif-plugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:00:32 user nova-compute[75246]: WARNING nova.compute.manager [req-02858b29-5e51-4b54-a846-41ef9e4eabc5 req-e6a0e776-1810-4eae-bc47-72e4ad5bf86c service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received unexpected event network-vif-plugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 for instance with vm_state building and task_state spawning.
Nov 28 17:00:32 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:00:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:00:32 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Instance spawned successfully.
Nov 28 17:00:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:00:32 user nova-compute[75246]: DEBUG nova.network.neutron [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Successfully created port: 1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:00:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:33 user nova-compute[75246]: INFO nova.compute.manager [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Took 6.11 seconds to spawn the instance on the hypervisor.
Nov 28 17:00:33 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:00:33 user nova-compute[75246]: INFO nova.compute.manager [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Took 25.92 seconds to build instance.
Nov 28 17:00:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2f88dc7-3c72-4cee-b6b5-dc34ccd8dda7 tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.060s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:33 user nova-compute[75246]: DEBUG nova.network.neutron [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Successfully created port: 56971077-b127-4c9f-897f-22d420785295 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:00:34 user nova-compute[75246]: DEBUG nova.network.neutron [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Successfully created port: a46959c2-cd58-410c-8cdb-054015f1794a {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:00:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Acquiring lock "cd47c12d-05fd-4942-ac19-f3283c90db8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Lock "cd47c12d-05fd-4942-ac19-f3283c90db8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:35 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:00:35 user nova-compute[75246]: DEBUG nova.network.neutron [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Successfully updated port: 7f38967b-bb53-4627-ad7f-6324098159a9 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:00:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:35 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:00:35 user nova-compute[75246]: INFO nova.compute.claims [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Claim successful on node user
Nov 28 17:00:35 user nova-compute[75246]: DEBUG nova.compute.manager [req-b96420e8-6f96-4f42-8e99-8b43312e9b4b req-28af9a49-d123-4642-a3ce-572296b8d657 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-changed-7f38967b-bb53-4627-ad7f-6324098159a9 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:35 user nova-compute[75246]: DEBUG nova.compute.manager [req-b96420e8-6f96-4f42-8e99-8b43312e9b4b req-28af9a49-d123-4642-a3ce-572296b8d657 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Refreshing instance network info cache due to event network-changed-7f38967b-bb53-4627-ad7f-6324098159a9. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:00:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b96420e8-6f96-4f42-8e99-8b43312e9b4b req-28af9a49-d123-4642-a3ce-572296b8d657 service nova] Acquiring lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:00:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b96420e8-6f96-4f42-8e99-8b43312e9b4b req-28af9a49-d123-4642-a3ce-572296b8d657 service nova] Acquired lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:00:35 user nova-compute[75246]: DEBUG nova.network.neutron [req-b96420e8-6f96-4f42-8e99-8b43312e9b4b req-28af9a49-d123-4642-a3ce-572296b8d657 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Refreshing network info cache for port 7f38967b-bb53-4627-ad7f-6324098159a9 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:00:35 user nova-compute[75246]: DEBUG nova.network.neutron [req-b96420e8-6f96-4f42-8e99-8b43312e9b4b req-28af9a49-d123-4642-a3ce-572296b8d657 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG nova.network.neutron [req-b96420e8-6f96-4f42-8e99-8b43312e9b4b req-28af9a49-d123-4642-a3ce-572296b8d657 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b96420e8-6f96-4f42-8e99-8b43312e9b4b req-28af9a49-d123-4642-a3ce-572296b8d657 service nova] Releasing lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.621s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:00:36 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:00:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:00:36 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Creating image(s)
Nov 28 17:00:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Lock "/opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Lock "/opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG nova.policy [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '449b2736a5924946b1caacf0d3178f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f61bb961816422ebd08a75d7054588e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.203s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG nova.network.neutron [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Successfully updated port: 0c207a6f-3e99-4122-8b4b-bf433d46193f {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.226s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/disk 1073741824" returned: 0 in 0.052s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.201s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:37 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:00:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:37 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Cannot resize image /opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:00:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:00:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Ensure instance console log exists: /opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:00:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:37 user nova-compute[75246]: DEBUG nova.compute.manager [req-839ce30c-916c-44c9-a8de-d71743456252 req-f090c593-f660-4b36-8215-1bf429ee2aa7 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-changed-0c207a6f-3e99-4122-8b4b-bf433d46193f {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:37 user nova-compute[75246]: DEBUG nova.compute.manager [req-839ce30c-916c-44c9-a8de-d71743456252 req-f090c593-f660-4b36-8215-1bf429ee2aa7 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Refreshing instance network info cache due to event network-changed-0c207a6f-3e99-4122-8b4b-bf433d46193f. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:00:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-839ce30c-916c-44c9-a8de-d71743456252 req-f090c593-f660-4b36-8215-1bf429ee2aa7 service nova] Acquiring lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:00:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-839ce30c-916c-44c9-a8de-d71743456252 req-f090c593-f660-4b36-8215-1bf429ee2aa7 service nova] Acquired lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:00:37 user nova-compute[75246]: DEBUG nova.network.neutron [req-839ce30c-916c-44c9-a8de-d71743456252 req-f090c593-f660-4b36-8215-1bf429ee2aa7 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Refreshing network info cache for port 0c207a6f-3e99-4122-8b4b-bf433d46193f {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:00:37 user nova-compute[75246]: DEBUG nova.network.neutron [req-839ce30c-916c-44c9-a8de-d71743456252 req-f090c593-f660-4b36-8215-1bf429ee2aa7 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:00:38 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Successfully created port: edde6fa7-66d9-422c-b7a7-b79351a15fa4 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:00:38 user nova-compute[75246]: DEBUG nova.network.neutron [req-839ce30c-916c-44c9-a8de-d71743456252 req-f090c593-f660-4b36-8215-1bf429ee2aa7 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-839ce30c-916c-44c9-a8de-d71743456252 req-f090c593-f660-4b36-8215-1bf429ee2aa7 service nova] Releasing lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:38 user nova-compute[75246]: DEBUG nova.network.neutron [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Successfully updated port: 8f041c8c-a943-41bd-8ea1-7629e2635d6c {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:00:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:39 user nova-compute[75246]: INFO nova.virt.block_device [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Booting with volume 4a29c9e3-4029-4742-b240-d31c497812d8 at /dev/vdb
Nov 28 17:00:39 user nova-compute[75246]: DEBUG os_brick.utils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[288da380-e745-44ff-8325-8c6cb996bf6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f161be55-92a6-4592-b9a0-da4e7963ab7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30a62c1-f83f-4fbb-b7e7-43cdd3f65421]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e237d185-2ec8-4698-9098-867e0d238995]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:00:39 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[183846ba-fe9b-4962-bd0d-84ab7defb391]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG os_brick.utils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Updating existing volume attachment record: 4b980184-89ba-4169-b390-2a0411662706 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Successfully updated port: edde6fa7-66d9-422c-b7a7-b79351a15fa4 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Acquiring lock "refresh_cache-cd47c12d-05fd-4942-ac19-f3283c90db8e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Acquired lock "refresh_cache-cd47c12d-05fd-4942-ac19-f3283c90db8e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG nova.compute.manager [req-515b237e-c724-4dce-931b-f7346beb90bc req-e06d9098-1d73-4c16-8ef7-558e683aef26 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-changed-8f041c8c-a943-41bd-8ea1-7629e2635d6c {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG nova.compute.manager [req-515b237e-c724-4dce-931b-f7346beb90bc req-e06d9098-1d73-4c16-8ef7-558e683aef26 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Refreshing instance network info cache due to event network-changed-8f041c8c-a943-41bd-8ea1-7629e2635d6c. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-515b237e-c724-4dce-931b-f7346beb90bc req-e06d9098-1d73-4c16-8ef7-558e683aef26 service nova] Acquiring lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-515b237e-c724-4dce-931b-f7346beb90bc req-e06d9098-1d73-4c16-8ef7-558e683aef26 service nova] Acquired lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG nova.network.neutron [req-515b237e-c724-4dce-931b-f7346beb90bc req-e06d9098-1d73-4c16-8ef7-558e683aef26 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Refreshing network info cache for port 8f041c8c-a943-41bd-8ea1-7629e2635d6c {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:00:39 user nova-compute[75246]: DEBUG nova.network.neutron [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Successfully updated port: 53ae7951-da14-4dcb-bf28-16f035e3d01b {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.network.neutron [req-515b237e-c724-4dce-931b-f7346beb90bc req-e06d9098-1d73-4c16-8ef7-558e683aef26 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.network.neutron [req-515b237e-c724-4dce-931b-f7346beb90bc req-e06d9098-1d73-4c16-8ef7-558e683aef26 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-515b237e-c724-4dce-931b-f7346beb90bc req-e06d9098-1d73-4c16-8ef7-558e683aef26 service nova] Releasing lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-515b237e-c724-4dce-931b-f7346beb90bc req-e06d9098-1d73-4c16-8ef7-558e683aef26 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Received event network-changed-edde6fa7-66d9-422c-b7a7-b79351a15fa4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-515b237e-c724-4dce-931b-f7346beb90bc req-e06d9098-1d73-4c16-8ef7-558e683aef26 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Refreshing instance network info cache due to event network-changed-edde6fa7-66d9-422c-b7a7-b79351a15fa4. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-515b237e-c724-4dce-931b-f7346beb90bc req-e06d9098-1d73-4c16-8ef7-558e683aef26 service nova] Acquiring lock "refresh_cache-cd47c12d-05fd-4942-ac19-f3283c90db8e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Updating instance_info_cache with network_info: [{"id": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "address": "fa:16:3e:15:a7:d6", "network": {"id": "554d0735-9205-45bc-b6d3-e572a90c8ac2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b8ef2b06a1514b5088e6adece7f4f2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedde6fa7-66", "ovs_interfaceid": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Releasing lock "refresh_cache-cd47c12d-05fd-4942-ac19-f3283c90db8e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Instance network_info: |[{"id": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "address": "fa:16:3e:15:a7:d6", "network": {"id": "554d0735-9205-45bc-b6d3-e572a90c8ac2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b8ef2b06a1514b5088e6adece7f4f2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedde6fa7-66", "ovs_interfaceid": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-515b237e-c724-4dce-931b-f7346beb90bc req-e06d9098-1d73-4c16-8ef7-558e683aef26 service nova] Acquired lock "refresh_cache-cd47c12d-05fd-4942-ac19-f3283c90db8e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.network.neutron [req-515b237e-c724-4dce-931b-f7346beb90bc req-e06d9098-1d73-4c16-8ef7-558e683aef26 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Refreshing network info cache for port edde6fa7-66d9-422c-b7a7-b79351a15fa4 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Start _get_guest_xml network_info=[{"id": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "address": "fa:16:3e:15:a7:d6", "network": {"id": "554d0735-9205-45bc-b6d3-e572a90c8ac2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b8ef2b06a1514b5088e6adece7f4f2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedde6fa7-66", "ovs_interfaceid": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:00:40 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:00:40 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1384405179',display_name='tempest-VolumesNegativeTest-instance-1384405179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1384405179',id=11,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f61bb961816422ebd08a75d7054588e',ramdisk_id='',reservation_id='r-1k0xa5t2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1552569566',owner_user_name='tempest-VolumesNegativeTest-1552569566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:36Z,user_data=None,user_id='449b2736a5924946b1caacf0d3178f3f',uuid=cd47c12d-05fd-4942-ac19-f3283c90db8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "address": "fa:16:3e:15:a7:d6", "network": {"id": "554d0735-9205-45bc-b6d3-e572a90c8ac2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b8ef2b06a1514b5088e6adece7f4f2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedde6fa7-66", "ovs_interfaceid": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Converting VIF {"id": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "address": "fa:16:3e:15:a7:d6", "network": {"id": "554d0735-9205-45bc-b6d3-e572a90c8ac2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b8ef2b06a1514b5088e6adece7f4f2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedde6fa7-66", "ovs_interfaceid": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:a7:d6,bridge_name='br-int',has_traffic_filtering=True,id=edde6fa7-66d9-422c-b7a7-b79351a15fa4,network=Network(554d0735-9205-45bc-b6d3-e572a90c8ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedde6fa7-66') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.objects.instance [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Lazy-loading 'pci_devices' on Instance uuid cd47c12d-05fd-4942-ac19-f3283c90db8e {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:00:40 user nova-compute[75246]:   <uuid>cd47c12d-05fd-4942-ac19-f3283c90db8e</uuid>
Nov 28 17:00:40 user nova-compute[75246]:   <name>instance-0000000b</name>
Nov 28 17:00:40 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:00:40 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:00:40 user nova-compute[75246]:   <metadata>
Nov 28 17:00:40 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:00:40 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:00:40 user nova-compute[75246]:       <nova:name>tempest-VolumesNegativeTest-instance-1384405179</nova:name>
Nov 28 17:00:40 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:00:40</nova:creationTime>
Nov 28 17:00:40 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:00:40 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:00:40 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:00:40 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:00:40 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:00:40 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:00:40 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:00:40 user nova-compute[75246]:       <nova:owner>
Nov 28 17:00:40 user nova-compute[75246]:         <nova:user uuid="449b2736a5924946b1caacf0d3178f3f">tempest-VolumesNegativeTest-1552569566-project-member</nova:user>
Nov 28 17:00:40 user nova-compute[75246]:         <nova:project uuid="4f61bb961816422ebd08a75d7054588e">tempest-VolumesNegativeTest-1552569566</nova:project>
Nov 28 17:00:40 user nova-compute[75246]:       </nova:owner>
Nov 28 17:00:40 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:00:40 user nova-compute[75246]:       <nova:ports>
Nov 28 17:00:40 user nova-compute[75246]:         <nova:port uuid="edde6fa7-66d9-422c-b7a7-b79351a15fa4">
Nov 28 17:00:40 user nova-compute[75246]:           <nova:ip type="fixed" address="192.168.233.62" ipVersion="4"/>
Nov 28 17:00:40 user nova-compute[75246]:         </nova:port>
Nov 28 17:00:40 user nova-compute[75246]:       </nova:ports>
Nov 28 17:00:40 user nova-compute[75246]:     </nova:instance>
Nov 28 17:00:40 user nova-compute[75246]:   </metadata>
Nov 28 17:00:40 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:00:40 user nova-compute[75246]:     <system>
Nov 28 17:00:40 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:00:40 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:00:40 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:00:40 user nova-compute[75246]:       <entry name="serial">cd47c12d-05fd-4942-ac19-f3283c90db8e</entry>
Nov 28 17:00:40 user nova-compute[75246]:       <entry name="uuid">cd47c12d-05fd-4942-ac19-f3283c90db8e</entry>
Nov 28 17:00:40 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:00:40 user nova-compute[75246]:     </system>
Nov 28 17:00:40 user nova-compute[75246]:   </sysinfo>
Nov 28 17:00:40 user nova-compute[75246]:   <os>
Nov 28 17:00:40 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:00:40 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:00:40 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:00:40 user nova-compute[75246]:   </os>
Nov 28 17:00:40 user nova-compute[75246]:   <features>
Nov 28 17:00:40 user nova-compute[75246]:     <acpi/>
Nov 28 17:00:40 user nova-compute[75246]:     <apic/>
Nov 28 17:00:40 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:00:40 user nova-compute[75246]:   </features>
Nov 28 17:00:40 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:00:40 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:00:40 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:00:40 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:00:40 user nova-compute[75246]:   </clock>
Nov 28 17:00:40 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:00:40 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:00:40 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:00:40 user nova-compute[75246]:   </cpu>
Nov 28 17:00:40 user nova-compute[75246]:   <devices>
Nov 28 17:00:40 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:00:40 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:00:40 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/disk"/>
Nov 28 17:00:40 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:00:40 user nova-compute[75246]:     </disk>
Nov 28 17:00:40 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:00:40 user nova-compute[75246]:       <mac address="fa:16:3e:15:a7:d6"/>
Nov 28 17:00:40 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:00:40 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:00:40 user nova-compute[75246]:       <target dev="tapedde6fa7-66"/>
Nov 28 17:00:40 user nova-compute[75246]:     </interface>
Nov 28 17:00:40 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:00:40 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/console.log" append="off"/>
Nov 28 17:00:40 user nova-compute[75246]:     </serial>
Nov 28 17:00:40 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:00:40 user nova-compute[75246]:     <video>
Nov 28 17:00:40 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:00:40 user nova-compute[75246]:     </video>
Nov 28 17:00:40 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:00:40 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:00:40 user nova-compute[75246]:     </rng>
Nov 28 17:00:40 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:00:40 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:00:40 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:00:40 user nova-compute[75246]:     </memballoon>
Nov 28 17:00:40 user nova-compute[75246]:   </devices>
Nov 28 17:00:40 user nova-compute[75246]: </domain>
Nov 28 17:00:40 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1384405179',display_name='tempest-VolumesNegativeTest-instance-1384405179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1384405179',id=11,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f61bb961816422ebd08a75d7054588e',ramdisk_id='',reservation_id='r-1k0xa5t2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1552569566',owner_user_name='tempest-VolumesNegativeTest-1552569566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:36Z,user_data=None,user_id='449b2736a5924946b1caacf0d3178f3f',uuid=cd47c12d-05fd-4942-ac19-f3283c90db8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "address": "fa:16:3e:15:a7:d6", "network": {"id": "554d0735-9205-45bc-b6d3-e572a90c8ac2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b8ef2b06a1514b5088e6adece7f4f2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedde6fa7-66", "ovs_interfaceid": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Converting VIF {"id": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "address": "fa:16:3e:15:a7:d6", "network": {"id": "554d0735-9205-45bc-b6d3-e572a90c8ac2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b8ef2b06a1514b5088e6adece7f4f2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedde6fa7-66", "ovs_interfaceid": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:a7:d6,bridge_name='br-int',has_traffic_filtering=True,id=edde6fa7-66d9-422c-b7a7-b79351a15fa4,network=Network(554d0735-9205-45bc-b6d3-e572a90c8ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedde6fa7-66') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG os_vif [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:a7:d6,bridge_name='br-int',has_traffic_filtering=True,id=edde6fa7-66d9-422c-b7a7-b79351a15fa4,network=Network(554d0735-9205-45bc-b6d3-e572a90c8ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedde6fa7-66') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dabbb27e-a340-55e9-ad43-0c2c88dc5dde', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedde6fa7-66, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedde6fa7-66, col_values=(('qos', UUID('e1747270-4734-4644-8f78-5275f5ab7075')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedde6fa7-66, col_values=(('external_ids', {'iface-id': 'edde6fa7-66d9-422c-b7a7-b79351a15fa4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:a7:d6', 'vm-uuid': 'cd47c12d-05fd-4942-ac19-f3283c90db8e'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:40 user nova-compute[75246]: INFO os_vif [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:a7:d6,bridge_name='br-int',has_traffic_filtering=True,id=edde6fa7-66d9-422c-b7a7-b79351a15fa4,network=Network(554d0735-9205-45bc-b6d3-e572a90c8ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedde6fa7-66')
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:00:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] No VIF found with MAC fa:16:3e:15:a7:d6, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:00:41 user nova-compute[75246]: DEBUG nova.network.neutron [req-515b237e-c724-4dce-931b-f7346beb90bc req-e06d9098-1d73-4c16-8ef7-558e683aef26 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Updated VIF entry in instance network info cache for port edde6fa7-66d9-422c-b7a7-b79351a15fa4. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:00:41 user nova-compute[75246]: DEBUG nova.network.neutron [req-515b237e-c724-4dce-931b-f7346beb90bc req-e06d9098-1d73-4c16-8ef7-558e683aef26 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Updating instance_info_cache with network_info: [{"id": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "address": "fa:16:3e:15:a7:d6", "network": {"id": "554d0735-9205-45bc-b6d3-e572a90c8ac2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b8ef2b06a1514b5088e6adece7f4f2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedde6fa7-66", "ovs_interfaceid": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-515b237e-c724-4dce-931b-f7346beb90bc req-e06d9098-1d73-4c16-8ef7-558e683aef26 service nova] Releasing lock "refresh_cache-cd47c12d-05fd-4942-ac19-f3283c90db8e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:41 user nova-compute[75246]: DEBUG nova.network.neutron [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Successfully updated port: 1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:00:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG nova.compute.manager [req-e65fbf05-112b-455c-8d54-eafaaa4dc33f req-94a5d9b5-8a4a-4c29-8ade-2a863134a3cc service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-changed-53ae7951-da14-4dcb-bf28-16f035e3d01b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG nova.compute.manager [req-e65fbf05-112b-455c-8d54-eafaaa4dc33f req-94a5d9b5-8a4a-4c29-8ade-2a863134a3cc service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Refreshing instance network info cache due to event network-changed-53ae7951-da14-4dcb-bf28-16f035e3d01b. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e65fbf05-112b-455c-8d54-eafaaa4dc33f req-94a5d9b5-8a4a-4c29-8ade-2a863134a3cc service nova] Acquiring lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e65fbf05-112b-455c-8d54-eafaaa4dc33f req-94a5d9b5-8a4a-4c29-8ade-2a863134a3cc service nova] Acquired lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG nova.network.neutron [req-e65fbf05-112b-455c-8d54-eafaaa4dc33f req-94a5d9b5-8a4a-4c29-8ade-2a863134a3cc service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Refreshing network info cache for port 53ae7951-da14-4dcb-bf28-16f035e3d01b {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG nova.network.neutron [req-e65fbf05-112b-455c-8d54-eafaaa4dc33f req-94a5d9b5-8a4a-4c29-8ade-2a863134a3cc service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG nova.network.neutron [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Successfully updated port: 56971077-b127-4c9f-897f-22d420785295 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG nova.network.neutron [req-e65fbf05-112b-455c-8d54-eafaaa4dc33f req-94a5d9b5-8a4a-4c29-8ade-2a863134a3cc service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e65fbf05-112b-455c-8d54-eafaaa4dc33f req-94a5d9b5-8a4a-4c29-8ade-2a863134a3cc service nova] Releasing lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG nova.compute.manager [req-e65fbf05-112b-455c-8d54-eafaaa4dc33f req-94a5d9b5-8a4a-4c29-8ade-2a863134a3cc service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-changed-1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG nova.compute.manager [req-e65fbf05-112b-455c-8d54-eafaaa4dc33f req-94a5d9b5-8a4a-4c29-8ade-2a863134a3cc service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Refreshing instance network info cache due to event network-changed-1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e65fbf05-112b-455c-8d54-eafaaa4dc33f req-94a5d9b5-8a4a-4c29-8ade-2a863134a3cc service nova] Acquiring lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e65fbf05-112b-455c-8d54-eafaaa4dc33f req-94a5d9b5-8a4a-4c29-8ade-2a863134a3cc service nova] Acquired lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG nova.network.neutron [req-e65fbf05-112b-455c-8d54-eafaaa4dc33f req-94a5d9b5-8a4a-4c29-8ade-2a863134a3cc service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Refreshing network info cache for port 1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:42 user nova-compute[75246]: DEBUG nova.network.neutron [req-e65fbf05-112b-455c-8d54-eafaaa4dc33f req-94a5d9b5-8a4a-4c29-8ade-2a863134a3cc service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:00:43 user nova-compute[75246]: DEBUG nova.network.neutron [req-e65fbf05-112b-455c-8d54-eafaaa4dc33f req-94a5d9b5-8a4a-4c29-8ade-2a863134a3cc service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e65fbf05-112b-455c-8d54-eafaaa4dc33f req-94a5d9b5-8a4a-4c29-8ade-2a863134a3cc service nova] Releasing lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-changed-56971077-b127-4c9f-897f-22d420785295 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Refreshing instance network info cache due to event network-changed-56971077-b127-4c9f-897f-22d420785295. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] Acquiring lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] Acquired lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.network.neutron [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Refreshing network info cache for port 56971077-b127-4c9f-897f-22d420785295 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.network.neutron [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:00:44 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Instance spawned successfully.
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:00:44 user nova-compute[75246]: INFO nova.compute.manager [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Took 8.31 seconds to spawn the instance on the hypervisor.
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.network.neutron [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] Releasing lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Received event network-vif-plugged-edde6fa7-66d9-422c-b7a7-b79351a15fa4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] Acquiring lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] Lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] Lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] No waiting events found dispatching network-vif-plugged-edde6fa7-66d9-422c-b7a7-b79351a15fa4 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:00:44 user nova-compute[75246]: WARNING nova.compute.manager [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Received unexpected event network-vif-plugged-edde6fa7-66d9-422c-b7a7-b79351a15fa4 for instance with vm_state building and task_state spawning.
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Received event network-vif-plugged-edde6fa7-66d9-422c-b7a7-b79351a15fa4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] Acquiring lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] Lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] Lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] No waiting events found dispatching network-vif-plugged-edde6fa7-66d9-422c-b7a7-b79351a15fa4 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:00:44 user nova-compute[75246]: WARNING nova.compute.manager [req-30522f57-f7eb-4f16-853c-a57d6d0d8aa3 req-5408dde1-e226-41ba-aed9-13fccd130c54 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Received unexpected event network-vif-plugged-edde6fa7-66d9-422c-b7a7-b79351a15fa4 for instance with vm_state building and task_state spawning.
Nov 28 17:00:44 user nova-compute[75246]: INFO nova.compute.manager [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Took 9.31 seconds to build instance.
Nov 28 17:00:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b936161-933a-4991-a9a7-12781c22f8eb tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Lock "cd47c12d-05fd-4942-ac19-f3283c90db8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.445s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:45 user nova-compute[75246]: DEBUG nova.network.neutron [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Successfully updated port: a46959c2-cd58-410c-8cdb-054015f1794a {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:00:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Acquiring lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:00:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Acquired lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:00:45 user nova-compute[75246]: DEBUG nova.network.neutron [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:00:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:45 user nova-compute[75246]: DEBUG nova.network.neutron [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:00:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-8d9e2ef1-45cd-46a9-9c8f-6989f35f0ff4 req-de4c2ceb-494f-4ba3-b427-8fa4275ac857 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-changed-a46959c2-cd58-410c-8cdb-054015f1794a {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:00:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-8d9e2ef1-45cd-46a9-9c8f-6989f35f0ff4 req-de4c2ceb-494f-4ba3-b427-8fa4275ac857 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Refreshing instance network info cache due to event network-changed-a46959c2-cd58-410c-8cdb-054015f1794a. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:00:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8d9e2ef1-45cd-46a9-9c8f-6989f35f0ff4 req-de4c2ceb-494f-4ba3-b427-8fa4275ac857 service nova] Acquiring lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG nova.network.neutron [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Updating instance_info_cache with network_info: [{"id": "7f38967b-bb53-4627-ad7f-6324098159a9", "address": "fa:16:3e:0e:49:2c", "network": {"id": "5d735e77-2be9-47ce-bff7-55da5c0432ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1287968723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f38967b-bb", "ovs_interfaceid": "7f38967b-bb53-4627-ad7f-6324098159a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "address": "fa:16:3e:ca:43:c6", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c207a6f-3e", "ovs_interfaceid": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "address": "fa:16:3e:56:1a:9d", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f041c8c-a9", "ovs_interfaceid": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "address": "fa:16:3e:05:5e:e3", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ae7951-da", "ovs_interfaceid": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "address": "fa:16:3e:e6:6e:f2", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a556d5f-62", "ovs_interfaceid": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56971077-b127-4c9f-897f-22d420785295", "address": "fa:16:3e:a9:3c:06", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56971077-b1", "ovs_interfaceid": "56971077-b127-4c9f-897f-22d420785295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a46959c2-cd58-410c-8cdb-054015f1794a", "address": "fa:16:3e:4b:1c:67", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46959c2-cd", "ovs_interfaceid": "a46959c2-cd58-410c-8cdb-054015f1794a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Releasing lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG nova.compute.manager [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Instance network_info: |[{"id": "7f38967b-bb53-4627-ad7f-6324098159a9", "address": "fa:16:3e:0e:49:2c", "network": {"id": "5d735e77-2be9-47ce-bff7-55da5c0432ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1287968723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f38967b-bb", "ovs_interfaceid": "7f38967b-bb53-4627-ad7f-6324098159a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "address": "fa:16:3e:ca:43:c6", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c207a6f-3e", "ovs_interfaceid": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "address": "fa:16:3e:56:1a:9d", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f041c8c-a9", "ovs_interfaceid": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "address": "fa:16:3e:05:5e:e3", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ae7951-da", "ovs_interfaceid": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "address": "fa:16:3e:e6:6e:f2", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a556d5f-62", "ovs_interfaceid": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56971077-b127-4c9f-897f-22d420785295", "address": "fa:16:3e:a9:3c:06", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56971077-b1", "ovs_interfaceid": "56971077-b127-4c9f-897f-22d420785295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a46959c2-cd58-410c-8cdb-054015f1794a", "address": "fa:16:3e:4b:1c:67", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46959c2-cd", "ovs_interfaceid": "a46959c2-cd58-410c-8cdb-054015f1794a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8d9e2ef1-45cd-46a9-9c8f-6989f35f0ff4 req-de4c2ceb-494f-4ba3-b427-8fa4275ac857 service nova] Acquired lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG nova.network.neutron [req-8d9e2ef1-45cd-46a9-9c8f-6989f35f0ff4 req-de4c2ceb-494f-4ba3-b427-8fa4275ac857 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Refreshing network info cache for port a46959c2-cd58-410c-8cdb-054015f1794a {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG nova.network.neutron [req-8d9e2ef1-45cd-46a9-9c8f-6989f35f0ff4 req-de4c2ceb-494f-4ba3-b427-8fa4275ac857 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Updated VIF entry in instance network info cache for port a46959c2-cd58-410c-8cdb-054015f1794a. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG nova.network.neutron [req-8d9e2ef1-45cd-46a9-9c8f-6989f35f0ff4 req-de4c2ceb-494f-4ba3-b427-8fa4275ac857 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Updating instance_info_cache with network_info: [{"id": "7f38967b-bb53-4627-ad7f-6324098159a9", "address": "fa:16:3e:0e:49:2c", "network": {"id": "5d735e77-2be9-47ce-bff7-55da5c0432ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1287968723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f38967b-bb", "ovs_interfaceid": "7f38967b-bb53-4627-ad7f-6324098159a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "address": "fa:16:3e:ca:43:c6", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c207a6f-3e", "ovs_interfaceid": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "address": "fa:16:3e:56:1a:9d", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f041c8c-a9", "ovs_interfaceid": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "address": "fa:16:3e:05:5e:e3", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ae7951-da", "ovs_interfaceid": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "address": "fa:16:3e:e6:6e:f2", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a556d5f-62", "ovs_interfaceid": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56971077-b127-4c9f-897f-22d420785295", "address": "fa:16:3e:a9:3c:06", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56971077-b1", "ovs_interfaceid": "56971077-b127-4c9f-897f-22d420785295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a46959c2-cd58-410c-8cdb-054015f1794a", "address": "fa:16:3e:4b:1c:67", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46959c2-cd", "ovs_interfaceid": "a46959c2-cd58-410c-8cdb-054015f1794a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8d9e2ef1-45cd-46a9-9c8f-6989f35f0ff4 req-de4c2ceb-494f-4ba3-b427-8fa4275ac857 service nova] Releasing lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:00:47 user nova-compute[75246]: INFO nova.virt.block_device [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Booting with volume 622aeb5e-70ae-4744-84f3-cb47decd3ac2 at /dev/vdc
Nov 28 17:00:47 user nova-compute[75246]: DEBUG os_brick.utils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b46bdd9-734b-45b6-8e2a-2a75fd071170]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd6214b-84d4-43db-8b25-68730495926e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d610a8d-9025-4cdb-9549-621bd938ec2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ab6b64-7f23-41c4-9f35-eac5a33b4b65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:00:48 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:00:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:00:48 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:00:48 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2e0728-c302-4052-b396-495c7a053a6e]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:48 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:00:48 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:00:48 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:00:48 user nova-compute[75246]: DEBUG os_brick.utils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:00:48 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Updating existing volume attachment record: db367e2a-8a1c-4cf6-8cf8-32120bb7259d {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:00:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.compute.manager [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:00:55 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Creating image(s)
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Did not create local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Ensure instance console log exists: /opt/stack/data/nova/instances/04c31ea4-faaa-4289-8930-9406865e6705/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Start _get_guest_xml network_info=[{"id": "7f38967b-bb53-4627-ad7f-6324098159a9", "address": "fa:16:3e:0e:49:2c", "network": {"id": "5d735e77-2be9-47ce-bff7-55da5c0432ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1287968723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f38967b-bb", "ovs_interfaceid": "7f38967b-bb53-4627-ad7f-6324098159a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "address": "fa:16:3e:ca:43:c6", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c207a6f-3e", "ovs_interfaceid": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "address": "fa:16:3e:56:1a:9d", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f041c8c-a9", "ovs_interfaceid": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "address": "fa:16:3e:05:5e:e3", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ae7951-da", "ovs_interfaceid": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "address": "fa:16:3e:e6:6e:f2", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a556d5f-62", "ovs_interfaceid": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56971077-b127-4c9f-897f-22d420785295", "address": "fa:16:3e:a9:3c:06", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56971077-b1", "ovs_interfaceid": "56971077-b127-4c9f-897f-22d420785295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a46959c2-cd58-410c-8cdb-054015f1794a", "address": "fa:16:3e:4b:1c:67", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46959c2-cd", "ovs_interfaceid": "a46959c2-cd58-410c-8cdb-054015f1794a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'b8b5674b-00d3-4f2c-8d13-6950968db77a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJoRnaXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04c31ea4-faaa-4289-8930-9406865e6705', 'attached_at': '', 'detached_at': '', 'volume_id': '3fa9362a-51ef-4ae5-8ea5-6001b754eb8c', 'serial': '3fa9362a-51ef-4ae5-8ea5-6001b754eb8c'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 1, 'attachment_id': '4b980184-89ba-4169-b390-2a0411662706', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CwQqOMWc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04c31ea4-faaa-4289-8930-9406865e6705', 'attached_at': '', 'detached_at': '', 'volume_id': '4a29c9e3-4029-4742-b240-d31c497812d8', 'serial': '4a29c9e3-4029-4742-b240-d31c497812d8'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 2, 'attachment_id': 'db367e2a-8a1c-4cf6-8cf8-32120bb7259d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFYkfNDw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04c31ea4-faaa-4289-8930-9406865e6705', 'attached_at': '', 'detached_at': '', 'volume_id': '622aeb5e-70ae-4744-84f3-cb47decd3ac2', 'serial': '622aeb5e-70ae-4744-84f3-cb47decd3ac2'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:00:55 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:00:55 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJoRnaXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:00:55 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:00:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:00:55 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:00:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:00:55 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bd17b7-1cf5-47a0-97df-630822e57830]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:00:55 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[22eaabb5-75ab-4c1e-bed5-b6bc1c5b6bc2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c] added
Nov 28 17:00:55 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.055s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be7dac2-41f0-4485-a225-8e59729e47ff]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1061de8e-1afa-4be5-9b3b-4a3800d04555]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJoRnaXq {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJoRnaXq" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a1d79d-1e22-4687-939d-473114ac40f6]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tJoRnaXq'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce12bc0-92cd-49b9-ad22-470e985ffa78]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7d7542-accc-40bd-a77e-48c57c91dcd4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:00:55 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:00:55 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:00:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b49960b-3524-4bfd-b093-365677852e66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c, portal: 172.16.0.220,3260]
Nov 28 17:00:56 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c, portal: 172.16.0.220,3260] successful.
Nov 28 17:00:56 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff69f5fb-9857-4be1-b158-f1560a2213c3]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5727dda4-3274-450f-9277-8f96650ca04d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:00:56 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:00:56 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:00:56 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:00:56 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[961d29b7-3811-4c34-a09e-395df61a7b85]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:00:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJoRnaXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26663613461343334', 'path': '/dev/sdc'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663613461343334', 'path': '/dev/sdc'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CwQqOMWc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:00:57 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:00:57 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:00:57 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e81460-eb11-4bb7-b034-b3712a4fd80f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:00:57 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[160e2007-1374-41d5-ad4a-f0e2bd8d7d99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8] added
Nov 28 17:00:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[623517c2-7552-43b6-8115-8420bc4010b7]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.117s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5fc990-a147-4c56-8db9-a48420a00e9b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CwQqOMWc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CwQqOMWc" returned: 0 in 0.113s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[387c6cb4-abd1-4375-98a3-538870176302]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CwQqOMWc'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae349f6-6de0-4ef1-9824-8d930b62f0d3]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[90837c87-c532-4358-937f-c35e5685b7c4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:00:57 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:00:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:00:57 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:00:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10b399c-fd90-4524-90d0-313e12ec133a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8, portal: 172.16.0.220,3260]
Nov 28 17:00:57 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8, portal: 172.16.0.220,3260] successful.
Nov 28 17:00:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9e7799-406c-4e07-8406-f4c63ded6b31]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b04a14-7572-4ed1-9823-e6dc4f46c773]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:00:57 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:00:57 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:00:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:00:57 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:00:57 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:00:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.468s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46b78dd-629c-4988-b85c-e3ff349317ea]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:57 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CwQqOMWc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.496s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] <== connect_volume: return (1496ms) {'type': 'block', 'scsi_wwn': '26131316565306563', 'path': '/dev/sdd'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131316565306563', 'path': '/dev/sdd'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFYkfNDw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:00:58 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:00:58 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:00:58 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7946bf3-6983-4e4b-b8ac-a5cd4fd01fe2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:00:58 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7535bf07-9e47-47ae-bf9d-501e7c35516d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2] added
Nov 28 17:00:58 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d59114-a7db-4081-b4d2-a041b3a43fd1]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f954c4d-f15b-4d57-a868-882731d5be92]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AFYkfNDw {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AFYkfNDw" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb67eab-0dc3-474d-9a10-49866e6ae1ee]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AFYkfNDw'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c107745a-67d6-418d-80d8-724474aa0262]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3437da-5205-4150-ad1e-65d1e0d98ebe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:00:58 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:00:58 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:00:58 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:00:58 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:00:58 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:00:58 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35a86c1-f9de-4006-a2da-1a600c779977]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2, portal: 172.16.0.220,3260]
Nov 28 17:00:58 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2, portal: 172.16.0.220,3260] successful.
Nov 28 17:00:58 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[82790bd3-f9a0-4d25-ac61-90e15b974313]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:00:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78de885-abea-4465-8aa4-8252e06b1600]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:00:59 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:00:59 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:00:59 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:00:59 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:00:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:00:59 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:00:59 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:00:59 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:00:59 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:00:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:00:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:00:59 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:00:59 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:00:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:00:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:00:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e602e18-a11f-49d0-a097-cec5b02f29df]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:00:59 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:00:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFYkfNDw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23363363231356434', 'path': '/dev/sde'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363363231356434', 'path': '/dev/sde'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f38967b-bb53-4627-ad7f-6324098159a9", "address": "fa:16:3e:0e:49:2c", "network": {"id": "5d735e77-2be9-47ce-bff7-55da5c0432ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1287968723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f38967b-bb", "ovs_interfaceid": "7f38967b-bb53-4627-ad7f-6324098159a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "7f38967b-bb53-4627-ad7f-6324098159a9", "address": "fa:16:3e:0e:49:2c", "network": {"id": "5d735e77-2be9-47ce-bff7-55da5c0432ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1287968723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f38967b-bb", "ovs_interfaceid": "7f38967b-bb53-4627-ad7f-6324098159a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:49:2c,bridge_name='br-int',has_traffic_filtering=True,id=7f38967b-bb53-4627-ad7f-6324098159a9,network=Network(5d735e77-2be9-47ce-bff7-55da5c0432ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f38967b-bb') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "address": "fa:16:3e:ca:43:c6", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c207a6f-3e", "ovs_interfaceid": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "address": "fa:16:3e:ca:43:c6", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c207a6f-3e", "ovs_interfaceid": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:43:c6,bridge_name='br-int',has_traffic_filtering=True,id=0c207a6f-3e99-4122-8b4b-bf433d46193f,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0c207a6f-3e') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "address": "fa:16:3e:56:1a:9d", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f041c8c-a9", "ovs_interfaceid": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "address": "fa:16:3e:56:1a:9d", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f041c8c-a9", "ovs_interfaceid": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:1a:9d,bridge_name='br-int',has_traffic_filtering=True,id=8f041c8c-a943-41bd-8ea1-7629e2635d6c,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8f041c8c-a9') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "address": "fa:16:3e:05:5e:e3", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ae7951-da", "ovs_interfaceid": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "address": "fa:16:3e:05:5e:e3", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ae7951-da", "ovs_interfaceid": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:e3,bridge_name='br-int',has_traffic_filtering=True,id=53ae7951-da14-4dcb-bf28-16f035e3d01b,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ae7951-da') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "address": "fa:16:3e:e6:6e:f2", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a556d5f-62", "ovs_interfaceid": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "address": "fa:16:3e:e6:6e:f2", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a556d5f-62", "ovs_interfaceid": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:6e:f2,bridge_name='br-int',has_traffic_filtering=True,id=1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a556d5f-62') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56971077-b127-4c9f-897f-22d420785295", "address": "fa:16:3e:a9:3c:06", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56971077-b1", "ovs_interfaceid": "56971077-b127-4c9f-897f-22d420785295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "56971077-b127-4c9f-897f-22d420785295", "address": "fa:16:3e:a9:3c:06", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56971077-b1", "ovs_interfaceid": "56971077-b127-4c9f-897f-22d420785295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3c:06,bridge_name='br-int',has_traffic_filtering=True,id=56971077-b127-4c9f-897f-22d420785295,network=Network(bb32316c-05ca-45f5-a0a9-b386f0a72f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56971077-b1') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a46959c2-cd58-410c-8cdb-054015f1794a", "address": "fa:16:3e:4b:1c:67", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46959c2-cd", "ovs_interfaceid": "a46959c2-cd58-410c-8cdb-054015f1794a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "a46959c2-cd58-410c-8cdb-054015f1794a", "address": "fa:16:3e:4b:1c:67", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46959c2-cd", "ovs_interfaceid": "a46959c2-cd58-410c-8cdb-054015f1794a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:1c:67,bridge_name='br-int',has_traffic_filtering=True,id=a46959c2-cd58-410c-8cdb-054015f1794a,network=Network(bb32316c-05ca-45f5-a0a9-b386f0a72f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46959c2-cd') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.objects.instance [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lazy-loading 'pci_devices' on Instance uuid 04c31ea4-faaa-4289-8930-9406865e6705 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:01:00 user nova-compute[75246]:   <uuid>04c31ea4-faaa-4289-8930-9406865e6705</uuid>
Nov 28 17:01:00 user nova-compute[75246]:   <name>instance-0000000a</name>
Nov 28 17:01:00 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:01:00 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:01:00 user nova-compute[75246]:   <metadata>
Nov 28 17:01:00 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:01:00 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:01:00 user nova-compute[75246]:       <nova:name>tempest-device-tagging-server-698112315</nova:name>
Nov 28 17:01:00 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:00:55</nova:creationTime>
Nov 28 17:01:00 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:01:00 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:01:00 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:01:00 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:01:00 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:01:00 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:01:00 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:01:00 user nova-compute[75246]:       <nova:owner>
Nov 28 17:01:00 user nova-compute[75246]:         <nova:user uuid="a47e1ecec64748caab24532ade08a57b">tempest-TaggedBootDevicesTest_v242-1662440183-project-member</nova:user>
Nov 28 17:01:00 user nova-compute[75246]:         <nova:project uuid="3301e46ecb36426a9225385c1fd6c6b4">tempest-TaggedBootDevicesTest_v242-1662440183</nova:project>
Nov 28 17:01:00 user nova-compute[75246]:       </nova:owner>
Nov 28 17:01:00 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:01:00 user nova-compute[75246]:       <nova:ports>
Nov 28 17:01:00 user nova-compute[75246]:         <nova:port uuid="7f38967b-bb53-4627-ad7f-6324098159a9">
Nov 28 17:01:00 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 17:01:00 user nova-compute[75246]:         </nova:port>
Nov 28 17:01:00 user nova-compute[75246]:         <nova:port uuid="0c207a6f-3e99-4122-8b4b-bf433d46193f">
Nov 28 17:01:00 user nova-compute[75246]:           <nova:ip type="fixed" address="10.1.1.201" ipVersion="4"/>
Nov 28 17:01:00 user nova-compute[75246]:         </nova:port>
Nov 28 17:01:00 user nova-compute[75246]:         <nova:port uuid="8f041c8c-a943-41bd-8ea1-7629e2635d6c">
Nov 28 17:01:00 user nova-compute[75246]:           <nova:ip type="fixed" address="10.1.1.219" ipVersion="4"/>
Nov 28 17:01:00 user nova-compute[75246]:         </nova:port>
Nov 28 17:01:00 user nova-compute[75246]:         <nova:port uuid="53ae7951-da14-4dcb-bf28-16f035e3d01b">
Nov 28 17:01:00 user nova-compute[75246]:           <nova:ip type="fixed" address="10.1.1.166" ipVersion="4"/>
Nov 28 17:01:00 user nova-compute[75246]:         </nova:port>
Nov 28 17:01:00 user nova-compute[75246]:         <nova:port uuid="1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1">
Nov 28 17:01:00 user nova-compute[75246]:           <nova:ip type="fixed" address="10.1.1.81" ipVersion="4"/>
Nov 28 17:01:00 user nova-compute[75246]:         </nova:port>
Nov 28 17:01:00 user nova-compute[75246]:         <nova:port uuid="56971077-b127-4c9f-897f-22d420785295">
Nov 28 17:01:00 user nova-compute[75246]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 28 17:01:00 user nova-compute[75246]:         </nova:port>
Nov 28 17:01:00 user nova-compute[75246]:         <nova:port uuid="a46959c2-cd58-410c-8cdb-054015f1794a">
Nov 28 17:01:00 user nova-compute[75246]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 28 17:01:00 user nova-compute[75246]:         </nova:port>
Nov 28 17:01:00 user nova-compute[75246]:       </nova:ports>
Nov 28 17:01:00 user nova-compute[75246]:     </nova:instance>
Nov 28 17:01:00 user nova-compute[75246]:   </metadata>
Nov 28 17:01:00 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:01:00 user nova-compute[75246]:     <system>
Nov 28 17:01:00 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:01:00 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:01:00 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:01:00 user nova-compute[75246]:       <entry name="serial">04c31ea4-faaa-4289-8930-9406865e6705</entry>
Nov 28 17:01:00 user nova-compute[75246]:       <entry name="uuid">04c31ea4-faaa-4289-8930-9406865e6705</entry>
Nov 28 17:01:00 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:01:00 user nova-compute[75246]:     </system>
Nov 28 17:01:00 user nova-compute[75246]:   </sysinfo>
Nov 28 17:01:00 user nova-compute[75246]:   <os>
Nov 28 17:01:00 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:01:00 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:01:00 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:01:00 user nova-compute[75246]:   </os>
Nov 28 17:01:00 user nova-compute[75246]:   <features>
Nov 28 17:01:00 user nova-compute[75246]:     <acpi/>
Nov 28 17:01:00 user nova-compute[75246]:     <apic/>
Nov 28 17:01:00 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:01:00 user nova-compute[75246]:   </features>
Nov 28 17:01:00 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:01:00 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:01:00 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:01:00 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:01:00 user nova-compute[75246]:   </clock>
Nov 28 17:01:00 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:01:00 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:01:00 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:01:00 user nova-compute[75246]:   </cpu>
Nov 28 17:01:00 user nova-compute[75246]:   <devices>
Nov 28 17:01:00 user nova-compute[75246]:     <disk type="file" device="cdrom">
Nov 28 17:01:00 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 17:01:00 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/04c31ea4-faaa-4289-8930-9406865e6705/disk.config"/>
Nov 28 17:01:00 user nova-compute[75246]:       <target dev="hda" bus="ide"/>
Nov 28 17:01:00 user nova-compute[75246]:     </disk>
Nov 28 17:01:00 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:01:00 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:01:00 user nova-compute[75246]:       <source dev="/dev/sdc"/>
Nov 28 17:01:00 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:01:00 user nova-compute[75246]:       <serial>3fa9362a-51ef-4ae5-8ea5-6001b754eb8c</serial>
Nov 28 17:01:00 user nova-compute[75246]:     </disk>
Nov 28 17:01:00 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:01:00 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:01:00 user nova-compute[75246]:       <source dev="/dev/sdd"/>
Nov 28 17:01:00 user nova-compute[75246]:       <target dev="vdb" bus="virtio"/>
Nov 28 17:01:00 user nova-compute[75246]:       <serial>4a29c9e3-4029-4742-b240-d31c497812d8</serial>
Nov 28 17:01:00 user nova-compute[75246]:     </disk>
Nov 28 17:01:00 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:01:00 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:01:00 user nova-compute[75246]:       <source dev="/dev/sde"/>
Nov 28 17:01:00 user nova-compute[75246]:       <target dev="vdc" bus="virtio"/>
Nov 28 17:01:00 user nova-compute[75246]:       <serial>622aeb5e-70ae-4744-84f3-cb47decd3ac2</serial>
Nov 28 17:01:00 user nova-compute[75246]:     </disk>
Nov 28 17:01:00 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:01:00 user nova-compute[75246]:       <mac address="fa:16:3e:0e:49:2c"/>
Nov 28 17:01:00 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:01:00 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:01:00 user nova-compute[75246]:       <target dev="tap7f38967b-bb"/>
Nov 28 17:01:00 user nova-compute[75246]:     </interface>
Nov 28 17:01:00 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:01:00 user nova-compute[75246]:       <mac address="fa:16:3e:ca:43:c6"/>
Nov 28 17:01:00 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:01:00 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:01:00 user nova-compute[75246]:       <target dev="tap0c207a6f-3e"/>
Nov 28 17:01:00 user nova-compute[75246]:     </interface>
Nov 28 17:01:00 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:01:00 user nova-compute[75246]:       <mac address="fa:16:3e:56:1a:9d"/>
Nov 28 17:01:00 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:01:00 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:01:00 user nova-compute[75246]:       <target dev="tap8f041c8c-a9"/>
Nov 28 17:01:00 user nova-compute[75246]:     </interface>
Nov 28 17:01:00 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:01:00 user nova-compute[75246]:       <mac address="fa:16:3e:05:5e:e3"/>
Nov 28 17:01:00 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:01:00 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:01:00 user nova-compute[75246]:       <target dev="tap53ae7951-da"/>
Nov 28 17:01:00 user nova-compute[75246]:     </interface>
Nov 28 17:01:00 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:01:00 user nova-compute[75246]:       <mac address="fa:16:3e:e6:6e:f2"/>
Nov 28 17:01:00 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:01:00 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:01:00 user nova-compute[75246]:       <target dev="tap1a556d5f-62"/>
Nov 28 17:01:00 user nova-compute[75246]:     </interface>
Nov 28 17:01:00 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:01:00 user nova-compute[75246]:       <mac address="fa:16:3e:a9:3c:06"/>
Nov 28 17:01:00 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:01:00 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:01:00 user nova-compute[75246]:       <target dev="tap56971077-b1"/>
Nov 28 17:01:00 user nova-compute[75246]:     </interface>
Nov 28 17:01:00 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:01:00 user nova-compute[75246]:       <mac address="fa:16:3e:4b:1c:67"/>
Nov 28 17:01:00 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:01:00 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:01:00 user nova-compute[75246]:       <target dev="tapa46959c2-cd"/>
Nov 28 17:01:00 user nova-compute[75246]:     </interface>
Nov 28 17:01:00 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:01:00 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/04c31ea4-faaa-4289-8930-9406865e6705/console.log" append="off"/>
Nov 28 17:01:00 user nova-compute[75246]:     </serial>
Nov 28 17:01:00 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:01:00 user nova-compute[75246]:     <video>
Nov 28 17:01:00 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:01:00 user nova-compute[75246]:     </video>
Nov 28 17:01:00 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:01:00 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:01:00 user nova-compute[75246]:     </rng>
Nov 28 17:01:00 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:01:00 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:01:00 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:01:00 user nova-compute[75246]:     </memballoon>
Nov 28 17:01:00 user nova-compute[75246]:   </devices>
Nov 28 17:01:00 user nova-compute[75246]: </domain>
Nov 28 17:01:00 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f38967b-bb53-4627-ad7f-6324098159a9", "address": "fa:16:3e:0e:49:2c", "network": {"id": "5d735e77-2be9-47ce-bff7-55da5c0432ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1287968723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f38967b-bb", "ovs_interfaceid": "7f38967b-bb53-4627-ad7f-6324098159a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "7f38967b-bb53-4627-ad7f-6324098159a9", "address": "fa:16:3e:0e:49:2c", "network": {"id": "5d735e77-2be9-47ce-bff7-55da5c0432ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1287968723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f38967b-bb", "ovs_interfaceid": "7f38967b-bb53-4627-ad7f-6324098159a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:49:2c,bridge_name='br-int',has_traffic_filtering=True,id=7f38967b-bb53-4627-ad7f-6324098159a9,network=Network(5d735e77-2be9-47ce-bff7-55da5c0432ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f38967b-bb') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG os_vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:49:2c,bridge_name='br-int',has_traffic_filtering=True,id=7f38967b-bb53-4627-ad7f-6324098159a9,network=Network(5d735e77-2be9-47ce-bff7-55da5c0432ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f38967b-bb') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '150b9335-9851-5f4c-a75b-505135416a34', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f38967b-bb, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f38967b-bb, col_values=(('qos', UUID('e9bb388c-6f16-43ac-af55-830dfe0129c4')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f38967b-bb, col_values=(('external_ids', {'iface-id': '7f38967b-bb53-4627-ad7f-6324098159a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:49:2c', 'vm-uuid': '04c31ea4-faaa-4289-8930-9406865e6705'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: INFO os_vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:49:2c,bridge_name='br-int',has_traffic_filtering=True,id=7f38967b-bb53-4627-ad7f-6324098159a9,network=Network(5d735e77-2be9-47ce-bff7-55da5c0432ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f38967b-bb')
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "address": "fa:16:3e:ca:43:c6", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c207a6f-3e", "ovs_interfaceid": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "address": "fa:16:3e:ca:43:c6", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c207a6f-3e", "ovs_interfaceid": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:43:c6,bridge_name='br-int',has_traffic_filtering=True,id=0c207a6f-3e99-4122-8b4b-bf433d46193f,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0c207a6f-3e') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG os_vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:43:c6,bridge_name='br-int',has_traffic_filtering=True,id=0c207a6f-3e99-4122-8b4b-bf433d46193f,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0c207a6f-3e') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e95e47e-1944-5eef-ae6f-0cd42728764a', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c207a6f-3e, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c207a6f-3e, col_values=(('qos', UUID('198809e3-8bd4-40f2-8d04-732726367a80')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c207a6f-3e, col_values=(('external_ids', {'iface-id': '0c207a6f-3e99-4122-8b4b-bf433d46193f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:43:c6', 'vm-uuid': '04c31ea4-faaa-4289-8930-9406865e6705'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: INFO os_vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:43:c6,bridge_name='br-int',has_traffic_filtering=True,id=0c207a6f-3e99-4122-8b4b-bf433d46193f,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0c207a6f-3e')
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "address": "fa:16:3e:56:1a:9d", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f041c8c-a9", "ovs_interfaceid": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "address": "fa:16:3e:56:1a:9d", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f041c8c-a9", "ovs_interfaceid": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:1a:9d,bridge_name='br-int',has_traffic_filtering=True,id=8f041c8c-a943-41bd-8ea1-7629e2635d6c,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8f041c8c-a9') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG os_vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:1a:9d,bridge_name='br-int',has_traffic_filtering=True,id=8f041c8c-a943-41bd-8ea1-7629e2635d6c,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8f041c8c-a9') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ef59279-94ed-5470-ac49-30fdac6c0476', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f041c8c-a9, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f041c8c-a9, col_values=(('qos', UUID('5827f9d4-368c-4a74-9e3e-671778cefc27')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f041c8c-a9, col_values=(('external_ids', {'iface-id': '8f041c8c-a943-41bd-8ea1-7629e2635d6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:1a:9d', 'vm-uuid': '04c31ea4-faaa-4289-8930-9406865e6705'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: INFO os_vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:1a:9d,bridge_name='br-int',has_traffic_filtering=True,id=8f041c8c-a943-41bd-8ea1-7629e2635d6c,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8f041c8c-a9')
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "address": "fa:16:3e:05:5e:e3", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ae7951-da", "ovs_interfaceid": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "address": "fa:16:3e:05:5e:e3", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ae7951-da", "ovs_interfaceid": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:e3,bridge_name='br-int',has_traffic_filtering=True,id=53ae7951-da14-4dcb-bf28-16f035e3d01b,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ae7951-da') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG os_vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:e3,bridge_name='br-int',has_traffic_filtering=True,id=53ae7951-da14-4dcb-bf28-16f035e3d01b,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ae7951-da') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51fd8f7c-7b58-526d-8fa5-e63d517e3428', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53ae7951-da, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53ae7951-da, col_values=(('qos', UUID('098cb838-6912-46cb-9545-9f77c12a0a86')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53ae7951-da, col_values=(('external_ids', {'iface-id': '53ae7951-da14-4dcb-bf28-16f035e3d01b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:5e:e3', 'vm-uuid': '04c31ea4-faaa-4289-8930-9406865e6705'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: INFO os_vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:e3,bridge_name='br-int',has_traffic_filtering=True,id=53ae7951-da14-4dcb-bf28-16f035e3d01b,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ae7951-da')
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "address": "fa:16:3e:e6:6e:f2", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a556d5f-62", "ovs_interfaceid": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "address": "fa:16:3e:e6:6e:f2", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a556d5f-62", "ovs_interfaceid": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:6e:f2,bridge_name='br-int',has_traffic_filtering=True,id=1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a556d5f-62') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG os_vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:6e:f2,bridge_name='br-int',has_traffic_filtering=True,id=1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a556d5f-62') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a30dba7f-d429-5c4c-bb1e-8a959772bd3f', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a556d5f-62, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a556d5f-62, col_values=(('qos', UUID('78a83468-941b-4271-828c-0d661208f4f7')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a556d5f-62, col_values=(('external_ids', {'iface-id': '1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:6e:f2', 'vm-uuid': '04c31ea4-faaa-4289-8930-9406865e6705'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: INFO os_vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:6e:f2,bridge_name='br-int',has_traffic_filtering=True,id=1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a556d5f-62')
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56971077-b127-4c9f-897f-22d420785295", "address": "fa:16:3e:a9:3c:06", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56971077-b1", "ovs_interfaceid": "56971077-b127-4c9f-897f-22d420785295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "56971077-b127-4c9f-897f-22d420785295", "address": "fa:16:3e:a9:3c:06", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56971077-b1", "ovs_interfaceid": "56971077-b127-4c9f-897f-22d420785295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3c:06,bridge_name='br-int',has_traffic_filtering=True,id=56971077-b127-4c9f-897f-22d420785295,network=Network(bb32316c-05ca-45f5-a0a9-b386f0a72f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56971077-b1') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG os_vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3c:06,bridge_name='br-int',has_traffic_filtering=True,id=56971077-b127-4c9f-897f-22d420785295,network=Network(bb32316c-05ca-45f5-a0a9-b386f0a72f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56971077-b1') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72151e31-60ab-584d-bffc-0855e4a5b1c8', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56971077-b1, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56971077-b1, col_values=(('qos', UUID('0194c1d9-8173-420a-9c47-f0b53d206324')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56971077-b1, col_values=(('external_ids', {'iface-id': '56971077-b127-4c9f-897f-22d420785295', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:3c:06', 'vm-uuid': '04c31ea4-faaa-4289-8930-9406865e6705'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: INFO os_vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3c:06,bridge_name='br-int',has_traffic_filtering=True,id=56971077-b127-4c9f-897f-22d420785295,network=Network(bb32316c-05ca-45f5-a0a9-b386f0a72f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56971077-b1')
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a46959c2-cd58-410c-8cdb-054015f1794a", "address": "fa:16:3e:4b:1c:67", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46959c2-cd", "ovs_interfaceid": "a46959c2-cd58-410c-8cdb-054015f1794a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "a46959c2-cd58-410c-8cdb-054015f1794a", "address": "fa:16:3e:4b:1c:67", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46959c2-cd", "ovs_interfaceid": "a46959c2-cd58-410c-8cdb-054015f1794a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:1c:67,bridge_name='br-int',has_traffic_filtering=True,id=a46959c2-cd58-410c-8cdb-054015f1794a,network=Network(bb32316c-05ca-45f5-a0a9-b386f0a72f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46959c2-cd') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG os_vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:1c:67,bridge_name='br-int',has_traffic_filtering=True,id=a46959c2-cd58-410c-8cdb-054015f1794a,network=Network(bb32316c-05ca-45f5-a0a9-b386f0a72f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46959c2-cd') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f957b1e-3680-50d5-92cf-3a7ff157c68c', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa46959c2-cd, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa46959c2-cd, col_values=(('qos', UUID('20f8b40d-1afc-42a4-8904-ef967f4865e5')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa46959c2-cd, col_values=(('external_ids', {'iface-id': 'a46959c2-cd58-410c-8cdb-054015f1794a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:1c:67', 'vm-uuid': '04c31ea4-faaa-4289-8930-9406865e6705'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:00 user nova-compute[75246]: INFO os_vif [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:1c:67,bridge_name='br-int',has_traffic_filtering=True,id=a46959c2-cd58-410c-8cdb-054015f1794a,network=Network(bb32316c-05ca-45f5-a0a9-b386f0a72f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46959c2-cd')
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] No BDM found with device name hda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] No VIF found with MAC fa:16:3e:0e:49:2c, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:01:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] No VIF found with MAC fa:16:3e:e6:6e:f2, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:01:00 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Using config drive
Nov 28 17:01:00 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Creating config drive at /opt/stack/data/nova/instances/04c31ea4-faaa-4289-8930-9406865e6705/disk.config
Nov 28 17:01:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/04c31ea4-faaa-4289-8930-9406865e6705/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpztla_z8a {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/04c31ea4-faaa-4289-8930-9406865e6705/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpztla_z8a" returned: 0 in 0.054s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-10a745f3-4b0e-4ee8-a536-63d716dad4d1 req-0f6f6a09-7bd0-4e4f-bba4-4cb79b17961f service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-7f38967b-bb53-4627-ad7f-6324098159a9 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-10a745f3-4b0e-4ee8-a536-63d716dad4d1 req-0f6f6a09-7bd0-4e4f-bba4-4cb79b17961f service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-10a745f3-4b0e-4ee8-a536-63d716dad4d1 req-0f6f6a09-7bd0-4e4f-bba4-4cb79b17961f service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-10a745f3-4b0e-4ee8-a536-63d716dad4d1 req-0f6f6a09-7bd0-4e4f-bba4-4cb79b17961f service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-10a745f3-4b0e-4ee8-a536-63d716dad4d1 req-0f6f6a09-7bd0-4e4f-bba4-4cb79b17961f service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-7f38967b-bb53-4627-ad7f-6324098159a9 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:02 user nova-compute[75246]: WARNING nova.compute.manager [req-10a745f3-4b0e-4ee8-a536-63d716dad4d1 req-0f6f6a09-7bd0-4e4f-bba4-4cb79b17961f service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-7f38967b-bb53-4627-ad7f-6324098159a9 for instance with vm_state building and task_state spawning.
Nov 28 17:01:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-c54bbfa7-9270-4350-8d09-f0d7a65f9667 req-5a0ab0bf-1885-46ce-8355-d9eea2217476 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-8f041c8c-a943-41bd-8ea1-7629e2635d6c {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c54bbfa7-9270-4350-8d09-f0d7a65f9667 req-5a0ab0bf-1885-46ce-8355-d9eea2217476 service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c54bbfa7-9270-4350-8d09-f0d7a65f9667 req-5a0ab0bf-1885-46ce-8355-d9eea2217476 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c54bbfa7-9270-4350-8d09-f0d7a65f9667 req-5a0ab0bf-1885-46ce-8355-d9eea2217476 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-c54bbfa7-9270-4350-8d09-f0d7a65f9667 req-5a0ab0bf-1885-46ce-8355-d9eea2217476 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-8f041c8c-a943-41bd-8ea1-7629e2635d6c {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:03 user nova-compute[75246]: WARNING nova.compute.manager [req-c54bbfa7-9270-4350-8d09-f0d7a65f9667 req-5a0ab0bf-1885-46ce-8355-d9eea2217476 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-8f041c8c-a943-41bd-8ea1-7629e2635d6c for instance with vm_state building and task_state spawning.
Nov 28 17:01:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-d9f8d910-8ab7-4eb5-a384-50e98a0041b4 req-64c4ec97-7bf8-4b7b-99cd-cff8374d32b0 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-53ae7951-da14-4dcb-bf28-16f035e3d01b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d9f8d910-8ab7-4eb5-a384-50e98a0041b4 req-64c4ec97-7bf8-4b7b-99cd-cff8374d32b0 service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d9f8d910-8ab7-4eb5-a384-50e98a0041b4 req-64c4ec97-7bf8-4b7b-99cd-cff8374d32b0 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d9f8d910-8ab7-4eb5-a384-50e98a0041b4 req-64c4ec97-7bf8-4b7b-99cd-cff8374d32b0 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-d9f8d910-8ab7-4eb5-a384-50e98a0041b4 req-64c4ec97-7bf8-4b7b-99cd-cff8374d32b0 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-53ae7951-da14-4dcb-bf28-16f035e3d01b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:03 user nova-compute[75246]: WARNING nova.compute.manager [req-d9f8d910-8ab7-4eb5-a384-50e98a0041b4 req-64c4ec97-7bf8-4b7b-99cd-cff8374d32b0 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-53ae7951-da14-4dcb-bf28-16f035e3d01b for instance with vm_state building and task_state spawning.
Nov 28 17:01:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-9686ffe6-5db1-4ab7-a5da-777c8fc13b43 req-ca0f5ba3-a3b8-464f-8819-261c34560a9b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-7f38967b-bb53-4627-ad7f-6324098159a9 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9686ffe6-5db1-4ab7-a5da-777c8fc13b43 req-ca0f5ba3-a3b8-464f-8819-261c34560a9b service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9686ffe6-5db1-4ab7-a5da-777c8fc13b43 req-ca0f5ba3-a3b8-464f-8819-261c34560a9b service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9686ffe6-5db1-4ab7-a5da-777c8fc13b43 req-ca0f5ba3-a3b8-464f-8819-261c34560a9b service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-9686ffe6-5db1-4ab7-a5da-777c8fc13b43 req-ca0f5ba3-a3b8-464f-8819-261c34560a9b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-7f38967b-bb53-4627-ad7f-6324098159a9 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:04 user nova-compute[75246]: WARNING nova.compute.manager [req-9686ffe6-5db1-4ab7-a5da-777c8fc13b43 req-ca0f5ba3-a3b8-464f-8819-261c34560a9b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-7f38967b-bb53-4627-ad7f-6324098159a9 for instance with vm_state building and task_state spawning.
Nov 28 17:01:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-9686ffe6-5db1-4ab7-a5da-777c8fc13b43 req-ca0f5ba3-a3b8-464f-8819-261c34560a9b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-0c207a6f-3e99-4122-8b4b-bf433d46193f {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9686ffe6-5db1-4ab7-a5da-777c8fc13b43 req-ca0f5ba3-a3b8-464f-8819-261c34560a9b service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9686ffe6-5db1-4ab7-a5da-777c8fc13b43 req-ca0f5ba3-a3b8-464f-8819-261c34560a9b service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9686ffe6-5db1-4ab7-a5da-777c8fc13b43 req-ca0f5ba3-a3b8-464f-8819-261c34560a9b service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-9686ffe6-5db1-4ab7-a5da-777c8fc13b43 req-ca0f5ba3-a3b8-464f-8819-261c34560a9b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-0c207a6f-3e99-4122-8b4b-bf433d46193f {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:04 user nova-compute[75246]: WARNING nova.compute.manager [req-9686ffe6-5db1-4ab7-a5da-777c8fc13b43 req-ca0f5ba3-a3b8-464f-8819-261c34560a9b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-0c207a6f-3e99-4122-8b4b-bf433d46193f for instance with vm_state building and task_state spawning.
Nov 28 17:01:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-9686ffe6-5db1-4ab7-a5da-777c8fc13b43 req-ca0f5ba3-a3b8-464f-8819-261c34560a9b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-0c207a6f-3e99-4122-8b4b-bf433d46193f {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9686ffe6-5db1-4ab7-a5da-777c8fc13b43 req-ca0f5ba3-a3b8-464f-8819-261c34560a9b service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9686ffe6-5db1-4ab7-a5da-777c8fc13b43 req-ca0f5ba3-a3b8-464f-8819-261c34560a9b service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9686ffe6-5db1-4ab7-a5da-777c8fc13b43 req-ca0f5ba3-a3b8-464f-8819-261c34560a9b service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-9686ffe6-5db1-4ab7-a5da-777c8fc13b43 req-ca0f5ba3-a3b8-464f-8819-261c34560a9b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-0c207a6f-3e99-4122-8b4b-bf433d46193f {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:04 user nova-compute[75246]: WARNING nova.compute.manager [req-9686ffe6-5db1-4ab7-a5da-777c8fc13b43 req-ca0f5ba3-a3b8-464f-8819-261c34560a9b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-0c207a6f-3e99-4122-8b4b-bf433d46193f for instance with vm_state building and task_state spawning.
Nov 28 17:01:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-0f42d4bf-6ee5-4d62-8f23-97c45e4a5833 req-3adf505f-62ac-4021-a0d6-bd225a0bc5b9 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-8f041c8c-a943-41bd-8ea1-7629e2635d6c {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0f42d4bf-6ee5-4d62-8f23-97c45e4a5833 req-3adf505f-62ac-4021-a0d6-bd225a0bc5b9 service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0f42d4bf-6ee5-4d62-8f23-97c45e4a5833 req-3adf505f-62ac-4021-a0d6-bd225a0bc5b9 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0f42d4bf-6ee5-4d62-8f23-97c45e4a5833 req-3adf505f-62ac-4021-a0d6-bd225a0bc5b9 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-0f42d4bf-6ee5-4d62-8f23-97c45e4a5833 req-3adf505f-62ac-4021-a0d6-bd225a0bc5b9 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-8f041c8c-a943-41bd-8ea1-7629e2635d6c {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:05 user nova-compute[75246]: WARNING nova.compute.manager [req-0f42d4bf-6ee5-4d62-8f23-97c45e4a5833 req-3adf505f-62ac-4021-a0d6-bd225a0bc5b9 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-8f041c8c-a943-41bd-8ea1-7629e2635d6c for instance with vm_state building and task_state spawning.
Nov 28 17:01:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-0f42d4bf-6ee5-4d62-8f23-97c45e4a5833 req-3adf505f-62ac-4021-a0d6-bd225a0bc5b9 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-56971077-b127-4c9f-897f-22d420785295 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0f42d4bf-6ee5-4d62-8f23-97c45e4a5833 req-3adf505f-62ac-4021-a0d6-bd225a0bc5b9 service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0f42d4bf-6ee5-4d62-8f23-97c45e4a5833 req-3adf505f-62ac-4021-a0d6-bd225a0bc5b9 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0f42d4bf-6ee5-4d62-8f23-97c45e4a5833 req-3adf505f-62ac-4021-a0d6-bd225a0bc5b9 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-0f42d4bf-6ee5-4d62-8f23-97c45e4a5833 req-3adf505f-62ac-4021-a0d6-bd225a0bc5b9 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-56971077-b127-4c9f-897f-22d420785295 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:05 user nova-compute[75246]: WARNING nova.compute.manager [req-0f42d4bf-6ee5-4d62-8f23-97c45e4a5833 req-3adf505f-62ac-4021-a0d6-bd225a0bc5b9 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-56971077-b127-4c9f-897f-22d420785295 for instance with vm_state building and task_state spawning.
Nov 28 17:01:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-0f42d4bf-6ee5-4d62-8f23-97c45e4a5833 req-3adf505f-62ac-4021-a0d6-bd225a0bc5b9 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-56971077-b127-4c9f-897f-22d420785295 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0f42d4bf-6ee5-4d62-8f23-97c45e4a5833 req-3adf505f-62ac-4021-a0d6-bd225a0bc5b9 service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0f42d4bf-6ee5-4d62-8f23-97c45e4a5833 req-3adf505f-62ac-4021-a0d6-bd225a0bc5b9 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0f42d4bf-6ee5-4d62-8f23-97c45e4a5833 req-3adf505f-62ac-4021-a0d6-bd225a0bc5b9 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-0f42d4bf-6ee5-4d62-8f23-97c45e4a5833 req-3adf505f-62ac-4021-a0d6-bd225a0bc5b9 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-56971077-b127-4c9f-897f-22d420785295 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:05 user nova-compute[75246]: WARNING nova.compute.manager [req-0f42d4bf-6ee5-4d62-8f23-97c45e4a5833 req-3adf505f-62ac-4021-a0d6-bd225a0bc5b9 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-56971077-b127-4c9f-897f-22d420785295 for instance with vm_state building and task_state spawning.
Nov 28 17:01:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-53ae7951-da14-4dcb-bf28-16f035e3d01b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-53ae7951-da14-4dcb-bf28-16f035e3d01b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:05 user nova-compute[75246]: WARNING nova.compute.manager [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-53ae7951-da14-4dcb-bf28-16f035e3d01b for instance with vm_state building and task_state spawning.
Nov 28 17:01:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:05 user nova-compute[75246]: WARNING nova.compute.manager [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1 for instance with vm_state building and task_state spawning.
Nov 28 17:01:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:05 user nova-compute[75246]: WARNING nova.compute.manager [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1 for instance with vm_state building and task_state spawning.
Nov 28 17:01:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-a46959c2-cd58-410c-8cdb-054015f1794a {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-a46959c2-cd58-410c-8cdb-054015f1794a {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:05 user nova-compute[75246]: WARNING nova.compute.manager [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-a46959c2-cd58-410c-8cdb-054015f1794a for instance with vm_state building and task_state spawning.
Nov 28 17:01:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-a46959c2-cd58-410c-8cdb-054015f1794a {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-a46959c2-cd58-410c-8cdb-054015f1794a {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:05 user nova-compute[75246]: WARNING nova.compute.manager [req-fb76be45-aeb7-40c3-b6e8-14cc425dfd06 req-d57228ed-841a-45e3-a37a-50a0b2f37a1d service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-a46959c2-cd58-410c-8cdb-054015f1794a for instance with vm_state building and task_state spawning.
Nov 28 17:01:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:01:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:01:07 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Instance spawned successfully.
Nov 28 17:01:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:01:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:01:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:01:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:01:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:01:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:01:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:01:07 user nova-compute[75246]: INFO nova.compute.manager [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Took 11.71 seconds to spawn the instance on the hypervisor.
Nov 28 17:01:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:01:07 user nova-compute[75246]: INFO nova.compute.manager [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Took 38.29 seconds to build instance.
Nov 28 17:01:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-935d3384-7ce3-4729-a2fc-f6fe379600dd tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "04c31ea4-faaa-4289-8930-9406865e6705" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.415s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:01:17 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:01:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "1358a444-8765-4863-a9b6-9b0e53eaff51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "1358a444-8765-4863-a9b6-9b0e53eaff51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:01:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:01:18 user nova-compute[75246]: INFO nova.compute.claims [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Claim successful on node user
Nov 28 17:01:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:01:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:01:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:01:19 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:01:19 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:01:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:19 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:01:19 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:01:19 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:01:19 user nova-compute[75246]: DEBUG nova.policy [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed5bb6d3f84b4c90990c68ed1d55b1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde1b5b56914297ab276a983b4dd56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:01:19 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:01:19 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:01:19 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:01:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:01:19 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Creating image(s)
Nov 28 17:01:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "/opt/stack/data/nova/instances/1358a444-8765-4863-a9b6-9b0e53eaff51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "/opt/stack/data/nova/instances/1358a444-8765-4863-a9b6-9b0e53eaff51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "/opt/stack/data/nova/instances/1358a444-8765-4863-a9b6-9b0e53eaff51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:19 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:01:19 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:01:19 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Successfully created port: 9cc4adc2-b744-448d-9393-c659ed3e33dd {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.404s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.224s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/1358a444-8765-4863-a9b6-9b0e53eaff51/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/1358a444-8765-4863-a9b6-9b0e53eaff51/disk 1073741824" returned: 0 in 0.090s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.199s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1358a444-8765-4863-a9b6-9b0e53eaff51/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1358a444-8765-4863-a9b6-9b0e53eaff51/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1358a444-8765-4863-a9b6-9b0e53eaff51/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Cannot resize image /opt/stack/data/nova/instances/1358a444-8765-4863-a9b6-9b0e53eaff51/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Ensure instance console log exists: /opt/stack/data/nova/instances/1358a444-8765-4863-a9b6-9b0e53eaff51/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:20 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Updating instance_info_cache with network_info: [{"id": "459bf491-d464-42b1-be6c-282af882a38d", "address": "fa:16:3e:4f:20:c2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459bf491-d4", "ovs_interfaceid": "459bf491-d464-42b1-be6c-282af882a38d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Successfully updated port: 9cc4adc2-b744-448d-9393-c659ed3e33dd {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "refresh_cache-1358a444-8765-4863-a9b6-9b0e53eaff51" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquired lock "refresh_cache-1358a444-8765-4863-a9b6-9b0e53eaff51" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.compute.manager [req-1dbe4668-6fe9-49c8-bf6e-935daad768da req-316e55a0-c5fd-487d-8a3c-d2b0c24f3fb9 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Received event network-changed-9cc4adc2-b744-448d-9393-c659ed3e33dd {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.compute.manager [req-1dbe4668-6fe9-49c8-bf6e-935daad768da req-316e55a0-c5fd-487d-8a3c-d2b0c24f3fb9 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Refreshing instance network info cache due to event network-changed-9cc4adc2-b744-448d-9393-c659ed3e33dd. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1dbe4668-6fe9-49c8-bf6e-935daad768da req-316e55a0-c5fd-487d-8a3c-d2b0c24f3fb9 service nova] Acquiring lock "refresh_cache-1358a444-8765-4863-a9b6-9b0e53eaff51" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Updating instance_info_cache with network_info: [{"id": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "address": "fa:16:3e:00:60:8d", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc4adc2-b7", "ovs_interfaceid": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Releasing lock "refresh_cache-1358a444-8765-4863-a9b6-9b0e53eaff51" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Instance network_info: |[{"id": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "address": "fa:16:3e:00:60:8d", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc4adc2-b7", "ovs_interfaceid": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1dbe4668-6fe9-49c8-bf6e-935daad768da req-316e55a0-c5fd-487d-8a3c-d2b0c24f3fb9 service nova] Acquired lock "refresh_cache-1358a444-8765-4863-a9b6-9b0e53eaff51" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.network.neutron [req-1dbe4668-6fe9-49c8-bf6e-935daad768da req-316e55a0-c5fd-487d-8a3c-d2b0c24f3fb9 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Refreshing network info cache for port 9cc4adc2-b744-448d-9393-c659ed3e33dd {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Start _get_guest_xml network_info=[{"id": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "address": "fa:16:3e:00:60:8d", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc4adc2-b7", "ovs_interfaceid": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:01:21 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:01:21 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-439501669',display_name='tempest-ServersNegativeTestJSON-server-439501669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-439501669',id=12,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbde1b5b56914297ab276a983b4dd56b',ramdisk_id='',reservation_id='r-ud0p2c3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-368898789',owner_user_name='tempest-ServersNegativeTestJSON-368898789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:01:20Z,user_data=None,user_id='ed5bb6d3f84b4c90990c68ed1d55b1c0',uuid=1358a444-8765-4863-a9b6-9b0e53eaff51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "address": "fa:16:3e:00:60:8d", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc4adc2-b7", "ovs_interfaceid": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Converting VIF {"id": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "address": "fa:16:3e:00:60:8d", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc4adc2-b7", "ovs_interfaceid": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:60:8d,bridge_name='br-int',has_traffic_filtering=True,id=9cc4adc2-b744-448d-9393-c659ed3e33dd,network=Network(75d646d7-52d6-4455-8014-0381aa33c56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cc4adc2-b7') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.objects.instance [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lazy-loading 'pci_devices' on Instance uuid 1358a444-8765-4863-a9b6-9b0e53eaff51 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:01:21 user nova-compute[75246]:   <uuid>1358a444-8765-4863-a9b6-9b0e53eaff51</uuid>
Nov 28 17:01:21 user nova-compute[75246]:   <name>instance-0000000c</name>
Nov 28 17:01:21 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:01:21 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:01:21 user nova-compute[75246]:   <metadata>
Nov 28 17:01:21 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:01:21 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:01:21 user nova-compute[75246]:       <nova:name>tempest-ServersNegativeTestJSON-server-439501669</nova:name>
Nov 28 17:01:21 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:01:21</nova:creationTime>
Nov 28 17:01:21 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:01:21 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:01:21 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:01:21 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:01:21 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:01:21 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:01:21 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:01:21 user nova-compute[75246]:       <nova:owner>
Nov 28 17:01:21 user nova-compute[75246]:         <nova:user uuid="ed5bb6d3f84b4c90990c68ed1d55b1c0">tempest-ServersNegativeTestJSON-368898789-project-member</nova:user>
Nov 28 17:01:21 user nova-compute[75246]:         <nova:project uuid="bbde1b5b56914297ab276a983b4dd56b">tempest-ServersNegativeTestJSON-368898789</nova:project>
Nov 28 17:01:21 user nova-compute[75246]:       </nova:owner>
Nov 28 17:01:21 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:01:21 user nova-compute[75246]:       <nova:ports>
Nov 28 17:01:21 user nova-compute[75246]:         <nova:port uuid="9cc4adc2-b744-448d-9393-c659ed3e33dd">
Nov 28 17:01:21 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 17:01:21 user nova-compute[75246]:         </nova:port>
Nov 28 17:01:21 user nova-compute[75246]:       </nova:ports>
Nov 28 17:01:21 user nova-compute[75246]:     </nova:instance>
Nov 28 17:01:21 user nova-compute[75246]:   </metadata>
Nov 28 17:01:21 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:01:21 user nova-compute[75246]:     <system>
Nov 28 17:01:21 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:01:21 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:01:21 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:01:21 user nova-compute[75246]:       <entry name="serial">1358a444-8765-4863-a9b6-9b0e53eaff51</entry>
Nov 28 17:01:21 user nova-compute[75246]:       <entry name="uuid">1358a444-8765-4863-a9b6-9b0e53eaff51</entry>
Nov 28 17:01:21 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:01:21 user nova-compute[75246]:     </system>
Nov 28 17:01:21 user nova-compute[75246]:   </sysinfo>
Nov 28 17:01:21 user nova-compute[75246]:   <os>
Nov 28 17:01:21 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:01:21 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:01:21 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:01:21 user nova-compute[75246]:   </os>
Nov 28 17:01:21 user nova-compute[75246]:   <features>
Nov 28 17:01:21 user nova-compute[75246]:     <acpi/>
Nov 28 17:01:21 user nova-compute[75246]:     <apic/>
Nov 28 17:01:21 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:01:21 user nova-compute[75246]:   </features>
Nov 28 17:01:21 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:01:21 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:01:21 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:01:21 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:01:21 user nova-compute[75246]:   </clock>
Nov 28 17:01:21 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:01:21 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:01:21 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:01:21 user nova-compute[75246]:   </cpu>
Nov 28 17:01:21 user nova-compute[75246]:   <devices>
Nov 28 17:01:21 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:01:21 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:01:21 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/1358a444-8765-4863-a9b6-9b0e53eaff51/disk"/>
Nov 28 17:01:21 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:01:21 user nova-compute[75246]:     </disk>
Nov 28 17:01:21 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:01:21 user nova-compute[75246]:       <mac address="fa:16:3e:00:60:8d"/>
Nov 28 17:01:21 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:01:21 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:01:21 user nova-compute[75246]:       <target dev="tap9cc4adc2-b7"/>
Nov 28 17:01:21 user nova-compute[75246]:     </interface>
Nov 28 17:01:21 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:01:21 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/1358a444-8765-4863-a9b6-9b0e53eaff51/console.log" append="off"/>
Nov 28 17:01:21 user nova-compute[75246]:     </serial>
Nov 28 17:01:21 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:01:21 user nova-compute[75246]:     <video>
Nov 28 17:01:21 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:01:21 user nova-compute[75246]:     </video>
Nov 28 17:01:21 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:01:21 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:01:21 user nova-compute[75246]:     </rng>
Nov 28 17:01:21 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:01:21 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:01:21 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:01:21 user nova-compute[75246]:     </memballoon>
Nov 28 17:01:21 user nova-compute[75246]:   </devices>
Nov 28 17:01:21 user nova-compute[75246]: </domain>
Nov 28 17:01:21 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-439501669',display_name='tempest-ServersNegativeTestJSON-server-439501669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-439501669',id=12,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbde1b5b56914297ab276a983b4dd56b',ramdisk_id='',reservation_id='r-ud0p2c3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-368898789',owner_user_name='tempest-ServersNegativeTestJSON-368898789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:01:20Z,user_data=None,user_id='ed5bb6d3f84b4c90990c68ed1d55b1c0',uuid=1358a444-8765-4863-a9b6-9b0e53eaff51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "address": "fa:16:3e:00:60:8d", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc4adc2-b7", "ovs_interfaceid": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Converting VIF {"id": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "address": "fa:16:3e:00:60:8d", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc4adc2-b7", "ovs_interfaceid": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:60:8d,bridge_name='br-int',has_traffic_filtering=True,id=9cc4adc2-b744-448d-9393-c659ed3e33dd,network=Network(75d646d7-52d6-4455-8014-0381aa33c56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cc4adc2-b7') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG os_vif [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:60:8d,bridge_name='br-int',has_traffic_filtering=True,id=9cc4adc2-b744-448d-9393-c659ed3e33dd,network=Network(75d646d7-52d6-4455-8014-0381aa33c56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cc4adc2-b7') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17fda6bd-1716-5cb8-a540-51f5877a6e76', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cc4adc2-b7, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9cc4adc2-b7, col_values=(('qos', UUID('0b8ff953-13c7-4ea6-9909-761f936ed49d')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9cc4adc2-b7, col_values=(('external_ids', {'iface-id': '9cc4adc2-b744-448d-9393-c659ed3e33dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:60:8d', 'vm-uuid': '1358a444-8765-4863-a9b6-9b0e53eaff51'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:21 user nova-compute[75246]: INFO os_vif [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:60:8d,bridge_name='br-int',has_traffic_filtering=True,id=9cc4adc2-b744-448d-9393-c659ed3e33dd,network=Network(75d646d7-52d6-4455-8014-0381aa33c56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cc4adc2-b7')
Nov 28 17:01:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] No VIF found with MAC fa:16:3e:00:60:8d, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:22 user nova-compute[75246]: DEBUG nova.network.neutron [req-1dbe4668-6fe9-49c8-bf6e-935daad768da req-316e55a0-c5fd-487d-8a3c-d2b0c24f3fb9 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Updated VIF entry in instance network info cache for port 9cc4adc2-b744-448d-9393-c659ed3e33dd. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:01:22 user nova-compute[75246]: DEBUG nova.network.neutron [req-1dbe4668-6fe9-49c8-bf6e-935daad768da req-316e55a0-c5fd-487d-8a3c-d2b0c24f3fb9 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Updating instance_info_cache with network_info: [{"id": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "address": "fa:16:3e:00:60:8d", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc4adc2-b7", "ovs_interfaceid": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:01:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1dbe4668-6fe9-49c8-bf6e-935daad768da req-316e55a0-c5fd-487d-8a3c-d2b0c24f3fb9 service nova] Releasing lock "refresh_cache-1358a444-8765-4863-a9b6-9b0e53eaff51" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:01:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-01edf05b-451b-4a71-8fdb-6df161b53d32 req-48131ef8-2d43-4651-90a2-e6721bedce16 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Received event network-changed-459bf491-d464-42b1-be6c-282af882a38d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-01edf05b-451b-4a71-8fdb-6df161b53d32 req-48131ef8-2d43-4651-90a2-e6721bedce16 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Refreshing instance network info cache due to event network-changed-459bf491-d464-42b1-be6c-282af882a38d. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:01:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-01edf05b-451b-4a71-8fdb-6df161b53d32 req-48131ef8-2d43-4651-90a2-e6721bedce16 service nova] Acquiring lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:01:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-01edf05b-451b-4a71-8fdb-6df161b53d32 req-48131ef8-2d43-4651-90a2-e6721bedce16 service nova] Acquired lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:01:23 user nova-compute[75246]: DEBUG nova.network.neutron [req-01edf05b-451b-4a71-8fdb-6df161b53d32 req-48131ef8-2d43-4651-90a2-e6721bedce16 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Refreshing network info cache for port 459bf491-d464-42b1-be6c-282af882a38d {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:01:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:23 user nova-compute[75246]: DEBUG nova.network.neutron [req-01edf05b-451b-4a71-8fdb-6df161b53d32 req-48131ef8-2d43-4651-90a2-e6721bedce16 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Updated VIF entry in instance network info cache for port 459bf491-d464-42b1-be6c-282af882a38d. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:01:23 user nova-compute[75246]: DEBUG nova.network.neutron [req-01edf05b-451b-4a71-8fdb-6df161b53d32 req-48131ef8-2d43-4651-90a2-e6721bedce16 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Updating instance_info_cache with network_info: [{"id": "459bf491-d464-42b1-be6c-282af882a38d", "address": "fa:16:3e:4f:20:c2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459bf491-d4", "ovs_interfaceid": "459bf491-d464-42b1-be6c-282af882a38d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:01:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-01edf05b-451b-4a71-8fdb-6df161b53d32 req-48131ef8-2d43-4651-90a2-e6721bedce16 service nova] Releasing lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:01:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk --force-share --output=json" returned: 0 in 0.339s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:24 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:01:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:24 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:01:24 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:01:24 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:01:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-8f23993f-512f-4662-9505-ae19b9ea7b89 req-02cd639d-6a11-4d0d-9104-e081935c8c85 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Received event network-vif-plugged-9cc4adc2-b744-448d-9393-c659ed3e33dd {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8f23993f-512f-4662-9505-ae19b9ea7b89 req-02cd639d-6a11-4d0d-9104-e081935c8c85 service nova] Acquiring lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8f23993f-512f-4662-9505-ae19b9ea7b89 req-02cd639d-6a11-4d0d-9104-e081935c8c85 service nova] Lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8f23993f-512f-4662-9505-ae19b9ea7b89 req-02cd639d-6a11-4d0d-9104-e081935c8c85 service nova] Lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-8f23993f-512f-4662-9505-ae19b9ea7b89 req-02cd639d-6a11-4d0d-9104-e081935c8c85 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] No waiting events found dispatching network-vif-plugged-9cc4adc2-b744-448d-9393-c659ed3e33dd {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:25 user nova-compute[75246]: WARNING nova.compute.manager [req-8f23993f-512f-4662-9505-ae19b9ea7b89 req-02cd639d-6a11-4d0d-9104-e081935c8c85 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Received unexpected event network-vif-plugged-9cc4adc2-b744-448d-9393-c659ed3e33dd for instance with vm_state building and task_state spawning.
Nov 28 17:01:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-8f23993f-512f-4662-9505-ae19b9ea7b89 req-02cd639d-6a11-4d0d-9104-e081935c8c85 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Received event network-vif-plugged-9cc4adc2-b744-448d-9393-c659ed3e33dd {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8f23993f-512f-4662-9505-ae19b9ea7b89 req-02cd639d-6a11-4d0d-9104-e081935c8c85 service nova] Acquiring lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8f23993f-512f-4662-9505-ae19b9ea7b89 req-02cd639d-6a11-4d0d-9104-e081935c8c85 service nova] Lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8f23993f-512f-4662-9505-ae19b9ea7b89 req-02cd639d-6a11-4d0d-9104-e081935c8c85 service nova] Lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-8f23993f-512f-4662-9505-ae19b9ea7b89 req-02cd639d-6a11-4d0d-9104-e081935c8c85 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] No waiting events found dispatching network-vif-plugged-9cc4adc2-b744-448d-9393-c659ed3e33dd {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:25 user nova-compute[75246]: WARNING nova.compute.manager [req-8f23993f-512f-4662-9505-ae19b9ea7b89 req-02cd639d-6a11-4d0d-9104-e081935c8c85 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Received unexpected event network-vif-plugged-9cc4adc2-b744-448d-9393-c659ed3e33dd for instance with vm_state building and task_state spawning.
Nov 28 17:01:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.manager [req-24f8105f-d9ba-4eed-8705-1a49791fd5c6 req-9a75a8e5-c891-4deb-b45b-96ff7ca9b486 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received event network-changed-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.manager [req-24f8105f-d9ba-4eed-8705-1a49791fd5c6 req-9a75a8e5-c891-4deb-b45b-96ff7ca9b486 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Refreshing instance network info cache due to event network-changed-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-24f8105f-d9ba-4eed-8705-1a49791fd5c6 req-9a75a8e5-c891-4deb-b45b-96ff7ca9b486 service nova] Acquiring lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-24f8105f-d9ba-4eed-8705-1a49791fd5c6 req-9a75a8e5-c891-4deb-b45b-96ff7ca9b486 service nova] Acquired lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.network.neutron [req-24f8105f-d9ba-4eed-8705-1a49791fd5c6 req-9a75a8e5-c891-4deb-b45b-96ff7ca9b486 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Refreshing network info cache for port 3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:01:27 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Instance spawned successfully.
Nov 28 17:01:27 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:01:27 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=6855MB free_disk=25.633689880371094GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:01:27 user nova-compute[75246]: INFO nova.compute.manager [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Took 7.82 seconds to spawn the instance on the hypervisor.
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 25480185-8c9c-4aad-9c46-573cfbf65364 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e1266470-c182-4c0c-a575-4c5043f54745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 4b650a57-5870-4f77-bca2-abe50d970b40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 915bc61e-eaea-40c0-a5ed-4d2a677477f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance f6fe7bf7-782c-4660-9612-101c9f277903 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e0df8b51-bda3-4c45-ab54-c6097f6136ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a3fe15c9-36ab-404e-876e-e6241cca05f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 24d45b28-61df-43cb-bdae-f8ce6b3aaca3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 9f306608-7716-41e0-9aa0-afa8ba173a04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 04c31ea4-faaa-4289-8930-9406865e6705 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance cd47c12d-05fd-4942-ac19-f3283c90db8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 1358a444-8765-4863-a9b6-9b0e53eaff51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:01:27 user nova-compute[75246]: INFO nova.compute.manager [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Took 8.92 seconds to build instance.
Nov 28 17:01:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c221a40a-777d-47c9-9ae3-8b95221425a6 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "1358a444-8765-4863-a9b6-9b0e53eaff51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.030s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.network.neutron [req-24f8105f-d9ba-4eed-8705-1a49791fd5c6 req-9a75a8e5-c891-4deb-b45b-96ff7ca9b486 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Updated VIF entry in instance network info cache for port 3b26f892-a21c-4c9f-b4f2-627ed62fb2c0. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.network.neutron [req-24f8105f-d9ba-4eed-8705-1a49791fd5c6 req-9a75a8e5-c891-4deb-b45b-96ff7ca9b486 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Updating instance_info_cache with network_info: [{"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.759s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-24f8105f-d9ba-4eed-8705-1a49791fd5c6 req-9a75a8e5-c891-4deb-b45b-96ff7ca9b486 service nova] Releasing lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:01:29 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:01:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "69f05219-5034-4e88-879c-9c567e2c2fcd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:37 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:01:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:37 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:01:37 user nova-compute[75246]: INFO nova.compute.claims [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Claim successful on node user
Nov 28 17:01:38 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.854s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG nova.network.neutron [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:01:38 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:01:38 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG nova.policy [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58d26618e4064fedb1bd65d14920652d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572ea174564b4afdbf607e501e025fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:01:38 user nova-compute[75246]: INFO nova.virt.block_device [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Booting with volume 73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 at /dev/vda
Nov 28 17:01:38 user nova-compute[75246]: DEBUG os_brick.utils [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c84130-3c81-442d-a9fc-016858c7b0bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa678c7-7aa1-4653-9f69-1b9aed7e5380]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a424c8-f649-419b-bd46-d829059088de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[352afda6-72d5-4eae-a6d6-1d9994a57464]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:01:38 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:01:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0487eaf4-ea7c-4ce3-8a8f-bdc3013ea57b]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG os_brick.utils [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:01:38 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Updating existing volume attachment record: 9e10a23d-24b4-4706-a982-5d30f307b1d6 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:01:39 user nova-compute[75246]: DEBUG nova.network.neutron [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Successfully created port: 068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:01:39 user nova-compute[75246]: DEBUG nova.compute.manager [req-40867b23-880d-4a91-b4ab-3415552b1c1c req-73311ac9-5d4a-46bb-a0c1-cbc0c02b66bc service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Received event network-changed-40798d97-9143-4283-90ba-2bf3f34c1f51 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:39 user nova-compute[75246]: DEBUG nova.compute.manager [req-40867b23-880d-4a91-b4ab-3415552b1c1c req-73311ac9-5d4a-46bb-a0c1-cbc0c02b66bc service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Refreshing instance network info cache due to event network-changed-40798d97-9143-4283-90ba-2bf3f34c1f51. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:01:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-40867b23-880d-4a91-b4ab-3415552b1c1c req-73311ac9-5d4a-46bb-a0c1-cbc0c02b66bc service nova] Acquiring lock "refresh_cache-915bc61e-eaea-40c0-a5ed-4d2a677477f8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:01:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-40867b23-880d-4a91-b4ab-3415552b1c1c req-73311ac9-5d4a-46bb-a0c1-cbc0c02b66bc service nova] Acquired lock "refresh_cache-915bc61e-eaea-40c0-a5ed-4d2a677477f8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:01:39 user nova-compute[75246]: DEBUG nova.network.neutron [req-40867b23-880d-4a91-b4ab-3415552b1c1c req-73311ac9-5d4a-46bb-a0c1-cbc0c02b66bc service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Refreshing network info cache for port 40798d97-9143-4283-90ba-2bf3f34c1f51 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:01:39 user nova-compute[75246]: DEBUG nova.network.neutron [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Successfully updated port: 068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:01:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:01:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquired lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:01:39 user nova-compute[75246]: DEBUG nova.network.neutron [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:01:39 user nova-compute[75246]: DEBUG nova.compute.manager [req-cfa09bb0-394f-4281-b362-297e81efaf5a req-789f6e77-4684-428d-ad33-93e26954394c service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-changed-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:39 user nova-compute[75246]: DEBUG nova.compute.manager [req-cfa09bb0-394f-4281-b362-297e81efaf5a req-789f6e77-4684-428d-ad33-93e26954394c service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Refreshing instance network info cache due to event network-changed-068da4fa-d42e-47e8-8e7e-81bda7521356. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:01:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cfa09bb0-394f-4281-b362-297e81efaf5a req-789f6e77-4684-428d-ad33-93e26954394c service nova] Acquiring lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:01:39 user nova-compute[75246]: DEBUG nova.network.neutron [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:01:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:40 user nova-compute[75246]: DEBUG nova.network.neutron [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Updating instance_info_cache with network_info: [{"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:01:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Releasing lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:01:40 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Instance network_info: |[{"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:01:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cfa09bb0-394f-4281-b362-297e81efaf5a req-789f6e77-4684-428d-ad33-93e26954394c service nova] Acquired lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:01:40 user nova-compute[75246]: DEBUG nova.network.neutron [req-cfa09bb0-394f-4281-b362-297e81efaf5a req-789f6e77-4684-428d-ad33-93e26954394c service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Refreshing network info cache for port 068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:01:40 user nova-compute[75246]: DEBUG nova.network.neutron [req-40867b23-880d-4a91-b4ab-3415552b1c1c req-73311ac9-5d4a-46bb-a0c1-cbc0c02b66bc service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Updated VIF entry in instance network info cache for port 40798d97-9143-4283-90ba-2bf3f34c1f51. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:01:40 user nova-compute[75246]: DEBUG nova.network.neutron [req-40867b23-880d-4a91-b4ab-3415552b1c1c req-73311ac9-5d4a-46bb-a0c1-cbc0c02b66bc service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Updating instance_info_cache with network_info: [{"id": "40798d97-9143-4283-90ba-2bf3f34c1f51", "address": "fa:16:3e:14:c6:95", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40798d97-91", "ovs_interfaceid": "40798d97-9143-4283-90ba-2bf3f34c1f51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:01:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-40867b23-880d-4a91-b4ab-3415552b1c1c req-73311ac9-5d4a-46bb-a0c1-cbc0c02b66bc service nova] Releasing lock "refresh_cache-915bc61e-eaea-40c0-a5ed-4d2a677477f8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:01:40 user nova-compute[75246]: DEBUG nova.network.neutron [req-cfa09bb0-394f-4281-b362-297e81efaf5a req-789f6e77-4684-428d-ad33-93e26954394c service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Updated VIF entry in instance network info cache for port 068da4fa-d42e-47e8-8e7e-81bda7521356. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:01:40 user nova-compute[75246]: DEBUG nova.network.neutron [req-cfa09bb0-394f-4281-b362-297e81efaf5a req-789f6e77-4684-428d-ad33-93e26954394c service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Updating instance_info_cache with network_info: [{"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:01:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cfa09bb0-394f-4281-b362-297e81efaf5a req-789f6e77-4684-428d-ad33-93e26954394c service nova] Releasing lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG nova.objects.instance [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lazy-loading 'flavor' on Instance uuid 915bc61e-eaea-40c0-a5ed-4d2a677477f8 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:42 user nova-compute[75246]: INFO nova.compute.manager [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Attaching volume bae0827b-8788-4aa7-9b54-ef14d23d886a to /dev/vdb
Nov 28 17:01:42 user nova-compute[75246]: DEBUG os_brick.utils [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7567505-7d6b-4603-b3de-cca9fd00274f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b640bdff-d66e-46f6-8232-75671369f686]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[796ef81f-1e63-483e-9832-29bcbae5aaa4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d376e73b-1075-44d7-9a6c-f2c307c2f45c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:01:42 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:01:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e266de8-c80d-4f3f-8931-e5436fa25afe]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG os_brick.utils [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:01:42 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Updating existing volume attachment record: 0eaeb485-5813-4f71-a8e3-7d952feaac68 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:01:43 user nova-compute[75246]: DEBUG nova.compute.manager [req-4e9ea410-fdd3-4970-b307-d05ceadefc29 req-4c6eed3d-04b5-4f6d-878a-f25df341ab5e service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Received event network-changed-5fe78c0a-025c-4ce0-b370-83959a0e2df7 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:43 user nova-compute[75246]: DEBUG nova.compute.manager [req-4e9ea410-fdd3-4970-b307-d05ceadefc29 req-4c6eed3d-04b5-4f6d-878a-f25df341ab5e service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Refreshing instance network info cache due to event network-changed-5fe78c0a-025c-4ce0-b370-83959a0e2df7. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:01:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4e9ea410-fdd3-4970-b307-d05ceadefc29 req-4c6eed3d-04b5-4f6d-878a-f25df341ab5e service nova] Acquiring lock "refresh_cache-f6fe7bf7-782c-4660-9612-101c9f277903" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:01:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4e9ea410-fdd3-4970-b307-d05ceadefc29 req-4c6eed3d-04b5-4f6d-878a-f25df341ab5e service nova] Acquired lock "refresh_cache-f6fe7bf7-782c-4660-9612-101c9f277903" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:01:43 user nova-compute[75246]: DEBUG nova.network.neutron [req-4e9ea410-fdd3-4970-b307-d05ceadefc29 req-4c6eed3d-04b5-4f6d-878a-f25df341ab5e service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Refreshing network info cache for port 5fe78c0a-025c-4ce0-b370-83959a0e2df7 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:01:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Acquiring lock "f6fe7bf7-782c-4660-9612-101c9f277903" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "f6fe7bf7-782c-4660-9612-101c9f277903" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:43 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lazy-loading 'flavor' on Instance uuid f6fe7bf7-782c-4660-9612-101c9f277903 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:01:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "f6fe7bf7-782c-4660-9612-101c9f277903" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Acquiring lock "f6fe7bf7-782c-4660-9612-101c9f277903" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "f6fe7bf7-782c-4660-9612-101c9f277903" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:43 user nova-compute[75246]: INFO nova.compute.manager [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Attaching volume b396e853-b227-4072-b566-bc9dc97a0047 to /dev/vdb
Nov 28 17:01:44 user nova-compute[75246]: DEBUG nova.network.neutron [req-4e9ea410-fdd3-4970-b307-d05ceadefc29 req-4c6eed3d-04b5-4f6d-878a-f25df341ab5e service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Updated VIF entry in instance network info cache for port 5fe78c0a-025c-4ce0-b370-83959a0e2df7. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG nova.network.neutron [req-4e9ea410-fdd3-4970-b307-d05ceadefc29 req-4c6eed3d-04b5-4f6d-878a-f25df341ab5e service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Updating instance_info_cache with network_info: [{"id": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "address": "fa:16:3e:d6:6b:75", "network": {"id": "d5b830a2-9940-49dc-947f-accb65b0f73a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1793539391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710057a2ce0441d3a6d78aab651ee091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe78c0a-02", "ovs_interfaceid": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG os_brick.utils [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4e9ea410-fdd3-4970-b307-d05ceadefc29 req-4c6eed3d-04b5-4f6d-878a-f25df341ab5e service nova] Releasing lock "refresh_cache-f6fe7bf7-782c-4660-9612-101c9f277903" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[59293f86-077e-421f-b835-a7268f461c96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad2df8c-492c-4cad-9ed6-887647bef777]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdb1225-7326-4998-b307-3e10fabc6200]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ed643c-6c1d-46a8-a821-72a78919a4a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:01:44 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:01:44 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6451c2-0c76-479f-a34c-fca1c39fcdf8]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG os_brick.utils [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:01:44 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Updating existing volume attachment record: 639f4421-03ba-4436-8cbe-a069dd4b28fe {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:01:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3612adb-bf1b-4334-b753-8513bcc6fd84 req-2e91daeb-a479-4843-8f36-d56b01cc33c4 service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Received event network-changed-26780137-c1a5-41f0-9c41-e2b2cf450405 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3612adb-bf1b-4334-b753-8513bcc6fd84 req-2e91daeb-a479-4843-8f36-d56b01cc33c4 service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Refreshing instance network info cache due to event network-changed-26780137-c1a5-41f0-9c41-e2b2cf450405. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:01:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3612adb-bf1b-4334-b753-8513bcc6fd84 req-2e91daeb-a479-4843-8f36-d56b01cc33c4 service nova] Acquiring lock "refresh_cache-e0df8b51-bda3-4c45-ab54-c6097f6136ad" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:01:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3612adb-bf1b-4334-b753-8513bcc6fd84 req-2e91daeb-a479-4843-8f36-d56b01cc33c4 service nova] Acquired lock "refresh_cache-e0df8b51-bda3-4c45-ab54-c6097f6136ad" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:01:45 user nova-compute[75246]: DEBUG nova.network.neutron [req-f3612adb-bf1b-4334-b753-8513bcc6fd84 req-2e91daeb-a479-4843-8f36-d56b01cc33c4 service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Refreshing network info cache for port 26780137-c1a5-41f0-9c41-e2b2cf450405 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-f3612adb-bf1b-4334-b753-8513bcc6fd84 req-2e91daeb-a479-4843-8f36-d56b01cc33c4 service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Updated VIF entry in instance network info cache for port 26780137-c1a5-41f0-9c41-e2b2cf450405. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-f3612adb-bf1b-4334-b753-8513bcc6fd84 req-2e91daeb-a479-4843-8f36-d56b01cc33c4 service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Updating instance_info_cache with network_info: [{"id": "26780137-c1a5-41f0-9c41-e2b2cf450405", "address": "fa:16:3e:b2:ec:27", "network": {"id": "a530cf40-41ff-4ed1-8b02-264d7b7830c8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-656328324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8690f10b04e44af49d2a459f88573ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26780137-c1", "ovs_interfaceid": "26780137-c1a5-41f0-9c41-e2b2cf450405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3612adb-bf1b-4334-b753-8513bcc6fd84 req-2e91daeb-a479-4843-8f36-d56b01cc33c4 service nova] Releasing lock "refresh_cache-e0df8b51-bda3-4c45-ab54-c6097f6136ad" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-7a45d371-d173-4cf3-9761-37c4cff6d094 req-e39ca94d-9e1a-4b18-af4b-bc0b64cb69c8 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received event network-changed-768ccf6f-fd61-45d1-b92f-1757a17dd630 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-7a45d371-d173-4cf3-9761-37c4cff6d094 req-e39ca94d-9e1a-4b18-af4b-bc0b64cb69c8 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Refreshing instance network info cache due to event network-changed-768ccf6f-fd61-45d1-b92f-1757a17dd630. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7a45d371-d173-4cf3-9761-37c4cff6d094 req-e39ca94d-9e1a-4b18-af4b-bc0b64cb69c8 service nova] Acquiring lock "refresh_cache-a3fe15c9-36ab-404e-876e-e6241cca05f4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7a45d371-d173-4cf3-9761-37c4cff6d094 req-e39ca94d-9e1a-4b18-af4b-bc0b64cb69c8 service nova] Acquired lock "refresh_cache-a3fe15c9-36ab-404e-876e-e6241cca05f4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-7a45d371-d173-4cf3-9761-37c4cff6d094 req-e39ca94d-9e1a-4b18-af4b-bc0b64cb69c8 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Refreshing network info cache for port 768ccf6f-fd61-45d1-b92f-1757a17dd630 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:01:46 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Creating image(s)
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Did not create local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Ensure instance console log exists: /opt/stack/data/nova/instances/69f05219-5034-4e88-879c-9c567e2c2fcd/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Start _get_guest_xml network_info=[{"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '9e10a23d-24b4-4706-a982-5d30f307b1d6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJLxnbkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '69f05219-5034-4e88-879c-9c567e2c2fcd', 'attached_at': '', 'detached_at': '', 'volume_id': '73cc7ca3-6f29-46f6-9e6a-d6d526dc6353', 'serial': '73cc7ca3-6f29-46f6-9e6a-d6d526dc6353'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:01:46 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:01:46 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJLxnbkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:01:46 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:01:46 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:01:46 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d5ea02-d947-41ff-a837-b728bc5ea7ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:01:46 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf3725a-bf89-44bb-8c1e-2ec17c664ebe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353] added
Nov 28 17:01:46 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b9f81c-cb23-410b-9946-3d35c65c2c75]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a79cfb2-901e-4f01-bd14-6eab192188fa]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJLxnbkd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-7a45d371-d173-4cf3-9761-37c4cff6d094 req-e39ca94d-9e1a-4b18-af4b-bc0b64cb69c8 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Updated VIF entry in instance network info cache for port 768ccf6f-fd61-45d1-b92f-1757a17dd630. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-7a45d371-d173-4cf3-9761-37c4cff6d094 req-e39ca94d-9e1a-4b18-af4b-bc0b64cb69c8 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Updating instance_info_cache with network_info: [{"id": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "address": "fa:16:3e:4a:b0:8a", "network": {"id": "ab6145d5-6573-4554-af98-a03fc795d945", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1474432451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768ccf6f-fd", "ovs_interfaceid": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJLxnbkd" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b657dbaa-5ec4-4ada-96c6-f06223be1bac]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gJLxnbkd'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7a45d371-d173-4cf3-9761-37c4cff6d094 req-e39ca94d-9e1a-4b18-af4b-bc0b64cb69c8 service nova] Releasing lock "refresh_cache-a3fe15c9-36ab-404e-876e-e6241cca05f4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Acquiring lock "interface-a3fe15c9-36ab-404e-876e-e6241cca05f4-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "interface-a3fe15c9-36ab-404e-876e-e6241cca05f4-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lazy-loading 'flavor' on Instance uuid a3fe15c9-36ab-404e-876e-e6241cca05f4 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b584fed-aeef-4298-91da-e37768c345f0]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63ffe45-f9d3-4ba9-ae67-1f33e4e2944d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:01:46 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:01:46 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:01:46 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:01:46 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:01:46 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:01:46 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:01:46 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:01:46 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2430f0a-d500-47ae-afff-f71017764c9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353, portal: 172.16.0.220,3260]
Nov 28 17:01:46 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353, portal: 172.16.0.220,3260] successful.
Nov 28 17:01:46 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde36ec1-4311-4220-81fe-9be10ddfd012]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lazy-loading 'pci_requests' on Instance uuid a3fe15c9-36ab-404e-876e-e6241cca05f4 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3746b56e-3d17-45bc-a0dc-5ba75f469ee1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:01:46 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:01:46 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:01:46 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:01:46 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:01:46 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:01:46 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:01:46 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:01:46 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:01:46 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:01:46 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.objects.base [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Object Instance<a3fe15c9-36ab-404e-876e-e6241cca05f4> lazy-loaded attributes: flavor,pci_requests {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[138fb81a-2519-441f-a90c-806a4d6cf6e5]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:01:46 user nova-compute[75246]: DEBUG nova.policy [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dfa371d2b74849bcaa6d181975484b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e482757bdc6447e6bbb8023603b840bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Successfully created port: a2e784b7-3e89-4751-854f-5456cc694388 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJLxnbkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23663623233316632', 'path': '/dev/sdf'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663623233316632', 'path': '/dev/sdf'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-261959295',display_name='tempest-TestShelveInstance-server-261959295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-261959295',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSXhLKm+++wgAM7YsUZWQNI57Qq/Uvo2sGpCIC0eWLA3a2G9dj59rvWwSkvl7YMi6fzuXFku8/GYlW1BRbrTLvl4ZqaNoDq5vRDvO38j64HIwGgl9GxlRYNZCFpgggI0Q==',key_name='tempest-TestShelveInstance-1911568956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='572ea174564b4afdbf607e501e025fd8',ramdisk_id='',reservation_id='r-hodplmom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-640383248',owner_user_name='tempest-TestShelveInstance-640383248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:01:38Z,user_data=None,user_id='58d26618e4064fedb1bd65d14920652d',uuid=69f05219-5034-4e88-879c-9c567e2c2fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Converting VIF {"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e6:81,bridge_name='br-int',has_traffic_filtering=True,id=068da4fa-d42e-47e8-8e7e-81bda7521356,network=Network(5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068da4fa-d4') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG nova.objects.instance [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lazy-loading 'pci_devices' on Instance uuid 69f05219-5034-4e88-879c-9c567e2c2fcd {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:01:47 user nova-compute[75246]:   <uuid>69f05219-5034-4e88-879c-9c567e2c2fcd</uuid>
Nov 28 17:01:47 user nova-compute[75246]:   <name>instance-0000000d</name>
Nov 28 17:01:47 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:01:47 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:01:47 user nova-compute[75246]:   <metadata>
Nov 28 17:01:47 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:01:47 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:01:47 user nova-compute[75246]:       <nova:name>tempest-TestShelveInstance-server-261959295</nova:name>
Nov 28 17:01:47 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:01:46</nova:creationTime>
Nov 28 17:01:47 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:01:47 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:01:47 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:01:47 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:01:47 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:01:47 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:01:47 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:01:47 user nova-compute[75246]:       <nova:owner>
Nov 28 17:01:47 user nova-compute[75246]:         <nova:user uuid="58d26618e4064fedb1bd65d14920652d">tempest-TestShelveInstance-640383248-project-member</nova:user>
Nov 28 17:01:47 user nova-compute[75246]:         <nova:project uuid="572ea174564b4afdbf607e501e025fd8">tempest-TestShelveInstance-640383248</nova:project>
Nov 28 17:01:47 user nova-compute[75246]:       </nova:owner>
Nov 28 17:01:47 user nova-compute[75246]:       <nova:ports>
Nov 28 17:01:47 user nova-compute[75246]:         <nova:port uuid="068da4fa-d42e-47e8-8e7e-81bda7521356">
Nov 28 17:01:47 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 17:01:47 user nova-compute[75246]:         </nova:port>
Nov 28 17:01:47 user nova-compute[75246]:       </nova:ports>
Nov 28 17:01:47 user nova-compute[75246]:     </nova:instance>
Nov 28 17:01:47 user nova-compute[75246]:   </metadata>
Nov 28 17:01:47 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:01:47 user nova-compute[75246]:     <system>
Nov 28 17:01:47 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:01:47 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:01:47 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:01:47 user nova-compute[75246]:       <entry name="serial">69f05219-5034-4e88-879c-9c567e2c2fcd</entry>
Nov 28 17:01:47 user nova-compute[75246]:       <entry name="uuid">69f05219-5034-4e88-879c-9c567e2c2fcd</entry>
Nov 28 17:01:47 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:01:47 user nova-compute[75246]:     </system>
Nov 28 17:01:47 user nova-compute[75246]:   </sysinfo>
Nov 28 17:01:47 user nova-compute[75246]:   <os>
Nov 28 17:01:47 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:01:47 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:01:47 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:01:47 user nova-compute[75246]:   </os>
Nov 28 17:01:47 user nova-compute[75246]:   <features>
Nov 28 17:01:47 user nova-compute[75246]:     <acpi/>
Nov 28 17:01:47 user nova-compute[75246]:     <apic/>
Nov 28 17:01:47 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:01:47 user nova-compute[75246]:   </features>
Nov 28 17:01:47 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:01:47 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:01:47 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:01:47 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:01:47 user nova-compute[75246]:   </clock>
Nov 28 17:01:47 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:01:47 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:01:47 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:01:47 user nova-compute[75246]:   </cpu>
Nov 28 17:01:47 user nova-compute[75246]:   <devices>
Nov 28 17:01:47 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:01:47 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:01:47 user nova-compute[75246]:       <source dev="/dev/sdf"/>
Nov 28 17:01:47 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:01:47 user nova-compute[75246]:       <serial>73cc7ca3-6f29-46f6-9e6a-d6d526dc6353</serial>
Nov 28 17:01:47 user nova-compute[75246]:     </disk>
Nov 28 17:01:47 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:01:47 user nova-compute[75246]:       <mac address="fa:16:3e:bc:e6:81"/>
Nov 28 17:01:47 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:01:47 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:01:47 user nova-compute[75246]:       <target dev="tap068da4fa-d4"/>
Nov 28 17:01:47 user nova-compute[75246]:     </interface>
Nov 28 17:01:47 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:01:47 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/69f05219-5034-4e88-879c-9c567e2c2fcd/console.log" append="off"/>
Nov 28 17:01:47 user nova-compute[75246]:     </serial>
Nov 28 17:01:47 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:01:47 user nova-compute[75246]:     <video>
Nov 28 17:01:47 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:01:47 user nova-compute[75246]:     </video>
Nov 28 17:01:47 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:01:47 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:01:47 user nova-compute[75246]:     </rng>
Nov 28 17:01:47 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:01:47 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:01:47 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:01:47 user nova-compute[75246]:     </memballoon>
Nov 28 17:01:47 user nova-compute[75246]:   </devices>
Nov 28 17:01:47 user nova-compute[75246]: </domain>
Nov 28 17:01:47 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-261959295',display_name='tempest-TestShelveInstance-server-261959295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-261959295',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSXhLKm+++wgAM7YsUZWQNI57Qq/Uvo2sGpCIC0eWLA3a2G9dj59rvWwSkvl7YMi6fzuXFku8/GYlW1BRbrTLvl4ZqaNoDq5vRDvO38j64HIwGgl9GxlRYNZCFpgggI0Q==',key_name='tempest-TestShelveInstance-1911568956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='572ea174564b4afdbf607e501e025fd8',ramdisk_id='',reservation_id='r-hodplmom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-640383248',owner_user_name='tempest-TestShelveInstance-640383248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:01:38Z,user_data=None,user_id='58d26618e4064fedb1bd65d14920652d',uuid=69f05219-5034-4e88-879c-9c567e2c2fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Converting VIF {"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e6:81,bridge_name='br-int',has_traffic_filtering=True,id=068da4fa-d42e-47e8-8e7e-81bda7521356,network=Network(5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068da4fa-d4') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG os_vif [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e6:81,bridge_name='br-int',has_traffic_filtering=True,id=068da4fa-d42e-47e8-8e7e-81bda7521356,network=Network(5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068da4fa-d4') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b916b78-caa8-56a2-82cf-aa0777fb48ac', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap068da4fa-d4, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap068da4fa-d4, col_values=(('qos', UUID('f85a0999-f9be-4233-9b73-01292cb1bd78')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap068da4fa-d4, col_values=(('external_ids', {'iface-id': '068da4fa-d42e-47e8-8e7e-81bda7521356', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:e6:81', 'vm-uuid': '69f05219-5034-4e88-879c-9c567e2c2fcd'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:48 user nova-compute[75246]: INFO os_vif [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e6:81,bridge_name='br-int',has_traffic_filtering=True,id=068da4fa-d42e-47e8-8e7e-81bda7521356,network=Network(5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068da4fa-d4')
Nov 28 17:01:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] No VIF found with MAC fa:16:3e:bc:e6:81, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Successfully updated port: a2e784b7-3e89-4751-854f-5456cc694388 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Acquiring lock "refresh_cache-a3fe15c9-36ab-404e-876e-e6241cca05f4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Acquired lock "refresh_cache-a3fe15c9-36ab-404e-876e-e6241cca05f4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG nova.compute.manager [req-00709062-a359-4723-aba7-6c480cd7c7e1 req-ab9d52cb-65a6-4c58-b081-5b6895ebc489 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received event network-changed-a2e784b7-3e89-4751-854f-5456cc694388 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG nova.compute.manager [req-00709062-a359-4723-aba7-6c480cd7c7e1 req-ab9d52cb-65a6-4c58-b081-5b6895ebc489 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Refreshing instance network info cache due to event network-changed-a2e784b7-3e89-4751-854f-5456cc694388. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-00709062-a359-4723-aba7-6c480cd7c7e1 req-ab9d52cb-65a6-4c58-b081-5b6895ebc489 service nova] Acquiring lock "refresh_cache-a3fe15c9-36ab-404e-876e-e6241cca05f4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Acquiring lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG nova.objects.instance [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lazy-loading 'flavor' on Instance uuid e0df8b51-bda3-4c45-ab54-c6097f6136ad {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Updating instance_info_cache with network_info: [{"id": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "address": "fa:16:3e:4a:b0:8a", "network": {"id": "ab6145d5-6573-4554-af98-a03fc795d945", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1474432451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768ccf6f-fd", "ovs_interfaceid": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2e784b7-3e89-4751-854f-5456cc694388", "address": "fa:16:3e:81:7f:b4", "network": {"id": "ff598896-c7ba-4144-b8d4-1b3e7a7848e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-7575623", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e784b7-3e", "ovs_interfaceid": "a2e784b7-3e89-4751-854f-5456cc694388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Releasing lock "refresh_cache-a3fe15c9-36ab-404e-876e-e6241cca05f4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-00709062-a359-4723-aba7-6c480cd7c7e1 req-ab9d52cb-65a6-4c58-b081-5b6895ebc489 service nova] Acquired lock "refresh_cache-a3fe15c9-36ab-404e-876e-e6241cca05f4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG nova.network.neutron [req-00709062-a359-4723-aba7-6c480cd7c7e1 req-ab9d52cb-65a6-4c58-b081-5b6895ebc489 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Refreshing network info cache for port a2e784b7-3e89-4751-854f-5456cc694388 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T16:59:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1290677406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1290677406',id=7,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJrFX4bITMkrby6ETDsYezBUA5h8p9LH12srNxdHviTlhXQIetTlR232xA8XXoc1vY6KV19PrW1yPWXcJCSTPwYRjwnPlIkcljll7OFMOW+nMc0PmFuhGMeQsruLDksRA==',key_name='tempest-keypair-693413544',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:00:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e482757bdc6447e6bbb8023603b840bf',ramdisk_id='',reservation_id='r-ib8ql4t7',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1447929950',owner_user_name='tempest-TaggedAttachmentsTest-1447929950-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:00:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfa371d2b74849bcaa6d181975484b66',uuid=a3fe15c9-36ab-404e-876e-e6241cca05f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2e784b7-3e89-4751-854f-5456cc694388", "address": "fa:16:3e:81:7f:b4", "network": {"id": "ff598896-c7ba-4144-b8d4-1b3e7a7848e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-7575623", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e784b7-3e", "ovs_interfaceid": "a2e784b7-3e89-4751-854f-5456cc694388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Converting VIF {"id": "a2e784b7-3e89-4751-854f-5456cc694388", "address": "fa:16:3e:81:7f:b4", "network": {"id": "ff598896-c7ba-4144-b8d4-1b3e7a7848e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-7575623", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e784b7-3e", "ovs_interfaceid": "a2e784b7-3e89-4751-854f-5456cc694388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:7f:b4,bridge_name='br-int',has_traffic_filtering=True,id=a2e784b7-3e89-4751-854f-5456cc694388,network=Network(ff598896-c7ba-4144-b8d4-1b3e7a7848e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e784b7-3e') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG os_vif [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:7f:b4,bridge_name='br-int',has_traffic_filtering=True,id=a2e784b7-3e89-4751-854f-5456cc694388,network=Network(ff598896-c7ba-4144-b8d4-1b3e7a7848e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e784b7-3e') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c83ee52-8039-56af-bf83-ae1abc1907ff', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2e784b7-3e, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2e784b7-3e, col_values=(('qos', UUID('2d7a9b83-1227-4764-84b1-c92fe37f7f39')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2e784b7-3e, col_values=(('external_ids', {'iface-id': 'a2e784b7-3e89-4751-854f-5456cc694388', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:7f:b4', 'vm-uuid': 'a3fe15c9-36ab-404e-876e-e6241cca05f4'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:48 user nova-compute[75246]: INFO os_vif [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:7f:b4,bridge_name='br-int',has_traffic_filtering=True,id=a2e784b7-3e89-4751-854f-5456cc694388,network=Network(ff598896-c7ba-4144-b8d4-1b3e7a7848e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e784b7-3e')
Nov 28 17:01:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T16:59:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1290677406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1290677406',id=7,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJrFX4bITMkrby6ETDsYezBUA5h8p9LH12srNxdHviTlhXQIetTlR232xA8XXoc1vY6KV19PrW1yPWXcJCSTPwYRjwnPlIkcljll7OFMOW+nMc0PmFuhGMeQsruLDksRA==',key_name='tempest-keypair-693413544',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:00:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e482757bdc6447e6bbb8023603b840bf',ramdisk_id='',reservation_id='r-ib8ql4t7',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1447929950',owner_user_name='tempest-TaggedAttachmentsTest-1447929950-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:00:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfa371d2b74849bcaa6d181975484b66',uuid=a3fe15c9-36ab-404e-876e-e6241cca05f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2e784b7-3e89-4751-854f-5456cc694388", "address": "fa:16:3e:81:7f:b4", "network": {"id": "ff598896-c7ba-4144-b8d4-1b3e7a7848e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-7575623", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e784b7-3e", "ovs_interfaceid": "a2e784b7-3e89-4751-854f-5456cc694388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Converting VIF {"id": "a2e784b7-3e89-4751-854f-5456cc694388", "address": "fa:16:3e:81:7f:b4", "network": {"id": "ff598896-c7ba-4144-b8d4-1b3e7a7848e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-7575623", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e784b7-3e", "ovs_interfaceid": "a2e784b7-3e89-4751-854f-5456cc694388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:7f:b4,bridge_name='br-int',has_traffic_filtering=True,id=a2e784b7-3e89-4751-854f-5456cc694388,network=Network(ff598896-c7ba-4144-b8d4-1b3e7a7848e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e784b7-3e') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] attach device xml: <interface type="ethernet">
Nov 28 17:01:48 user nova-compute[75246]:   <mac address="fa:16:3e:81:7f:b4"/>
Nov 28 17:01:48 user nova-compute[75246]:   <model type="virtio"/>
Nov 28 17:01:48 user nova-compute[75246]:   <mtu size="1442"/>
Nov 28 17:01:48 user nova-compute[75246]:   <target dev="tapa2e784b7-3e"/>
Nov 28 17:01:48 user nova-compute[75246]: </interface>
Nov 28 17:01:48 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:01:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Acquiring lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:49 user nova-compute[75246]: INFO nova.compute.manager [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Attaching volume 1e959eb7-e633-4c37-a2e2-4ecca532ba2f to /dev/sdc
Nov 28 17:01:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG os_brick.utils [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.037s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e228a9e2-7c25-477d-8aba-c2f1b4bb3eb4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c28ce9-ab8d-4425-bac8-8bd7e9bae916]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e3ca09-23c7-4961-8de9-4470d5341e81]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b13a88-3d2d-42d8-8a88-20673fc86629]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:01:49 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[81995427-a424-4746-83a2-6f7cc3878032]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG os_brick.utils [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] <== get_connector_properties: return (283ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Updating existing volume attachment record: 5e1b646c-1268-4c29-9308-d474abe5af52 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG nova.network.neutron [req-00709062-a359-4723-aba7-6c480cd7c7e1 req-ab9d52cb-65a6-4c58-b081-5b6895ebc489 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Updated VIF entry in instance network info cache for port a2e784b7-3e89-4751-854f-5456cc694388. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG nova.network.neutron [req-00709062-a359-4723-aba7-6c480cd7c7e1 req-ab9d52cb-65a6-4c58-b081-5b6895ebc489 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Updating instance_info_cache with network_info: [{"id": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "address": "fa:16:3e:4a:b0:8a", "network": {"id": "ab6145d5-6573-4554-af98-a03fc795d945", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1474432451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768ccf6f-fd", "ovs_interfaceid": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2e784b7-3e89-4751-854f-5456cc694388", "address": "fa:16:3e:81:7f:b4", "network": {"id": "ff598896-c7ba-4144-b8d4-1b3e7a7848e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-7575623", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e784b7-3e", "ovs_interfaceid": "a2e784b7-3e89-4751-854f-5456cc694388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-00709062-a359-4723-aba7-6c480cd7c7e1 req-ab9d52cb-65a6-4c58-b081-5b6895ebc489 service nova] Releasing lock "refresh_cache-a3fe15c9-36ab-404e-876e-e6241cca05f4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] No BDM found with device name hda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] No VIF found with MAC fa:16:3e:4a:b0:8a, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:01:49 user nova-compute[75246]:   <nova:package version="0.0.0"/>
Nov 28 17:01:49 user nova-compute[75246]:   <nova:name>tempest-device-tagging-server-1290677406</nova:name>
Nov 28 17:01:49 user nova-compute[75246]:   <nova:creationTime>2023-11-28 17:01:49</nova:creationTime>
Nov 28 17:01:49 user nova-compute[75246]:   <nova:flavor name="m1.tiny">
Nov 28 17:01:49 user nova-compute[75246]:     <nova:memory>512</nova:memory>
Nov 28 17:01:49 user nova-compute[75246]:     <nova:disk>1</nova:disk>
Nov 28 17:01:49 user nova-compute[75246]:     <nova:swap>0</nova:swap>
Nov 28 17:01:49 user nova-compute[75246]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:01:49 user nova-compute[75246]:     <nova:vcpus>1</nova:vcpus>
Nov 28 17:01:49 user nova-compute[75246]:   </nova:flavor>
Nov 28 17:01:49 user nova-compute[75246]:   <nova:owner>
Nov 28 17:01:49 user nova-compute[75246]:     <nova:user uuid="dfa371d2b74849bcaa6d181975484b66">tempest-TaggedAttachmentsTest-1447929950-project-member</nova:user>
Nov 28 17:01:49 user nova-compute[75246]:     <nova:project uuid="e482757bdc6447e6bbb8023603b840bf">tempest-TaggedAttachmentsTest-1447929950</nova:project>
Nov 28 17:01:49 user nova-compute[75246]:   </nova:owner>
Nov 28 17:01:49 user nova-compute[75246]:   <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:01:49 user nova-compute[75246]:   <nova:ports>
Nov 28 17:01:49 user nova-compute[75246]:     <nova:port uuid="768ccf6f-fd61-45d1-b92f-1757a17dd630">
Nov 28 17:01:49 user nova-compute[75246]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 17:01:49 user nova-compute[75246]:     </nova:port>
Nov 28 17:01:49 user nova-compute[75246]:     <nova:port uuid="a2e784b7-3e89-4751-854f-5456cc694388">
Nov 28 17:01:49 user nova-compute[75246]:       <nova:ip type="fixed" address="10.10.10.244" ipVersion="4"/>
Nov 28 17:01:49 user nova-compute[75246]:     </nova:port>
Nov 28 17:01:49 user nova-compute[75246]:   </nova:ports>
Nov 28 17:01:49 user nova-compute[75246]: </nova:instance>
Nov 28 17:01:49 user nova-compute[75246]:  {{(pid=75246) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6acf7aaa-f818-4a9b-b335-ff08e75f4495 tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "interface-a3fe15c9-36ab-404e-876e-e6241cca05f4-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.153s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG nova.compute.manager [req-c1ba3727-9455-4ccc-9404-453ffbce2d36 req-cda8e3a8-953a-4de3-8af4-adfaeca61aa2 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received event network-vif-plugged-a2e784b7-3e89-4751-854f-5456cc694388 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c1ba3727-9455-4ccc-9404-453ffbce2d36 req-cda8e3a8-953a-4de3-8af4-adfaeca61aa2 service nova] Acquiring lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c1ba3727-9455-4ccc-9404-453ffbce2d36 req-cda8e3a8-953a-4de3-8af4-adfaeca61aa2 service nova] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c1ba3727-9455-4ccc-9404-453ffbce2d36 req-cda8e3a8-953a-4de3-8af4-adfaeca61aa2 service nova] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG nova.compute.manager [req-c1ba3727-9455-4ccc-9404-453ffbce2d36 req-cda8e3a8-953a-4de3-8af4-adfaeca61aa2 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] No waiting events found dispatching network-vif-plugged-a2e784b7-3e89-4751-854f-5456cc694388 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:50 user nova-compute[75246]: WARNING nova.compute.manager [req-c1ba3727-9455-4ccc-9404-453ffbce2d36 req-cda8e3a8-953a-4de3-8af4-adfaeca61aa2 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received unexpected event network-vif-plugged-a2e784b7-3e89-4751-854f-5456cc694388 for instance with vm_state active and task_state None.
Nov 28 17:01:50 user nova-compute[75246]: DEBUG nova.compute.manager [req-c1ba3727-9455-4ccc-9404-453ffbce2d36 req-cda8e3a8-953a-4de3-8af4-adfaeca61aa2 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received event network-vif-plugged-a2e784b7-3e89-4751-854f-5456cc694388 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c1ba3727-9455-4ccc-9404-453ffbce2d36 req-cda8e3a8-953a-4de3-8af4-adfaeca61aa2 service nova] Acquiring lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c1ba3727-9455-4ccc-9404-453ffbce2d36 req-cda8e3a8-953a-4de3-8af4-adfaeca61aa2 service nova] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c1ba3727-9455-4ccc-9404-453ffbce2d36 req-cda8e3a8-953a-4de3-8af4-adfaeca61aa2 service nova] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG nova.compute.manager [req-c1ba3727-9455-4ccc-9404-453ffbce2d36 req-cda8e3a8-953a-4de3-8af4-adfaeca61aa2 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] No waiting events found dispatching network-vif-plugged-a2e784b7-3e89-4751-854f-5456cc694388 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:50 user nova-compute[75246]: WARNING nova.compute.manager [req-c1ba3727-9455-4ccc-9404-453ffbce2d36 req-cda8e3a8-953a-4de3-8af4-adfaeca61aa2 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received unexpected event network-vif-plugged-a2e784b7-3e89-4751-854f-5456cc694388 for instance with vm_state active and task_state None.
Nov 28 17:01:50 user nova-compute[75246]: DEBUG nova.compute.manager [req-c1ba3727-9455-4ccc-9404-453ffbce2d36 req-cda8e3a8-953a-4de3-8af4-adfaeca61aa2 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c1ba3727-9455-4ccc-9404-453ffbce2d36 req-cda8e3a8-953a-4de3-8af4-adfaeca61aa2 service nova] Acquiring lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c1ba3727-9455-4ccc-9404-453ffbce2d36 req-cda8e3a8-953a-4de3-8af4-adfaeca61aa2 service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c1ba3727-9455-4ccc-9404-453ffbce2d36 req-cda8e3a8-953a-4de3-8af4-adfaeca61aa2 service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG nova.compute.manager [req-c1ba3727-9455-4ccc-9404-453ffbce2d36 req-cda8e3a8-953a-4de3-8af4-adfaeca61aa2 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] No waiting events found dispatching network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:50 user nova-compute[75246]: WARNING nova.compute.manager [req-c1ba3727-9455-4ccc-9404-453ffbce2d36 req-cda8e3a8-953a-4de3-8af4-adfaeca61aa2 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received unexpected event network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 for instance with vm_state building and task_state spawning.
Nov 28 17:01:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:52 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:01:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:01:52 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Instance spawned successfully.
Nov 28 17:01:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:01:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:01:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:01:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:01:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:01:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:01:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:01:52 user nova-compute[75246]: INFO nova.compute.manager [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 28 17:01:52 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:01:52 user nova-compute[75246]: INFO nova.compute.manager [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Took 15.00 seconds to build instance.
Nov 28 17:01:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e67a7ff9-ee7e-4017-bff5-d85c04cbe1bf tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.092s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:52 user nova-compute[75246]: DEBUG nova.compute.manager [req-42e1d8dd-4508-4706-9163-517fe62ef6ec req-3cc02b2a-ad08-4942-8b90-a5d5d9221c8c service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-42e1d8dd-4508-4706-9163-517fe62ef6ec req-3cc02b2a-ad08-4942-8b90-a5d5d9221c8c service nova] Acquiring lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-42e1d8dd-4508-4706-9163-517fe62ef6ec req-3cc02b2a-ad08-4942-8b90-a5d5d9221c8c service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-42e1d8dd-4508-4706-9163-517fe62ef6ec req-3cc02b2a-ad08-4942-8b90-a5d5d9221c8c service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:52 user nova-compute[75246]: DEBUG nova.compute.manager [req-42e1d8dd-4508-4706-9163-517fe62ef6ec req-3cc02b2a-ad08-4942-8b90-a5d5d9221c8c service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] No waiting events found dispatching network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:01:52 user nova-compute[75246]: WARNING nova.compute.manager [req-42e1d8dd-4508-4706-9163-517fe62ef6ec req-3cc02b2a-ad08-4942-8b90-a5d5d9221c8c service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received unexpected event network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 for instance with vm_state active and task_state None.
Nov 28 17:01:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNVuowsS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:01:57 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:01:57 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:01:57 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[68136a34-921c-4300-b8e3-dbb0b0aaf92e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:01:57 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-394bde3b-3a2c-450c-912c-da1c6b72f3d5 req-132f0c4f-5bca-433f-a043-50bf60b77e5c service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Received event network-changed-ac51a369-6c87-41c1-8b7c-a313a3b72ee3 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-394bde3b-3a2c-450c-912c-da1c6b72f3d5 req-132f0c4f-5bca-433f-a043-50bf60b77e5c service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Refreshing instance network info cache due to event network-changed-ac51a369-6c87-41c1-8b7c-a313a3b72ee3. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-394bde3b-3a2c-450c-912c-da1c6b72f3d5 req-132f0c4f-5bca-433f-a043-50bf60b77e5c service nova] Acquiring lock "refresh_cache-24d45b28-61df-43cb-bdae-f8ce6b3aaca3" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-394bde3b-3a2c-450c-912c-da1c6b72f3d5 req-132f0c4f-5bca-433f-a043-50bf60b77e5c service nova] Acquired lock "refresh_cache-24d45b28-61df-43cb-bdae-f8ce6b3aaca3" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG nova.network.neutron [req-394bde3b-3a2c-450c-912c-da1c6b72f3d5 req-132f0c4f-5bca-433f-a043-50bf60b77e5c service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Refreshing network info cache for port ac51a369-6c87-41c1-8b7c-a313a3b72ee3 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d10bb9-326c-43e3-b35c-39fa7579b191]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f] added
Nov 28 17:01:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab33aa4-db3e-4152-9851-74d7040b23cb]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abceaaf-3fc2-491e-baac-267a1eb08e89]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cNVuowsS {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cNVuowsS" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d577ea-b793-4f03-8b14-5fb01e88ca5e]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cNVuowsS'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Acquiring lock "a3fe15c9-36ab-404e-876e-e6241cca05f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c6fe52-ded6-421e-8c17-714871d0cfe4]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG nova.objects.instance [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lazy-loading 'flavor' on Instance uuid a3fe15c9-36ab-404e-876e-e6241cca05f4 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbd3039-54cf-4352-aae2-22dd22b16d20]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:01:57 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:01:57 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:01:57 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:01:57 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:01:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:01:57 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:01:57 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:01:57 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:01:57 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:01:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef40bd3-ef08-41f0-9605-5b44fb91a7c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f, portal: 172.16.0.220,3260]
Nov 28 17:01:57 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f, portal: 172.16.0.220,3260] successful.
Nov 28 17:01:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Acquiring lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5408729d-3c33-4c6e-bca6-ff60a8fe9a69]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Lazy-loading 'flavor' on Instance uuid 24d45b28-61df-43cb-bdae-f8ce6b3aaca3 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa6dccf-b8cf-4714-b6de-8bfbc49356ca]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:01:57 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:01:57 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:01:57 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:01:57 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:01:57 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:01:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:01:57 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:01:57 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:01:57 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:01:57 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:01:57 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:01:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.041s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad6441f-279d-4d7b-8d30-04ef5e7b95e9]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNVuowsS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Acquiring lock "a3fe15c9-36ab-404e-876e-e6241cca05f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:57 user nova-compute[75246]: INFO nova.compute.manager [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Attaching volume eb572c9e-c19e-4350-90d8-530b085eae48 to /dev/vdb
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Acquiring lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:01:58 user nova-compute[75246]: INFO nova.compute.manager [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Attaching volume 939fb158-7a40-4076-be46-1a0a29b28633 to /dev/vdb
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.utils [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff136e7-33fd-4e07-a455-da3ba5978907]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71e5697-a8b2-4f90-b1bf-26f2d1eaebaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd96839-95d3-4c01-bd0e-a61f964a6bde]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e7a0d5-5010-4d6d-988c-38c1d0b2b249]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.utils [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:01:58 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4788644-a551-40e0-9477-6aa837251c39]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.utils [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Updating existing volume attachment record: 34afff74-d236-4d28-a770-a175119ccc82 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a1a036-4b15-4ee3-8d6d-8bf8918b5182]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[155e9c00-9554-43c8-bf5b-765c1d47420c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[259f4850-1eea-476c-953d-701fb9142caa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b240cfa-1f98-4d2f-9d1f-2f4ac279e642]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:01:58 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8b0fb6-2d31-4773-8b3a-0de9b61efe8e]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.utils [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Updating existing volume attachment record: 17ac1451-7d4b-4c5e-9d00-29407760a0e5 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nECbgNyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:01:58 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRMWKwCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:01:58 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG nova.network.neutron [req-394bde3b-3a2c-450c-912c-da1c6b72f3d5 req-132f0c4f-5bca-433f-a043-50bf60b77e5c service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Updated VIF entry in instance network info cache for port ac51a369-6c87-41c1-8b7c-a313a3b72ee3. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG nova.network.neutron [req-394bde3b-3a2c-450c-912c-da1c6b72f3d5 req-132f0c4f-5bca-433f-a043-50bf60b77e5c service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Updating instance_info_cache with network_info: [{"id": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "address": "fa:16:3e:54:89:d5", "network": {"id": "52ca7b7f-3ab7-4a79-a471-baeb55da51eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1832570935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131b53fb281648c79ad65e38978a7c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac51a369-6c", "ovs_interfaceid": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-394bde3b-3a2c-450c-912c-da1c6b72f3d5 req-132f0c4f-5bca-433f-a043-50bf60b77e5c service nova] Releasing lock "refresh_cache-24d45b28-61df-43cb-bdae-f8ce6b3aaca3" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '26238313561393362', 'path': '/dev/sdg'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238313561393362', 'path': '/dev/sdg'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.428s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:01:58 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:01:58 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG nova.objects.instance [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lazy-loading 'flavor' on Instance uuid e0df8b51-bda3-4c45-ab54-c6097f6136ad {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe4c0e9-c40e-40a9-b081-d01e411ce0f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:01:58 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:01:58 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:01:58 user nova-compute[75246]:   <source dev="/dev/sdg"/>
Nov 28 17:01:58 user nova-compute[75246]:   <target dev="sdc" bus="scsi"/>
Nov 28 17:01:58 user nova-compute[75246]:   <serial>1e959eb7-e633-4c37-a2e2-4ecca532ba2f</serial>
Nov 28 17:01:58 user nova-compute[75246]:   <address type="drive" controller="0" unit="2"/>
Nov 28 17:01:58 user nova-compute[75246]: </disk>
Nov 28 17:01:58 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b274770c-e7a8-44c6-9daa-38ffdd92c69d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a] added
Nov 28 17:01:58 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[27aaba12-d120-4fdb-9553-12930ef8cb17]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccae1b1-7ade-4319-a933-27ff47bbc97f]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nECbgNyp {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nECbgNyp" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[19520f8d-8cef-418a-910c-9d54e60b52f8]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nECbgNyp'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa351a5-6e0d-40cb-b9ca-3622a4be55f8]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0a9ac6-e117-49ba-9f54-08a0a0f1c616]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:01:59 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:01:59 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dcddbf-863f-4dd0-9cd2-8fed3272a73f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a, portal: 172.16.0.220,3260]
Nov 28 17:01:59 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a, portal: 172.16.0.220,3260] successful.
Nov 28 17:01:59 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ff3c7b-2d31-44a1-a91f-cadeeff6cfbd]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4f35be-24be-4509-a1ea-e75956c4d805]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:01:59 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:01:59 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:01:59 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba6e191-1a5e-4661-b4da-2df508044c16]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nECbgNyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] No BDM found with device name sda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] No VIF found with MAC fa:16:3e:b2:ec:27, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-695d259f-b631-4362-895f-70d6cfd33f30 req-932b47a0-556a-49ae-9b1a-9c4792421b64 service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received event network-changed-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-695d259f-b631-4362-895f-70d6cfd33f30 req-932b47a0-556a-49ae-9b1a-9c4792421b64 service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Refreshing instance network info cache due to event network-changed-8ccf37bb-28f1-4f69-ba57-e168eff668e4. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-695d259f-b631-4362-895f-70d6cfd33f30 req-932b47a0-556a-49ae-9b1a-9c4792421b64 service nova] Acquiring lock "refresh_cache-9f306608-7716-41e0-9aa0-afa8ba173a04" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-695d259f-b631-4362-895f-70d6cfd33f30 req-932b47a0-556a-49ae-9b1a-9c4792421b64 service nova] Acquired lock "refresh_cache-9f306608-7716-41e0-9aa0-afa8ba173a04" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG nova.network.neutron [req-695d259f-b631-4362-895f-70d6cfd33f30 req-932b47a0-556a-49ae-9b1a-9c4792421b64 service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Refreshing network info cache for port 8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b3796d75-cc3f-4a88-99ec-ab4f4c7a6a04 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.568s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:01:59 user nova-compute[75246]: INFO nova.compute.manager [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Rebuilding instance
Nov 28 17:01:59 user nova-compute[75246]: DEBUG nova.network.neutron [req-695d259f-b631-4362-895f-70d6cfd33f30 req-932b47a0-556a-49ae-9b1a-9c4792421b64 service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Updated VIF entry in instance network info cache for port 8ccf37bb-28f1-4f69-ba57-e168eff668e4. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG nova.network.neutron [req-695d259f-b631-4362-895f-70d6cfd33f30 req-932b47a0-556a-49ae-9b1a-9c4792421b64 service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Updating instance_info_cache with network_info: [{"id": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "address": "fa:16:3e:df:ac:3a", "network": {"id": "06579a46-8d95-4c64-940c-00a80ce64cf2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-824652166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37d00748c91a42a9aa255f62e207a41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf37bb-28", "ovs_interfaceid": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-695d259f-b631-4362-895f-70d6cfd33f30 req-932b47a0-556a-49ae-9b1a-9c4792421b64 service nova] Releasing lock "refresh_cache-9f306608-7716-41e0-9aa0-afa8ba173a04" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:01:59 user nova-compute[75246]: DEBUG nova.compute.manager [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] <== connect_volume: return (1807ms) {'type': 'block', 'scsi_wwn': '23939316262343736', 'path': '/dev/sdh'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939316262343736', 'path': '/dev/sdh'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.778s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:00 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:00 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Acquiring lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG nova.objects.instance [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lazy-loading 'flavor' on Instance uuid 915bc61e-eaea-40c0-a5ed-4d2a677477f8 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:02:00 user nova-compute[75246]: INFO nova.compute.manager [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Detaching volume 1e959eb7-e633-4c37-a2e2-4ecca532ba2f
Nov 28 17:02:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260" returned: 21 in 0.058s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5435060c-705b-4093-9135-945029dc010f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:02:00 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:02:00 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:02:00 user nova-compute[75246]:   <source dev="/dev/sdh"/>
Nov 28 17:02:00 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:02:00 user nova-compute[75246]:   <serial>bae0827b-8788-4aa7-9b54-ef14d23d886a</serial>
Nov 28 17:02:00 user nova-compute[75246]: </disk>
Nov 28 17:02:00 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d351de6b-6617-47a4-9d91-e1b920173782]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047] added
Nov 28 17:02:00 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:00 user nova-compute[75246]: INFO nova.virt.block_device [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Attempting to driver detach volume 1e959eb7-e633-4c37-a2e2-4ecca532ba2f from mountpoint /dev/sdc
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1728276-260c-4dc8-968f-dbe0a696e85e]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Attempting to detach device sdc from instance e0df8b51-bda3-4c45-ab54-c6097f6136ad from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:02:00 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:02:00 user nova-compute[75246]:   <source dev="/dev/sdg"/>
Nov 28 17:02:00 user nova-compute[75246]:   <target dev="sdc" bus="scsi"/>
Nov 28 17:02:00 user nova-compute[75246]:   <serial>1e959eb7-e633-4c37-a2e2-4ecca532ba2f</serial>
Nov 28 17:02:00 user nova-compute[75246]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 28 17:02:00 user nova-compute[75246]: </disk>
Nov 28 17:02:00 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5be782d-b73e-48ba-b941-1650d4785b3c]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TRMWKwCD {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:00 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Successfully detached device sdc from instance e0df8b51-bda3-4c45-ab54-c6097f6136ad from the persistent domain config.
Nov 28 17:02:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance e0df8b51-bda3-4c45-ab54-c6097f6136ad from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:02:00 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:02:00 user nova-compute[75246]:   <source dev="/dev/sdg"/>
Nov 28 17:02:00 user nova-compute[75246]:   <target dev="sdc" bus="scsi"/>
Nov 28 17:02:00 user nova-compute[75246]:   <serial>1e959eb7-e633-4c37-a2e2-4ecca532ba2f</serial>
Nov 28 17:02:00 user nova-compute[75246]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 28 17:02:00 user nova-compute[75246]: </disk>
Nov 28 17:02:00 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-0a8feb06-62cd-482f-9f6f-d40bad1505b2 req-7e18611a-d32f-4407-9178-31d2778d078b service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received event network-vif-unplugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0a8feb06-62cd-482f-9f6f-d40bad1505b2 req-7e18611a-d32f-4407-9178-31d2778d078b service nova] Acquiring lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0a8feb06-62cd-482f-9f6f-d40bad1505b2 req-7e18611a-d32f-4407-9178-31d2778d078b service nova] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0a8feb06-62cd-482f-9f6f-d40bad1505b2 req-7e18611a-d32f-4407-9178-31d2778d078b service nova] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-0a8feb06-62cd-482f-9f6f-d40bad1505b2 req-7e18611a-d32f-4407-9178-31d2778d078b service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] No waiting events found dispatching network-vif-unplugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:00 user nova-compute[75246]: WARNING nova.compute.manager [req-0a8feb06-62cd-482f-9f6f-d40bad1505b2 req-7e18611a-d32f-4407-9178-31d2778d078b service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received unexpected event network-vif-unplugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 for instance with vm_state active and task_state rebuilding.
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TRMWKwCD" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c3f050-50fb-4967-8ef8-351d43e93547]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TRMWKwCD'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[823185d5-e59d-4887-a076-59d4b2a18d75]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca062ed9-c328-42ef-bfea-f24be0ab2901]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:00 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:00 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4540cb-c3a6-4798-830e-d71c1be87875]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047, portal: 172.16.0.220,3260]
Nov 28 17:02:00 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047, portal: 172.16.0.220,3260] successful.
Nov 28 17:02:00 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e267f106-352b-464f-b477-69f17e3e5844]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff52da8f-89ce-4f15-96b0-ae6208e2c6bd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:00 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:00 user nova-compute[75246]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:00 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.441s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07b9a46-35e9-408f-8e8d-243cb7d61949]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRMWKwCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] No VIF found with MAC fa:16:3e:14:c6:95, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:02:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7c63a9cc-d941-43db-9b7b-d25981f32c89 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.421s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance e0df8b51-bda3-4c45-ab54-c6097f6136ad {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:02:01 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Instance destroyed successfully.
Nov 28 17:02:01 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Instance destroyed successfully.
Nov 28 17:02:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:00:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2073692504',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1449270168',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/bT5nFFmbZrOpaZ0HmyZXCELWLX9dTZ/XfZD4hqIrK3t2MR0LlLUdxpI/bFXzxh3UZ4VIGEMreeSaxuGWiHlXx7TOkvrFpJoQFIrSk/kIxGBFPzpcWuMsi8ubkeEskCA==',key_name='tempest-keypair-1686207482',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:00:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='37d00748c91a42a9aa255f62e207a41c',ramdisk_id='',reservation_id='r-r7anrgfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1837306517',owner_user_name='tempest-ServerActionsV293TestJSON-1837306517-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:02:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3465e183420e4370a02046024827d21f',uuid=9f306608-7716-41e0-9aa0-afa8ba173a04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "address": "fa:16:3e:df:ac:3a", "network": {"id": "06579a46-8d95-4c64-940c-00a80ce64cf2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-824652166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37d00748c91a42a9aa255f62e207a41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf37bb-28", "ovs_interfaceid": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Converting VIF {"id": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "address": "fa:16:3e:df:ac:3a", "network": {"id": "06579a46-8d95-4c64-940c-00a80ce64cf2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-824652166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37d00748c91a42a9aa255f62e207a41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf37bb-28", "ovs_interfaceid": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:3a,bridge_name='br-int',has_traffic_filtering=True,id=8ccf37bb-28f1-4f69-ba57-e168eff668e4,network=Network(06579a46-8d95-4c64-940c-00a80ce64cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf37bb-28') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_vif [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:3a,bridge_name='br-int',has_traffic_filtering=True,id=8ccf37bb-28f1-4f69-ba57-e168eff668e4,network=Network(06579a46-8d95-4c64-940c-00a80ce64cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf37bb-28') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ccf37bb-28, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a943cd9-c31e-46fe-b95f-f188578a6e62) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:01 user nova-compute[75246]: INFO os_vif [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:3a,bridge_name='br-int',has_traffic_filtering=True,id=8ccf37bb-28f1-4f69-ba57-e168eff668e4,network=Network(06579a46-8d95-4c64-940c-00a80ce64cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf37bb-28')
Nov 28 17:02:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbstSmKj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:02:01 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.484s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] <== connect_volume: return (3263ms) {'type': 'block', 'scsi_wwn': '26664393863373230', 'path': '/dev/sdi'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664393863373230', 'path': '/dev/sdi'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.364s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lazy-loading 'flavor' on Instance uuid f6fe7bf7-782c-4660-9612-101c9f277903 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c61895-25da-4aee-958f-09206da4e33c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:02:01 user nova-compute[75246]: No targets found.
Nov 28 17:02:01 user nova-compute[75246]: iSNS:
Nov 28 17:02:01 user nova-compute[75246]: No targets found.
Nov 28 17:02:01 user nova-compute[75246]: STATIC:
Nov 28 17:02:01 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a
Nov 28 17:02:01 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:01 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:01 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047
Nov 28 17:02:01 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:01 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:01 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c
Nov 28 17:02:01 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:01 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:01 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1
Nov 28 17:02:01 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:01 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:01 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353
Nov 28 17:02:01 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:01 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:01 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f
Nov 28 17:02:01 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:01 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:01 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8
Nov 28 17:02:01 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:01 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:01 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2
Nov 28 17:02:01 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:01 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:01 user nova-compute[75246]: FIRMWARE:
Nov 28 17:02:01 user nova-compute[75246]: No targets found.
Nov 28 17:02:01 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:02:01 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:02:01 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:02:01 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:02:01 user nova-compute[75246]:   <source dev="/dev/sdi"/>
Nov 28 17:02:01 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:02:01 user nova-compute[75246]:   <serial>b396e853-b227-4072-b566-bc9dc97a0047</serial>
Nov 28 17:02:01 user nova-compute[75246]: </disk>
Nov 28 17:02:01 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd287c2-0d40-4b9d-9167-9176081f7b13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[530304e8-eece-4c32-ba8b-e48e4c9fb45b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:01 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:01 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:01 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:01 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:01 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:02:01 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:01 user nova-compute[75246]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:01 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:01 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:01 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:01 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:01 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:01 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:02:01 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:01 user nova-compute[75246]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:01 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f01e9870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1'): ({'sdb'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Removing single pathed devices sdb {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[930dbffd-dc39-488a-af9f-51faed57623b]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cf604a-dd5e-4b91-8b07-93f45dd8e196]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Flushing IO for device /dev/sdb {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72ab9b8-24d9-4bf0-8c09-c30a41423641]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e607a93-2b63-4d64-b50b-e110013e5221]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfe967d-a120-44b9-b617-37a2351f0173]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[af867ef7-a8a7-4716-b25b-2d1f7fabee5a]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1, portal: 172.16.0.220,3260]
Nov 28 17:02:02 user nova-compute[75246]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1, portal: 172.16.0.220,3260] successful.
Nov 28 17:02:02 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffa4261-4ea7-4eb0-876e-b7e881340bb4]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] <== disconnect_volume: return (765ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:02:02 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Deleting instance files /opt/stack/data/nova/instances/9f306608-7716-41e0-9aa0-afa8ba173a04_del
Nov 28 17:02:02 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Deletion of /opt/stack/data/nova/instances/9f306608-7716-41e0-9aa0-afa8ba173a04_del complete
Nov 28 17:02:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] No VIF found with MAC fa:16:3e:d6:6b:75, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75246) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 28 17:02:02 user nova-compute[75246]: INFO nova.virt.libvirt.host [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] UEFI support detected
Nov 28 17:02:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6d0ad5b7-54f7-4c6b-bb22-be4c9c1a2e38 tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "f6fe7bf7-782c-4660-9612-101c9f277903" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.347s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:02 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 9f306608-7716-41e0-9aa0-afa8ba173a04 could not be found.
Nov 28 17:02:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbstSmKj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:02:02 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 17:02:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8317b6-44ce-4143-9b0f-e9951bd63372]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:02:02 user nova-compute[75246]: No targets found.
Nov 28 17:02:02 user nova-compute[75246]: iSNS:
Nov 28 17:02:02 user nova-compute[75246]: No targets found.
Nov 28 17:02:02 user nova-compute[75246]: STATIC:
Nov 28 17:02:02 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a
Nov 28 17:02:02 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:02 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:02 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047
Nov 28 17:02:02 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:02 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:02 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c
Nov 28 17:02:02 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:02 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:02 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353
Nov 28 17:02:02 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:02 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:02 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f
Nov 28 17:02:02 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:02 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:02 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8
Nov 28 17:02:02 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:02 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:02 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2
Nov 28 17:02:02 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:02 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:02 user nova-compute[75246]: FIRMWARE:
Nov 28 17:02:02 user nova-compute[75246]: No targets found.
Nov 28 17:02:02 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:02:02 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:02:02 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-0bc51aaa-d8c9-4645-9fee-8d882acbdd2d req-996141cb-9923-4ca1-b0ba-3ec59a893dcb service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received event network-vif-plugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0bc51aaa-d8c9-4645-9fee-8d882acbdd2d req-996141cb-9923-4ca1-b0ba-3ec59a893dcb service nova] Acquiring lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0bc51aaa-d8c9-4645-9fee-8d882acbdd2d req-996141cb-9923-4ca1-b0ba-3ec59a893dcb service nova] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0bc51aaa-d8c9-4645-9fee-8d882acbdd2d req-996141cb-9923-4ca1-b0ba-3ec59a893dcb service nova] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-0bc51aaa-d8c9-4645-9fee-8d882acbdd2d req-996141cb-9923-4ca1-b0ba-3ec59a893dcb service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] No waiting events found dispatching network-vif-plugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:02 user nova-compute[75246]: WARNING nova.compute.manager [req-0bc51aaa-d8c9-4645-9fee-8d882acbdd2d req-996141cb-9923-4ca1-b0ba-3ec59a893dcb service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received unexpected event network-vif-plugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 for instance with vm_state active and task_state rebuilding.
Nov 28 17:02:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3daffb-174c-4c84-8a94-68e7d452bec1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8265bf4c-567b-47a5-8f04-9f3c28adbf15]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:02 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:02 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:02 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:02 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:02:02 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:02 user nova-compute[75246]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:02 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:02 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:02 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:02 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:02 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:02:02 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:02 user nova-compute[75246]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:02 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f80ecaf0>, {}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Disconnecting from: [] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.099s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] <== disconnect_volume: return (99ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:02:03 user nova-compute[75246]: DEBUG nova.compute.manager [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Preparing to wait for external event volume-reimaged-5a955b08-0696-4533-b17d-0e99d36216e1 {{(pid=75246) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 28 17:02:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquiring lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:03 user nova-compute[75246]: INFO nova.compute.manager [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Detaching volume bae0827b-8788-4aa7-9b54-ef14d23d886a
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.volume.cinder [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Update attachment failed for attachment 34afff74-d236-4d28-a770-a175119ccc82. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3bb5c994-0fec-42a6-bc80-b0a3a5248b1c) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3bb5c994-0fec-42a6-bc80-b0a3a5248b1c)
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Failed to attach eb572c9e-c19e-4350-90d8-530b085eae48 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3bb5c994-0fec-42a6-bc80-b0a3a5248b1c)
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Traceback (most recent call last):
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]     ret_val = method(obj, context, *args, **kwargs)
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]     self._do_attach(context, instance, volume, volume_api,
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]     self._volume_attach(context, volume, connector, instance,
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]     connection_info = volume_api.attachment_update(
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]     res = method(self, ctx, *args, **kwargs)
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]     with excutils.save_and_reraise_exception():
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]     self.force_reraise()
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]     raise self.value
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]     context, '3.44', skip_version_check=True).attachments.update(
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]     return method.func(obj, *args, **kwargs)
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]     resp = self._update('/attachments/%s' % id, body)
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]     return self._cs_request(url, 'PUT', **kwargs)
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]     return self.request(url, method, **kwargs)
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4]     raise exceptions.from_response(resp, body)
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3bb5c994-0fec-42a6-bc80-b0a3a5248b1c)
Nov 28 17:02:03 user nova-compute[75246]: ERROR nova.compute.manager [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] 
Nov 28 17:02:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.054s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:03 user nova-compute[75246]: INFO nova.virt.block_device [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Attempting to driver detach volume bae0827b-8788-4aa7-9b54-ef14d23d886a from mountpoint /dev/vdb
Nov 28 17:02:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Attempting to detach device vdb from instance 915bc61e-eaea-40c0-a5ed-4d2a677477f8 from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:02:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:02:03 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:02:03 user nova-compute[75246]:   <source dev="/dev/sdh"/>
Nov 28 17:02:03 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:02:03 user nova-compute[75246]:   <serial>bae0827b-8788-4aa7-9b54-ef14d23d886a</serial>
Nov 28 17:02:03 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:02:03 user nova-compute[75246]: </disk>
Nov 28 17:02:03 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:02:03 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Successfully detached device vdb from instance 915bc61e-eaea-40c0-a5ed-4d2a677477f8 from the persistent domain config.
Nov 28 17:02:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 915bc61e-eaea-40c0-a5ed-4d2a677477f8 from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:02:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:02:03 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:02:03 user nova-compute[75246]:   <source dev="/dev/sdh"/>
Nov 28 17:02:03 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:02:03 user nova-compute[75246]:   <serial>bae0827b-8788-4aa7-9b54-ef14d23d886a</serial>
Nov 28 17:02:03 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:02:03 user nova-compute[75246]: </disk>
Nov 28 17:02:03 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server [None req-7fd36584-0799-4e8d-9bb3-4d315b9c38aa tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3bb5c994-0fec-42a6-bc80-b0a3a5248b1c)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3bb5c994-0fec-42a6-bc80-b0a3a5248b1c)
Nov 28 17:02:03 user nova-compute[75246]: ERROR oslo_messaging.rpc.server 
Nov 28 17:02:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Acquiring lock "f6fe7bf7-782c-4660-9612-101c9f277903" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Lock "f6fe7bf7-782c-4660-9612-101c9f277903" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG os_brick.utils [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de9ecb9-7724-4e90-8067-52a35976db9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d34c80-3ba6-4916-b44c-e0f42efd57ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54e5b7a-13e9-4c1a-ba54-b7207d200176]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a05edc0-8571-4dc2-b182-4060a0ea9c4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:02:04 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:02:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[456fe5cf-301a-494f-9ef5-8e35a0933aac]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG os_brick.utils [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 915bc61e-eaea-40c0-a5ed-4d2a677477f8 {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:02:04 user nova-compute[75246]: INFO nova.compute.manager [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Swapping volume b396e853-b227-4072-b566-bc9dc97a0047 for 46eec365-ee40-488c-ab1d-296e8bfb0a17
Nov 28 17:02:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnBhQcIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:02:12 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:12 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:12 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d9a1d9-ebab-45ed-ba6a-fb60285d0039]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:02:12 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f632ef9d-9ca4-4892-b9b3-2ff1857d294b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633] added
Nov 28 17:02:12 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec54245f-4c80-4489-abf9-62f58c55affc]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a618aad6-a52e-4822-ae0b-47172ec7cded]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnBhQcIX {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnBhQcIX" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dff3bf-eae0-4077-9632-906858929a98]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jnBhQcIX'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf8faba-902a-41db-8ff5-b5994eee6663]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[172136cb-2aff-41cb-82c6-f5f4e94a6eda]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --login" returned: 0 in 0.131s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eae1563-fa1f-4da4-bb7b-d8317a59b884]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633, portal: 172.16.0.220,3260]
Nov 28 17:02:12 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633, portal: 172.16.0.220,3260] successful.
Nov 28 17:02:12 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e9e43f-ffa8-4ddc-b351-916761aa48fb]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[befd6704-e95d-4bda-a4de-c0c07f750aff]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:12 user nova-compute[75246]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:12 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:02:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:13 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4035c7f3-76f3-4105-8909-762936fc1231]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:13 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: None {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:02:13 user nova-compute[75246]: DEBUG nova.compute.manager [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dDvQHqCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f6fe7bf7-782c-4660-9612-101c9f277903', 'attached_at': '', 'detached_at': '', 'volume_id': '46eec365-ee40-488c-ab1d-296e8bfb0a17', 'serial': '46eec365-ee40-488c-ab1d-296e8bfb0a17'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRMWKwCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'f6fe7bf7-782c-4660-9612-101c9f277903', 'attached_at': '', 'detached_at': '', 'volume_id': 'b396e853-b227-4072-b566-bc9dc97a0047', 'serial'} {{(pid=75246) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 28 17:02:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:02:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dDvQHqCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:02:13 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:02:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnBhQcIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '26530306133616333', 'path': '/dev/sdb'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530306133616333', 'path': '/dev/sdb'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.753s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:14 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:14 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Lazy-loading 'flavor' on Instance uuid 24d45b28-61df-43cb-bdae-f8ce6b3aaca3 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[90246071-4719-4db4-bedc-4d6aa72da243]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:02:14 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] attach device xml: <disk type="block" device="disk">
Nov 28 17:02:14 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:02:14 user nova-compute[75246]:   <source dev="/dev/sdb"/>
Nov 28 17:02:14 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:02:14 user nova-compute[75246]:   <serial>939fb158-7a40-4076-be46-1a0a29b28633</serial>
Nov 28 17:02:14 user nova-compute[75246]: </disk>
Nov 28 17:02:14 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[55630193-0dda-4491-9c32-02d4161fbbf4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17] added
Nov 28 17:02:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2edfb34-f6d6-413e-9cad-941542ed5cf1]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b400de6-7a5c-4cac-bff1-0960a9694c20]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dDvQHqCF {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dDvQHqCF" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[496cfddf-5b33-4aef-ab25-d12eef8380fb]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dDvQHqCF'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[22477bf7-2f8a-427b-97e4-83a6ae7b7d44]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43092c5-4c58-4ae8-a221-4bb0b9437b03]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca71ea9-0fe2-40df-9df5-ad209e63dc8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17, portal: 172.16.0.220,3260]
Nov 28 17:02:14 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17, portal: 172.16.0.220,3260] successful.
Nov 28 17:02:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf4cd98-3769-4b54-9596-680737577717]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a6337d-44e6-4ec4-b2cf-82bb95e5f637]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:14 user nova-compute[75246]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14b41ff-9597-45f9-bd61-0bc6a2716142]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dDvQHqCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] No VIF found with MAC fa:16:3e:54:89:d5, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:02:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3f318142-67fd-4b45-83ae-a8e29dce8477 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.585s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] <== connect_volume: return (2142ms) {'type': 'block', 'scsi_wwn': '23033303565393833', 'path': '/dev/sdk'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033303565393833', 'path': '/dev/sdk'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:02:15 user nova-compute[75246]: DEBUG nova.objects.instance [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Lazy-loading 'flavor' on Instance uuid f6fe7bf7-782c-4660-9612-101c9f277903 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:02:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e3a8a02e-8882-44f2-9699-0e74289f71a4 tempest-VolumesAssistedSnapshotsTest-1397137874 tempest-VolumesAssistedSnapshotsTest-1397137874-project] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] volume_snapshot_create: create_info: {'snapshot_id': '7c7e543a-926c-4980-8b88-d74e8e705b41', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75246) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 28 17:02:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e3a8a02e-8882-44f2-9699-0e74289f71a4 tempest-VolumesAssistedSnapshotsTest-1397137874 tempest-VolumesAssistedSnapshotsTest-1397137874-project] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] snap xml: <domainsnapshot>
Nov 28 17:02:15 user nova-compute[75246]:   <disks>
Nov 28 17:02:15 user nova-compute[75246]:     <disk name="/dev/sdb" snapshot="external" type="file">
Nov 28 17:02:15 user nova-compute[75246]:       <source file="/dev/new_file"/>
Nov 28 17:02:15 user nova-compute[75246]:     </disk>
Nov 28 17:02:15 user nova-compute[75246]:     <disk name="vda" snapshot="no"/>
Nov 28 17:02:15 user nova-compute[75246]:   </disks>
Nov 28 17:02:15 user nova-compute[75246]: </domainsnapshot>
Nov 28 17:02:15 user nova-compute[75246]:  {{(pid=75246) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 28 17:02:15 user nova-compute[75246]: DEBUG nova.objects.instance [None req-e3a8a02e-8882-44f2-9699-0e74289f71a4 tempest-VolumesAssistedSnapshotsTest-1397137874 tempest-VolumesAssistedSnapshotsTest-1397137874-project] Lazy-loading 'system_metadata' on Instance uuid 24d45b28-61df-43cb-bdae-f8ce6b3aaca3 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:02:15 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-e3a8a02e-8882-44f2-9699-0e74289f71a4 tempest-VolumesAssistedSnapshotsTest-1397137874 tempest-VolumesAssistedSnapshotsTest-1397137874-project] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [None req-e3a8a02e-8882-44f2-9699-0e74289f71a4 tempest-VolumesAssistedSnapshotsTest-1397137874 tempest-VolumesAssistedSnapshotsTest-1397137874-project] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Traceback (most recent call last):
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     rv = execute(f, *args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     six.reraise(c, e, tb)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     raise value
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     rv = meth(*args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] 
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [None req-e3a8a02e-8882-44f2-9699-0e74289f71a4 tempest-VolumesAssistedSnapshotsTest-1397137874 tempest-VolumesAssistedSnapshotsTest-1397137874-project] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Traceback (most recent call last):
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     self._volume_snapshot_create(context, instance, guest,
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     rv = execute(f, *args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     six.reraise(c, e, tb)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     raise value
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     rv = meth(*args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] 
Nov 28 17:02:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-eac010a7-1311-4b41-ac9c-3c064e7efb69 tempest-VolumesAssistedSnapshotsTest-1397137874 tempest-VolumesAssistedSnapshotsTest-1397137874-project] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] volume_snapshot_delete: delete_info: {'volume_id': '939fb158-7a40-4076-be46-1a0a29b28633'} {{(pid=75246) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [None req-eac010a7-1311-4b41-ac9c-3c064e7efb69 tempest-VolumesAssistedSnapshotsTest-1397137874 tempest-VolumesAssistedSnapshotsTest-1397137874-project] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Traceback (most recent call last):
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3]     if delete_info['type'] != 'qcow2':
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] KeyError: 'type'
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] 
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [None req-e3a8a02e-8882-44f2-9699-0e74289f71a4 tempest-VolumesAssistedSnapshotsTest-1397137874 tempest-VolumesAssistedSnapshotsTest-1397137874-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 7c7e543a-926c-4980-8b88-d74e8e705b41 could not be found.
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     raise value
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver 
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver 
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 7c7e543a-926c-4980-8b88-d74e8e705b41 could not be found. (HTTP 404) (Request-ID: req-32a72ddc-2141-4f9c-a0ca-355e13298bd1)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver 
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver 
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 7c7e543a-926c-4980-8b88-d74e8e705b41 could not be found.
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver 
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server [None req-e3a8a02e-8882-44f2-9699-0e74289f71a4 tempest-VolumesAssistedSnapshotsTest-1397137874 tempest-VolumesAssistedSnapshotsTest-1397137874-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     raise value
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server 
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver [None req-eac010a7-1311-4b41-ac9c-3c064e7efb69 tempest-VolumesAssistedSnapshotsTest-1397137874 tempest-VolumesAssistedSnapshotsTest-1397137874-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver 
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver 
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-0a12c0fc-581c-497f-acc7-368c24c41ff7)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver 
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver 
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 28 17:02:15 user nova-compute[75246]: ERROR nova.virt.libvirt.driver 
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server [None req-eac010a7-1311-4b41-ac9c-3c064e7efb69 tempest-VolumesAssistedSnapshotsTest-1397137874 tempest-VolumesAssistedSnapshotsTest-1397137874-project] Exception during message handling: KeyError: 'type'
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 28 17:02:15 user nova-compute[75246]: ERROR oslo_messaging.rpc.server 
Nov 28 17:02:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Acquiring lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:16 user nova-compute[75246]: INFO nova.compute.manager [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Detaching volume 939fb158-7a40-4076-be46-1a0a29b28633
Nov 28 17:02:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 103809024 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:16 user nova-compute[75246]: INFO nova.virt.block_device [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Attempting to driver detach volume 939fb158-7a40-4076-be46-1a0a29b28633 from mountpoint /dev/vdb
Nov 28 17:02:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Attempting to detach device vdb from instance 24d45b28-61df-43cb-bdae-f8ce6b3aaca3 from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:02:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] detach device xml: <disk type="block" device="disk">
Nov 28 17:02:16 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:02:16 user nova-compute[75246]:   <source dev="/dev/sdb"/>
Nov 28 17:02:16 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:02:16 user nova-compute[75246]:   <serial>939fb158-7a40-4076-be46-1a0a29b28633</serial>
Nov 28 17:02:16 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:02:16 user nova-compute[75246]: </disk>
Nov 28 17:02:16 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:02:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Successfully detached device vdb from instance 24d45b28-61df-43cb-bdae-f8ce6b3aaca3 from the persistent domain config.
Nov 28 17:02:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24d45b28-61df-43cb-bdae-f8ce6b3aaca3 from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:02:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] detach device xml: <disk type="block" device="disk">
Nov 28 17:02:16 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:02:16 user nova-compute[75246]:   <source dev="/dev/sdb"/>
Nov 28 17:02:16 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:02:16 user nova-compute[75246]:   <serial>939fb158-7a40-4076-be46-1a0a29b28633</serial>
Nov 28 17:02:16 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:02:16 user nova-compute[75246]: </disk>
Nov 28 17:02:16 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:02:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 269484032 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24d45b28-61df-43cb-bdae-f8ce6b3aaca3 {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:02:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:02:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 406847488 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 558891008 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 601882624 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 621805568 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:02:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:02:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 685768704 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 741343232 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:19 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:02:19 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:02:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:02:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:02:20 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:02:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-efdab10e-8959-4f3a-a03f-2be734c633cc req-89a9b985-56b9-4e96-bc6e-5acd3e735ccd service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-changed-7f38967b-bb53-4627-ad7f-6324098159a9 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-efdab10e-8959-4f3a-a03f-2be734c633cc req-89a9b985-56b9-4e96-bc6e-5acd3e735ccd service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Refreshing instance network info cache due to event network-changed-7f38967b-bb53-4627-ad7f-6324098159a9. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:02:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-efdab10e-8959-4f3a-a03f-2be734c633cc req-89a9b985-56b9-4e96-bc6e-5acd3e735ccd service nova] Acquiring lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:02:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-efdab10e-8959-4f3a-a03f-2be734c633cc req-89a9b985-56b9-4e96-bc6e-5acd3e735ccd service nova] Acquired lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:02:20 user nova-compute[75246]: DEBUG nova.network.neutron [req-efdab10e-8959-4f3a-a03f-2be734c633cc req-89a9b985-56b9-4e96-bc6e-5acd3e735ccd service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Refreshing network info cache for port 7f38967b-bb53-4627-ad7f-6324098159a9 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:02:20 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 823132160 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:20 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 895483904 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Updating instance_info_cache with network_info: [{"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:02:21 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance e0df8b51-bda3-4c45-ab54-c6097f6136ad is timed out.
Nov 28 17:02:21 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Successfully detached device sdc from instance e0df8b51-bda3-4c45-ab54-c6097f6136ad from the live domain config.
Nov 28 17:02:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNVuowsS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:02:21 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c951549-afd7-405c-81da-716384e463d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:02:21 user nova-compute[75246]: No targets found.
Nov 28 17:02:21 user nova-compute[75246]: iSNS:
Nov 28 17:02:21 user nova-compute[75246]: No targets found.
Nov 28 17:02:21 user nova-compute[75246]: STATIC:
Nov 28 17:02:21 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a
Nov 28 17:02:21 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:21 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:21 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047
Nov 28 17:02:21 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:21 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:21 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c
Nov 28 17:02:21 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:21 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:21 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633
Nov 28 17:02:21 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:21 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:21 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1
Nov 28 17:02:21 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:21 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:21 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353
Nov 28 17:02:21 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:21 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:21 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17
Nov 28 17:02:21 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:21 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:21 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f
Nov 28 17:02:21 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:21 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:21 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8
Nov 28 17:02:21 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:21 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:21 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2
Nov 28 17:02:21 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:21 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:21 user nova-compute[75246]: FIRMWARE:
Nov 28 17:02:21 user nova-compute[75246]: No targets found.
Nov 28 17:02:21 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:02:21 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:02:21 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[18444fe9-910f-4eb0-b0f7-b7e9d4486004]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a185b503-5944-4f84-ad1b-6492070ad447]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG nova.network.neutron [req-efdab10e-8959-4f3a-a03f-2be734c633cc req-89a9b985-56b9-4e96-bc6e-5acd3e735ccd service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Updated VIF entry in instance network info cache for port 7f38967b-bb53-4627-ad7f-6324098159a9. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG nova.network.neutron [req-efdab10e-8959-4f3a-a03f-2be734c633cc req-89a9b985-56b9-4e96-bc6e-5acd3e735ccd service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Updating instance_info_cache with network_info: [{"id": "7f38967b-bb53-4627-ad7f-6324098159a9", "address": "fa:16:3e:0e:49:2c", "network": {"id": "5d735e77-2be9-47ce-bff7-55da5c0432ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1287968723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f38967b-bb", "ovs_interfaceid": "7f38967b-bb53-4627-ad7f-6324098159a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "address": "fa:16:3e:ca:43:c6", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c207a6f-3e", "ovs_interfaceid": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "address": "fa:16:3e:56:1a:9d", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f041c8c-a9", "ovs_interfaceid": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "address": "fa:16:3e:05:5e:e3", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ae7951-da", "ovs_interfaceid": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "address": "fa:16:3e:e6:6e:f2", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a556d5f-62", "ovs_interfaceid": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56971077-b127-4c9f-897f-22d420785295", "address": "fa:16:3e:a9:3c:06", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56971077-b1", "ovs_interfaceid": "56971077-b127-4c9f-897f-22d420785295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a46959c2-cd58-410c-8cdb-054015f1794a", "address": "fa:16:3e:4b:1c:67", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46959c2-cd", "ovs_interfaceid": "a46959c2-cd58-410c-8cdb-054015f1794a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:21 user nova-compute[75246]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:21 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:21 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:21 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:21 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:21 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:21 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:02:21 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:21 user nova-compute[75246]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:21 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:21 user nova-compute[75246]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:21 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:21 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:21 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:21 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:21 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:21 user nova-compute[75246]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f (non-flash)
Nov 28 17:02:21 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:21 user nova-compute[75246]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:21 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d83f6f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f'): ({'sdg'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Removing single pathed devices sdg {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 924844032 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2e0abb-6438-4716-a8d9-47c209cf1d8d]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f5ddc9-14ca-4d35-ae5a-5e7fbc0cf4cd]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Flushing IO for device /dev/sdg {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d03dfc3-43d0-46e2-ad58-473a093cb326]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-efdab10e-8959-4f3a-a03f-2be734c633cc req-89a9b985-56b9-4e96-bc6e-5acd3e735ccd service nova] Releasing lock "refresh_cache-04c31ea4-faaa-4289-8930-9406865e6705" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[076177a3-ef4d-4ad8-8cec-62b4b5e3b471]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] SCSI volumes sdg have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3073f4c-9d71-48b4-8e60-ffab22613306]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2148d887-8957-4c29-b209-b61679724b4a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f, portal: 172.16.0.220,3260]
Nov 28 17:02:21 user nova-compute[75246]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f, portal: 172.16.0.220,3260] successful.
Nov 28 17:02:21 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e959eb7-e633-4c37-a2e2-4ecca532ba2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b22869-926a-42a8-a235-2249d4753172]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.517s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] <== disconnect_volume: return (525ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:02:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 1067450368 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRMWKwCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:02:22 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:02:22 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8a5214-d919-4144-b740-b782212b0abd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:02:22 user nova-compute[75246]: No targets found.
Nov 28 17:02:22 user nova-compute[75246]: iSNS:
Nov 28 17:02:22 user nova-compute[75246]: No targets found.
Nov 28 17:02:22 user nova-compute[75246]: STATIC:
Nov 28 17:02:22 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a
Nov 28 17:02:22 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:22 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:22 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047
Nov 28 17:02:22 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:22 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:22 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c
Nov 28 17:02:22 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:22 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:22 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633
Nov 28 17:02:22 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:22 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:22 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1
Nov 28 17:02:22 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:22 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:22 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353
Nov 28 17:02:22 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:22 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:22 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17
Nov 28 17:02:22 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:22 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:22 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8
Nov 28 17:02:22 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:22 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:22 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2
Nov 28 17:02:22 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:22 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:22 user nova-compute[75246]: FIRMWARE:
Nov 28 17:02:22 user nova-compute[75246]: No targets found.
Nov 28 17:02:22 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:02:22 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:02:22 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f1ce44-6948-4f46-8165-ceabeb30d989]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[57636a74-888e-49d7-8444-f32234a2a5c0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:22 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:22 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:22 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:22 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:22 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:22 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:22 user nova-compute[75246]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:22 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:22 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:22 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:22 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:22 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:22 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:22 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:22 user nova-compute[75246]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:22 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d87c3910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047'): ({'sdi'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Removing single pathed devices sdi {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG nova.objects.instance [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lazy-loading 'flavor' on Instance uuid e0df8b51-bda3-4c45-ab54-c6097f6136ad {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[feea139b-ccdd-40e2-9472-0799be256e61]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f880d871-f863-4e83-980b-016c70c682f0]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Flushing IO for device /dev/sdi {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-17fbc06b-9d12-42ca-8d00-c9c90f8b56d9 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.658s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b16e98-6e2f-40e8-a9ac-b7e6c53ea3c5]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.053s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[431efe2f-2140-4c2b-a2da-e634f0ececf2]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] SCSI volumes sdi have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[210f0d40-c016-41db-8eb1-ad04a43e186b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:22 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[85917172-c93d-447d-9958-7c72bbecfcdc]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047, portal: 172.16.0.220,3260]
Nov 28 17:02:23 user nova-compute[75246]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047, portal: 172.16.0.220,3260] successful.
Nov 28 17:02:23 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe32e36d-2686-455d-9355-1cb32f648506]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] <== disconnect_volume: return (426ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG nova.compute.manager [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dDvQHqCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': 'f6fe7bf7-782c-4660-9612-101c9f277903', 'attached_at': '', 'detached_at': '', 'volume_id': '46eec365-ee40-488c-ab1d-296e8bfb0a17', 'serial'} {{(pid=75246) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG nova.compute.manager [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] swap_volume: removing Cinder connection for volume b396e853-b227-4072-b566-bc9dc97a0047 {{(pid=75246) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "04c31ea4-faaa-4289-8930-9406865e6705" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:23 user nova-compute[75246]: INFO nova.compute.manager [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Terminating instance
Nov 28 17:02:23 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Acquiring lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Acquiring lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:23 user nova-compute[75246]: INFO nova.compute.manager [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Terminating instance
Nov 28 17:02:23 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-b24e5e4a-e3ba-4ee9-8f38-13ddc8609caa req-15f415c8-f403-44f4-abed-020b5d130cb0 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-unplugged-7f38967b-bb53-4627-ad7f-6324098159a9 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b24e5e4a-e3ba-4ee9-8f38-13ddc8609caa req-15f415c8-f403-44f4-abed-020b5d130cb0 service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b24e5e4a-e3ba-4ee9-8f38-13ddc8609caa req-15f415c8-f403-44f4-abed-020b5d130cb0 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b24e5e4a-e3ba-4ee9-8f38-13ddc8609caa req-15f415c8-f403-44f4-abed-020b5d130cb0 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-b24e5e4a-e3ba-4ee9-8f38-13ddc8609caa req-15f415c8-f403-44f4-abed-020b5d130cb0 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-unplugged-7f38967b-bb53-4627-ad7f-6324098159a9 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-b24e5e4a-e3ba-4ee9-8f38-13ddc8609caa req-15f415c8-f403-44f4-abed-020b5d130cb0 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-unplugged-7f38967b-bb53-4627-ad7f-6324098159a9 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-92b08d6e-dd80-4b85-b2a3-b08f118fea64 req-af02e7d0-7935-464c-8155-b56cc6faefe3 service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Received event network-vif-unplugged-26780137-c1a5-41f0-9c41-e2b2cf450405 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-92b08d6e-dd80-4b85-b2a3-b08f118fea64 req-af02e7d0-7935-464c-8155-b56cc6faefe3 service nova] Acquiring lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-92b08d6e-dd80-4b85-b2a3-b08f118fea64 req-af02e7d0-7935-464c-8155-b56cc6faefe3 service nova] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-92b08d6e-dd80-4b85-b2a3-b08f118fea64 req-af02e7d0-7935-464c-8155-b56cc6faefe3 service nova] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-92b08d6e-dd80-4b85-b2a3-b08f118fea64 req-af02e7d0-7935-464c-8155-b56cc6faefe3 service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] No waiting events found dispatching network-vif-unplugged-26780137-c1a5-41f0-9c41-e2b2cf450405 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-92b08d6e-dd80-4b85-b2a3-b08f118fea64 req-af02e7d0-7935-464c-8155-b56cc6faefe3 service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Received event network-vif-unplugged-26780137-c1a5-41f0-9c41-e2b2cf450405 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG nova.compute.manager [req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c req-2359231b-5cb0-4fc2-bafd-064ff09f94f3 service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received event volume-reimaged-5a955b08-0696-4533-b17d-0e99d36216e1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c req-2359231b-5cb0-4fc2-bafd-064ff09f94f3 service nova] Acquiring lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c req-2359231b-5cb0-4fc2-bafd-064ff09f94f3 service nova] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c req-2359231b-5cb0-4fc2-bafd-064ff09f94f3 service nova] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG nova.compute.manager [req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c req-2359231b-5cb0-4fc2-bafd-064ff09f94f3 service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Processing event volume-reimaged-5a955b08-0696-4533-b17d-0e99d36216e1 {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG nova.compute.manager [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Instance event wait completed in 20 seconds for volume-reimaged {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG nova.compute.manager [req-512a1436-b69d-4eb1-981e-7dfd41098607 req-63bc58b2-e648-4c8a-bf67-f86f41f0b49d service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-unplugged-53ae7951-da14-4dcb-bf28-16f035e3d01b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-512a1436-b69d-4eb1-981e-7dfd41098607 req-63bc58b2-e648-4c8a-bf67-f86f41f0b49d service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-512a1436-b69d-4eb1-981e-7dfd41098607 req-63bc58b2-e648-4c8a-bf67-f86f41f0b49d service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-512a1436-b69d-4eb1-981e-7dfd41098607 req-63bc58b2-e648-4c8a-bf67-f86f41f0b49d service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG nova.compute.manager [req-512a1436-b69d-4eb1-981e-7dfd41098607 req-63bc58b2-e648-4c8a-bf67-f86f41f0b49d service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-unplugged-53ae7951-da14-4dcb-bf28-16f035e3d01b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG nova.compute.manager [req-512a1436-b69d-4eb1-981e-7dfd41098607 req-63bc58b2-e648-4c8a-bf67-f86f41f0b49d service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-unplugged-53ae7951-da14-4dcb-bf28-16f035e3d01b for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:24 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Instance destroyed successfully.
Nov 28 17:02:24 user nova-compute[75246]: DEBUG nova.objects.instance [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lazy-loading 'resources' on Instance uuid e0df8b51-bda3-4c45-ab54-c6097f6136ad {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T16:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-837581652',display_name='tempest-AttachSCSIVolumeTestJSON-server-837581652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-837581652',id=6,image_ref='6ec16204-ddec-48db-8b46-68c22470c751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWDNMUX1bRPsmt/iVFeejvhXsdDdxxYQeAutD/RP2MdG599hA1KhdrBKcVjNx2MlkxRinQObD5H7uB4twopw3/j8vacwCw4mwnnxuFJraohMJG4xrZaP5eVkd9ib2Ab5A==',key_name='tempest-keypair-18747782',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:00:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8690f10b04e44af49d2a459f88573ecd',ramdisk_id='',reservation_id='r-3z30xpqt',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec16204-ddec-48db-8b46-68c22470c751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-884776922',owner_user_name='tempest-AttachSCSIVolumeTestJSON-884776922-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:00:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbd0260065a347f7a0256138a726607a',uuid=e0df8b51-bda3-4c45-ab54-c6097f6136ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26780137-c1a5-41f0-9c41-e2b2cf450405", "address": "fa:16:3e:b2:ec:27", "network": {"id": "a530cf40-41ff-4ed1-8b02-264d7b7830c8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-656328324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8690f10b04e44af49d2a459f88573ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26780137-c1", "ovs_interfaceid": "26780137-c1a5-41f0-9c41-e2b2cf450405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Converting VIF {"id": "26780137-c1a5-41f0-9c41-e2b2cf450405", "address": "fa:16:3e:b2:ec:27", "network": {"id": "a530cf40-41ff-4ed1-8b02-264d7b7830c8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-656328324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8690f10b04e44af49d2a459f88573ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26780137-c1", "ovs_interfaceid": "26780137-c1a5-41f0-9c41-e2b2cf450405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:ec:27,bridge_name='br-int',has_traffic_filtering=True,id=26780137-c1a5-41f0-9c41-e2b2cf450405,network=Network(a530cf40-41ff-4ed1-8b02-264d7b7830c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26780137-c1') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_vif [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:ec:27,bridge_name='br-int',has_traffic_filtering=True,id=26780137-c1a5-41f0-9c41-e2b2cf450405,network=Network(a530cf40-41ff-4ed1-8b02-264d7b7830c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26780137-c1') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26780137-c1, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:24 user nova-compute[75246]: INFO nova.virt.block_device [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Booting with volume 5a955b08-0696-4533-b17d-0e99d36216e1 at /dev/vda
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1358a444-8765-4863-a9b6-9b0e53eaff51/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.utils [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[475b0bd1-5879-430e-98c3-4a9325b30142]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2166bbc1-0e56-4e49-a39a-01414beaa61b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae062476-6c20-4d02-8cea-766154d79751) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:24 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 915bc61e-eaea-40c0-a5ed-4d2a677477f8 is timed out.
Nov 28 17:02:24 user nova-compute[75246]: DEBUG nova.compute.manager [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] swap_volume: Updating volume b396e853-b227-4072-b566-bc9dc97a0047 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "dDvQHqCF", "auth_password": "cO1V6hvStmWzKX", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "46eec365-ee40-488c-ab1d-296e8bfb0a17"}, "status": "reserved", "instance": "f6fe7bf7-782c-4660-9612-101c9f277903", "attached_at": "", "detached_at": "", "volume_id": "46eec365-ee40-488c-ab1d-296e8bfb0a17", "serial": "46eec365-ee40-488c-ab1d-296e8bfb0a17"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '46eec365-ee40-488c-ab1d-296e8bfb0a17', 'no_device': None, 'attachment_id': '7b39c575-89b1-4dfe-8530-e1ade39effe6'} {{(pid=75246) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1197f547-9a16-4ce6-8ea9-a1e8dac59ba7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caf8520-fed9-4a88-8012-fa1f577f3978]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:02:24 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Successfully detached device vdb from instance 915bc61e-eaea-40c0-a5ed-4d2a677477f8 from the live domain config.
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-683057bc-b783-45c8-ba7d-00318ebd5c66 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Lock "f6fe7bf7-782c-4660-9612-101c9f277903" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.287s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nECbgNyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:02:24 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:02:24 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[597f4a06-1a97-4e66-987f-cf605e824462]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1358a444-8765-4863-a9b6-9b0e53eaff51/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.utils [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Updating existing volume attachment record: 2e33e264-9297-42ff-a4d9-bd41e89e32c3 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1358a444-8765-4863-a9b6-9b0e53eaff51/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d568cf2-464b-4034-9e26-1d775b1ee4f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:02:24 user nova-compute[75246]: No targets found.
Nov 28 17:02:24 user nova-compute[75246]: iSNS:
Nov 28 17:02:24 user nova-compute[75246]: No targets found.
Nov 28 17:02:24 user nova-compute[75246]: STATIC:
Nov 28 17:02:24 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a
Nov 28 17:02:24 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:24 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:24 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c
Nov 28 17:02:24 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:24 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:24 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633
Nov 28 17:02:24 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:24 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:24 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353
Nov 28 17:02:24 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:24 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:24 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17
Nov 28 17:02:24 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:24 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:24 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8
Nov 28 17:02:24 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:24 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:24 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2
Nov 28 17:02:24 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:24 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:24 user nova-compute[75246]: FIRMWARE:
Nov 28 17:02:24 user nova-compute[75246]: No targets found.
Nov 28 17:02:24 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:02:24 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:02:24 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:24 user nova-compute[75246]: INFO os_vif [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:ec:27,bridge_name='br-int',has_traffic_filtering=True,id=26780137-c1a5-41f0-9c41-e2b2cf450405,network=Network(a530cf40-41ff-4ed1-8b02-264d7b7830c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26780137-c1')
Nov 28 17:02:24 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Deleting instance files /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad_del
Nov 28 17:02:24 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Deletion of /opt/stack/data/nova/instances/e0df8b51-bda3-4c45-ab54-c6097f6136ad_del complete
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d66c9a-1509-48fb-b82d-c59501ae8526]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e9a762-8714-40b8-82a3-4c2ca2ad71df]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:24 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:24 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:24 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:24 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:24 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:24 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:24 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:24 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:24 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:24 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:24 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:24 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:24 user nova-compute[75246]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a (non-flash)
Nov 28 17:02:24 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d83c2680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a'): ({'sdh'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Removing single pathed devices sdh {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dfe952-5225-428c-bd3c-77ee53ed004a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1358a444-8765-4863-a9b6-9b0e53eaff51/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7842a4c5-5181-4a84-bd39-be133eac7d22]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Flushing IO for device /dev/sdh {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[197f2076-2811-4e01-9bec-49b5116c7fc1]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:24 user nova-compute[75246]: INFO nova.compute.manager [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Took 1.46 seconds to destroy the instance on the hypervisor.
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.062s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0962ab8e-253a-4597-afa4-305fab2989f9]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] SCSI volumes sdh have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23939316262343736', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1fae00c0', '/dev/disk/by-id/scsi-1SCST_BIO1fae00c0-991bb4760adad5c7') {{(pid=85745) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a775b8ba-0f35-48c3-bb2b-3b5a00578021]: (4, None) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:02:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[249927ce-a31b-443b-94e1-eccd53b1bf75]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --logout" returned: 0 in 0.194s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d6bc3f-f7a7-4281-8411-469946c898d0]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a, portal: 172.16.0.220,3260]
Nov 28 17:02:25 user nova-compute[75246]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a, portal: 172.16.0.220,3260] successful.
Nov 28 17:02:25 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae0827b-8788-4aa7-9b54-ef14d23d886a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be9dbe3-26f6-4925-a619-2afc3a2d4609]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.697s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] <== disconnect_volume: return (699ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Acquiring lock "f6fe7bf7-782c-4660-9612-101c9f277903" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Lock "f6fe7bf7-782c-4660-9612-101c9f277903" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG os_brick.utils [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0101286-5214-4bde-a0d0-79df81557fb8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:25 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Instance destroyed successfully.
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.objects.instance [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lazy-loading 'resources' on Instance uuid 04c31ea4-faaa-4289-8930-9406865e6705 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6446457f-88b1-447c-8889-ec06f64c24f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f38967b-bb53-4627-ad7f-6324098159a9", "address": "fa:16:3e:0e:49:2c", "network": {"id": "5d735e77-2be9-47ce-bff7-55da5c0432ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1287968723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f38967b-bb", "ovs_interfaceid": "7f38967b-bb53-4627-ad7f-6324098159a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "7f38967b-bb53-4627-ad7f-6324098159a9", "address": "fa:16:3e:0e:49:2c", "network": {"id": "5d735e77-2be9-47ce-bff7-55da5c0432ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1287968723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f38967b-bb", "ovs_interfaceid": "7f38967b-bb53-4627-ad7f-6324098159a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:49:2c,bridge_name='br-int',has_traffic_filtering=True,id=7f38967b-bb53-4627-ad7f-6324098159a9,network=Network(5d735e77-2be9-47ce-bff7-55da5c0432ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f38967b-bb') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG os_vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:49:2c,bridge_name='br-int',has_traffic_filtering=True,id=7f38967b-bb53-4627-ad7f-6324098159a9,network=Network(5d735e77-2be9-47ce-bff7-55da5c0432ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f38967b-bb') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f38967b-bb, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbaf6e3-876f-41c6-ba57-43868e0a4e46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[733bdecf-435c-4750-9786-aa39ea5b069e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9bb388c-6f16-43ac-af55-830dfe0129c4) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:02:25 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[741caa54-4267-4b30-9315-2b06e46df3a9]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG os_brick.utils [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:25 user nova-compute[75246]: INFO os_vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:49:2c,bridge_name='br-int',has_traffic_filtering=True,id=7f38967b-bb53-4627-ad7f-6324098159a9,network=Network(5d735e77-2be9-47ce-bff7-55da5c0432ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f38967b-bb')
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "address": "fa:16:3e:ca:43:c6", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c207a6f-3e", "ovs_interfaceid": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "address": "fa:16:3e:ca:43:c6", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c207a6f-3e", "ovs_interfaceid": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:43:c6,bridge_name='br-int',has_traffic_filtering=True,id=0c207a6f-3e99-4122-8b4b-bf433d46193f,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0c207a6f-3e') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG os_vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:43:c6,bridge_name='br-int',has_traffic_filtering=True,id=0c207a6f-3e99-4122-8b4b-bf433d46193f,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0c207a6f-3e') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c207a6f-3e, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=198809e3-8bd4-40f2-8d04-732726367a80) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:25 user nova-compute[75246]: INFO nova.compute.manager [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Swapping volume 46eec365-ee40-488c-ab1d-296e8bfb0a17 for b396e853-b227-4072-b566-bc9dc97a0047
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-d9ba274e-6c80-4b36-91c8-6ef210dc47e0 req-112be1e9-82f3-4fc5-9d1b-5320926bc508 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-7f38967b-bb53-4627-ad7f-6324098159a9 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d9ba274e-6c80-4b36-91c8-6ef210dc47e0 req-112be1e9-82f3-4fc5-9d1b-5320926bc508 service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d9ba274e-6c80-4b36-91c8-6ef210dc47e0 req-112be1e9-82f3-4fc5-9d1b-5320926bc508 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d9ba274e-6c80-4b36-91c8-6ef210dc47e0 req-112be1e9-82f3-4fc5-9d1b-5320926bc508 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-d9ba274e-6c80-4b36-91c8-6ef210dc47e0 req-112be1e9-82f3-4fc5-9d1b-5320926bc508 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-7f38967b-bb53-4627-ad7f-6324098159a9 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:25 user nova-compute[75246]: WARNING nova.compute.manager [req-d9ba274e-6c80-4b36-91c8-6ef210dc47e0 req-112be1e9-82f3-4fc5-9d1b-5320926bc508 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-7f38967b-bb53-4627-ad7f-6324098159a9 for instance with vm_state active and task_state deleting.
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-d9ba274e-6c80-4b36-91c8-6ef210dc47e0 req-112be1e9-82f3-4fc5-9d1b-5320926bc508 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-unplugged-0c207a6f-3e99-4122-8b4b-bf433d46193f {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d9ba274e-6c80-4b36-91c8-6ef210dc47e0 req-112be1e9-82f3-4fc5-9d1b-5320926bc508 service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d9ba274e-6c80-4b36-91c8-6ef210dc47e0 req-112be1e9-82f3-4fc5-9d1b-5320926bc508 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d9ba274e-6c80-4b36-91c8-6ef210dc47e0 req-112be1e9-82f3-4fc5-9d1b-5320926bc508 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-d9ba274e-6c80-4b36-91c8-6ef210dc47e0 req-112be1e9-82f3-4fc5-9d1b-5320926bc508 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-unplugged-0c207a6f-3e99-4122-8b4b-bf433d46193f {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-d9ba274e-6c80-4b36-91c8-6ef210dc47e0 req-112be1e9-82f3-4fc5-9d1b-5320926bc508 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-unplugged-0c207a6f-3e99-4122-8b4b-bf433d46193f for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-d9ba274e-6c80-4b36-91c8-6ef210dc47e0 req-112be1e9-82f3-4fc5-9d1b-5320926bc508 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-0c207a6f-3e99-4122-8b4b-bf433d46193f {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d9ba274e-6c80-4b36-91c8-6ef210dc47e0 req-112be1e9-82f3-4fc5-9d1b-5320926bc508 service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d9ba274e-6c80-4b36-91c8-6ef210dc47e0 req-112be1e9-82f3-4fc5-9d1b-5320926bc508 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d9ba274e-6c80-4b36-91c8-6ef210dc47e0 req-112be1e9-82f3-4fc5-9d1b-5320926bc508 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-d9ba274e-6c80-4b36-91c8-6ef210dc47e0 req-112be1e9-82f3-4fc5-9d1b-5320926bc508 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-0c207a6f-3e99-4122-8b4b-bf433d46193f {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:25 user nova-compute[75246]: WARNING nova.compute.manager [req-d9ba274e-6c80-4b36-91c8-6ef210dc47e0 req-112be1e9-82f3-4fc5-9d1b-5320926bc508 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-0c207a6f-3e99-4122-8b4b-bf433d46193f for instance with vm_state active and task_state deleting.
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:25 user nova-compute[75246]: INFO os_vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:43:c6,bridge_name='br-int',has_traffic_filtering=True,id=0c207a6f-3e99-4122-8b4b-bf433d46193f,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0c207a6f-3e')
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "address": "fa:16:3e:56:1a:9d", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f041c8c-a9", "ovs_interfaceid": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "address": "fa:16:3e:56:1a:9d", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f041c8c-a9", "ovs_interfaceid": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:1a:9d,bridge_name='br-int',has_traffic_filtering=True,id=8f041c8c-a943-41bd-8ea1-7629e2635d6c,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8f041c8c-a9') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG os_vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:1a:9d,bridge_name='br-int',has_traffic_filtering=True,id=8f041c8c-a943-41bd-8ea1-7629e2635d6c,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8f041c8c-a9') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f041c8c-a9, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5827f9d4-368c-4a74-9e3e-671778cefc27) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Received event network-vif-plugged-26780137-c1a5-41f0-9c41-e2b2cf450405 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] Acquiring lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] No waiting events found dispatching network-vif-plugged-26780137-c1a5-41f0-9c41-e2b2cf450405 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:26 user nova-compute[75246]: WARNING nova.compute.manager [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Received unexpected event network-vif-plugged-26780137-c1a5-41f0-9c41-e2b2cf450405 for instance with vm_state active and task_state deleting.
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-unplugged-8f041c8c-a943-41bd-8ea1-7629e2635d6c {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-unplugged-8f041c8c-a943-41bd-8ea1-7629e2635d6c {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-unplugged-8f041c8c-a943-41bd-8ea1-7629e2635d6c for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-8f041c8c-a943-41bd-8ea1-7629e2635d6c {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-8f041c8c-a943-41bd-8ea1-7629e2635d6c {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:26 user nova-compute[75246]: WARNING nova.compute.manager [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-8f041c8c-a943-41bd-8ea1-7629e2635d6c for instance with vm_state active and task_state deleting.
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-unplugged-56971077-b127-4c9f-897f-22d420785295 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-unplugged-56971077-b127-4c9f-897f-22d420785295 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-unplugged-56971077-b127-4c9f-897f-22d420785295 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-56971077-b127-4c9f-897f-22d420785295 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-56971077-b127-4c9f-897f-22d420785295 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:26 user nova-compute[75246]: WARNING nova.compute.manager [req-6fba7484-78fd-46fa-bca1-45d96e7131ec req-760f22fe-7404-47c0-b582-97f6978e6d75 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-56971077-b127-4c9f-897f-22d420785295 for instance with vm_state active and task_state deleting.
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-53ae7951-da14-4dcb-bf28-16f035e3d01b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-53ae7951-da14-4dcb-bf28-16f035e3d01b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:26 user nova-compute[75246]: WARNING nova.compute.manager [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-53ae7951-da14-4dcb-bf28-16f035e3d01b for instance with vm_state active and task_state deleting.
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-unplugged-1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-unplugged-1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-unplugged-1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:26 user nova-compute[75246]: WARNING nova.compute.manager [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1 for instance with vm_state active and task_state deleting.
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-unplugged-a46959c2-cd58-410c-8cdb-054015f1794a {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-unplugged-a46959c2-cd58-410c-8cdb-054015f1794a {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-unplugged-a46959c2-cd58-410c-8cdb-054015f1794a for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-plugged-a46959c2-cd58-410c-8cdb-054015f1794a {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] Acquiring lock "04c31ea4-faaa-4289-8930-9406865e6705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] Lock "04c31ea4-faaa-4289-8930-9406865e6705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] No waiting events found dispatching network-vif-plugged-a46959c2-cd58-410c-8cdb-054015f1794a {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:26 user nova-compute[75246]: WARNING nova.compute.manager [req-f3e1cf72-970f-4553-806c-10302b4cf2cf req-e799b1e9-8b43-477f-9870-8900b7457c2b service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received unexpected event network-vif-plugged-a46959c2-cd58-410c-8cdb-054015f1794a for instance with vm_state active and task_state deleting.
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:26 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:02:26 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=6800MB free_disk=25.56372833251953GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:26 user nova-compute[75246]: INFO os_vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:1a:9d,bridge_name='br-int',has_traffic_filtering=True,id=8f041c8c-a943-41bd-8ea1-7629e2635d6c,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8f041c8c-a9')
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "address": "fa:16:3e:05:5e:e3", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ae7951-da", "ovs_interfaceid": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "address": "fa:16:3e:05:5e:e3", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ae7951-da", "ovs_interfaceid": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:e3,bridge_name='br-int',has_traffic_filtering=True,id=53ae7951-da14-4dcb-bf28-16f035e3d01b,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ae7951-da') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:e3,bridge_name='br-int',has_traffic_filtering=True,id=53ae7951-da14-4dcb-bf28-16f035e3d01b,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ae7951-da') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53ae7951-da, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:26 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Took 1.60 seconds to deallocate network for instance.
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=098cb838-6912-46cb-9545-9f77c12a0a86) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: INFO os_vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:e3,bridge_name='br-int',has_traffic_filtering=True,id=53ae7951-da14-4dcb-bf28-16f035e3d01b,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ae7951-da')
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "address": "fa:16:3e:e6:6e:f2", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a556d5f-62", "ovs_interfaceid": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "address": "fa:16:3e:e6:6e:f2", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a556d5f-62", "ovs_interfaceid": "1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:6e:f2,bridge_name='br-int',has_traffic_filtering=True,id=1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a556d5f-62') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:6e:f2,bridge_name='br-int',has_traffic_filtering=True,id=1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a556d5f-62') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a556d5f-62, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78a83468-941b-4271-828c-0d661208f4f7) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 25480185-8c9c-4aad-9c46-573cfbf65364 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e1266470-c182-4c0c-a575-4c5043f54745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 4b650a57-5870-4f77-bca2-abe50d970b40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 915bc61e-eaea-40c0-a5ed-4d2a677477f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance f6fe7bf7-782c-4660-9612-101c9f277903 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e0df8b51-bda3-4c45-ab54-c6097f6136ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a3fe15c9-36ab-404e-876e-e6241cca05f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 24d45b28-61df-43cb-bdae-f8ce6b3aaca3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 9f306608-7716-41e0-9aa0-afa8ba173a04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 04c31ea4-faaa-4289-8930-9406865e6705 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance cd47c12d-05fd-4942-ac19-f3283c90db8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 1358a444-8765-4863-a9b6-9b0e53eaff51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 69f05219-5034-4e88-879c-9c567e2c2fcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:02:26 user nova-compute[75246]: INFO os_vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:6e:f2,bridge_name='br-int',has_traffic_filtering=True,id=1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1,network=Network(8c3bd695-6a1f-40a6-9a4d-0ab59277b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a556d5f-62')
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56971077-b127-4c9f-897f-22d420785295", "address": "fa:16:3e:a9:3c:06", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56971077-b1", "ovs_interfaceid": "56971077-b127-4c9f-897f-22d420785295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "56971077-b127-4c9f-897f-22d420785295", "address": "fa:16:3e:a9:3c:06", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56971077-b1", "ovs_interfaceid": "56971077-b127-4c9f-897f-22d420785295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3c:06,bridge_name='br-int',has_traffic_filtering=True,id=56971077-b127-4c9f-897f-22d420785295,network=Network(bb32316c-05ca-45f5-a0a9-b386f0a72f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56971077-b1') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3c:06,bridge_name='br-int',has_traffic_filtering=True,id=56971077-b127-4c9f-897f-22d420785295,network=Network(bb32316c-05ca-45f5-a0a9-b386f0a72f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56971077-b1') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56971077-b1, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0194c1d9-8173-420a-9c47-f0b53d206324) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: INFO os_vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3c:06,bridge_name='br-int',has_traffic_filtering=True,id=56971077-b127-4c9f-897f-22d420785295,network=Network(bb32316c-05ca-45f5-a0a9-b386f0a72f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56971077-b1')
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-698112315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-698112315',id=10,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6llZMNqHAIsbA8YijfrnBvjirEr2bNStJEeCppPQ+mvtUcr1kTuMyM4KtqOSxpCuTiCL6QJHoyUwUvhd35lsi8FFU+db+e6UGPHJB+SzGWr5uIBUztoAawIB21LWNhGg==',key_name='tempest-keypair-1576239529',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3301e46ecb36426a9225385c1fd6c6b4',ramdisk_id='',reservation_id='r-0llanucd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1662440183',owner_user_name='tempest-TaggedBootDevicesTest_v242-1662440183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47e1ecec64748caab24532ade08a57b',uuid=04c31ea4-faaa-4289-8930-9406865e6705,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a46959c2-cd58-410c-8cdb-054015f1794a", "address": "fa:16:3e:4b:1c:67", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46959c2-cd", "ovs_interfaceid": "a46959c2-cd58-410c-8cdb-054015f1794a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converting VIF {"id": "a46959c2-cd58-410c-8cdb-054015f1794a", "address": "fa:16:3e:4b:1c:67", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46959c2-cd", "ovs_interfaceid": "a46959c2-cd58-410c-8cdb-054015f1794a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:1c:67,bridge_name='br-int',has_traffic_filtering=True,id=a46959c2-cd58-410c-8cdb-054015f1794a,network=Network(bb32316c-05ca-45f5-a0a9-b386f0a72f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46959c2-cd') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:1c:67,bridge_name='br-int',has_traffic_filtering=True,id=a46959c2-cd58-410c-8cdb-054015f1794a,network=Network(bb32316c-05ca-45f5-a0a9-b386f0a72f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46959c2-cd') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa46959c2-cd, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20f8b40d-1afc-42a4-8904-ef967f4865e5) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:26 user nova-compute[75246]: INFO os_vif [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:1c:67,bridge_name='br-int',has_traffic_filtering=True,id=a46959c2-cd58-410c-8cdb-054015f1794a,network=Network(bb32316c-05ca-45f5-a0a9-b386f0a72f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa46959c2-cd')
Nov 28 17:02:26 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJoRnaXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:02:26 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0fb598-8820-4b85-8236-6f2d91ffd6fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:02:26 user nova-compute[75246]: No targets found.
Nov 28 17:02:26 user nova-compute[75246]: iSNS:
Nov 28 17:02:26 user nova-compute[75246]: No targets found.
Nov 28 17:02:26 user nova-compute[75246]: STATIC:
Nov 28 17:02:26 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c
Nov 28 17:02:26 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:26 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:26 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633
Nov 28 17:02:26 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:26 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:26 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353
Nov 28 17:02:26 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:26 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:26 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17
Nov 28 17:02:26 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:26 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:26 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8
Nov 28 17:02:26 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:26 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:26 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2
Nov 28 17:02:26 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:26 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:26 user nova-compute[75246]: FIRMWARE:
Nov 28 17:02:26 user nova-compute[75246]: No targets found.
Nov 28 17:02:26 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:02:26 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:02:26 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd96136e-b595-4be5-8df9-e284b6ea43a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e140a29a-7f4e-4039-925d-8ed701f46e89]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:26 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:26 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:26 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:26 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:26 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:26 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:26 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:26 user nova-compute[75246]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c (non-flash)
Nov 28 17:02:26 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:26 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:26 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:26 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d83627a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c'): ({'sdc'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Removing single pathed devices sdc {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad716c7-a1a9-42a6-9deb-e945aaf13a0d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f812c4-1f50-4022-aea0-56da559bb1aa]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Flushing IO for device /dev/sdc {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8d361e-fbb4-4430-b835-b012dbcb1993]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6019720d-14f5-4e64-b0e2-316d04a62417]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:02:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef22402-40b9-4528-81de-5adf385e9ad2]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[670c6e3f-5aa2-45fa-938b-b9a23d9ffc01]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c, portal: 172.16.0.220,3260]
Nov 28 17:02:27 user nova-compute[75246]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c, portal: 172.16.0.220,3260] successful.
Nov 28 17:02:27 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa9362a-51ef-4ae5-8ea5-6001b754eb8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8917abf7-f21a-4c36-89bc-86dd255d1bbd]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] <== disconnect_volume: return (378ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CwQqOMWc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:02:27 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.663s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.553s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f9063e-3e20-4bbc-b9be-4c9f73a67b97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:02:27 user nova-compute[75246]: No targets found.
Nov 28 17:02:27 user nova-compute[75246]: iSNS:
Nov 28 17:02:27 user nova-compute[75246]: No targets found.
Nov 28 17:02:27 user nova-compute[75246]: STATIC:
Nov 28 17:02:27 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633
Nov 28 17:02:27 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:27 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:27 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353
Nov 28 17:02:27 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:27 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:27 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17
Nov 28 17:02:27 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:27 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:27 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8
Nov 28 17:02:27 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:27 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:27 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2
Nov 28 17:02:27 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:27 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:27 user nova-compute[75246]: FIRMWARE:
Nov 28 17:02:27 user nova-compute[75246]: No targets found.
Nov 28 17:02:27 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:02:27 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:02:27 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[53906110-aeeb-4490-8d55-2037504df30d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[271d76b8-c950-4d10-876d-c4b6ad649f02]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:27 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:27 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:27 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:27 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:27 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:27 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:27 user nova-compute[75246]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 (non-flash)
Nov 28 17:02:27 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:27 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:27 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f035c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8'): ({'sdd'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Removing single pathed devices sdd {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0ece48-50dc-4e30-b793-4e255f18e097]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[17970bb5-6611-403f-b5cf-9bc79da7b798]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Flushing IO for device /dev/sdd {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf362945-1a2a-4ec8-8b99-59b4ce0c1d73]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.029s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18245d5-e698-4d07-ba70-9cb6c008fbe2]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bfaf93-764d-4168-a376-51fd00842a41]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81b18ff-eb18-4bfc-94c7-d033885c2117]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8, portal: 172.16.0.220,3260]
Nov 28 17:02:27 user nova-compute[75246]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8, portal: 172.16.0.220,3260] successful.
Nov 28 17:02:27 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a29c9e3-4029-4742-b240-d31c497812d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[39172d6b-55dd-4eca-b3ed-c9b7c3e5ce37]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] <== disconnect_volume: return (330ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFYkfNDw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:02:27 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a393a2-9216-47e8-b83d-da5c75cb2e42]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:02:27 user nova-compute[75246]: No targets found.
Nov 28 17:02:27 user nova-compute[75246]: iSNS:
Nov 28 17:02:27 user nova-compute[75246]: No targets found.
Nov 28 17:02:27 user nova-compute[75246]: STATIC:
Nov 28 17:02:27 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633
Nov 28 17:02:27 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:27 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:27 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353
Nov 28 17:02:27 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:27 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:27 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17
Nov 28 17:02:27 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:27 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:27 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2
Nov 28 17:02:27 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:27 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:27 user nova-compute[75246]: FIRMWARE:
Nov 28 17:02:27 user nova-compute[75246]: No targets found.
Nov 28 17:02:27 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:02:27 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:02:27 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[46955bf1-107b-4869-97de-4a108181bfec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b7ba7d-eba5-4948-a22b-e23cf4e984a3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:27 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:27 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:27 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:27 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:27 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:27 user nova-compute[75246]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 (non-flash)
Nov 28 17:02:27 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:27 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d83627a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2'): ({'sde'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Removing single pathed devices sde {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb7510f-093e-4f8e-a86a-fecb8d1a5264]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3831a4b9-bd84-496c-af60-c20a1af387d3]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Flushing IO for device /dev/sde {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Deleted allocations for instance e0df8b51-bda3-4c45-ab54-c6097f6136ad
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e17eff2-310f-4950-98ab-2192bb4dfdde]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f23c5c-8b1f-4e13-9eb0-ab638333dc1b]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] SCSI volumes sde have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d42511e-cba8-4269-a7bb-4457ed4561aa]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c1788afd-6ced-4d2e-879f-9f6d1f23bbf6 tempest-AttachSCSIVolumeTestJSON-884776922 tempest-AttachSCSIVolumeTestJSON-884776922-project-member] Lock "e0df8b51-bda3-4c45-ab54-c6097f6136ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.294s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f829b664-66c8-4600-9b0a-30ddce0267bf]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2, portal: 172.16.0.220,3260]
Nov 28 17:02:27 user nova-compute[75246]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2, portal: 172.16.0.220,3260] successful.
Nov 28 17:02:27 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622aeb5e-70ae-4744-84f3-cb47decd3ac2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[54208bef-0753-4b45-affc-d6893e03293d]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] <== disconnect_volume: return (330ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:02:27 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Deleting instance files /opt/stack/data/nova/instances/04c31ea4-faaa-4289-8930-9406865e6705_del
Nov 28 17:02:27 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Deletion of /opt/stack/data/nova/instances/04c31ea4-faaa-4289-8930-9406865e6705_del complete
Nov 28 17:02:27 user nova-compute[75246]: INFO nova.compute.manager [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Took 4.52 seconds to destroy the instance on the hypervisor.
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:02:27 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:02:28 user nova-compute[75246]: DEBUG nova.compute.manager [req-be3ce958-9c84-42fe-946e-8ea918de9fec req-177fa6ea-0639-4c0f-ad2b-1c6587852b5e service nova] [instance: e0df8b51-bda3-4c45-ab54-c6097f6136ad] Received event network-vif-deleted-26780137-c1a5-41f0-9c41-e2b2cf450405 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-1630183d-5d0e-44bd-8932-7ce7092ac63f req-a705cf62-189d-4a03-8bf4-bd10c8c48e21 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-deleted-1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:30 user nova-compute[75246]: INFO nova.compute.manager [req-1630183d-5d0e-44bd-8932-7ce7092ac63f req-a705cf62-189d-4a03-8bf4-bd10c8c48e21 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Neutron deleted interface 1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1; detaching it from the instance and deleting it from the info cache
Nov 28 17:02:30 user nova-compute[75246]: DEBUG nova.network.neutron [req-1630183d-5d0e-44bd-8932-7ce7092ac63f req-a705cf62-189d-4a03-8bf4-bd10c8c48e21 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Updating instance_info_cache with network_info: [{"id": "7f38967b-bb53-4627-ad7f-6324098159a9", "address": "fa:16:3e:0e:49:2c", "network": {"id": "5d735e77-2be9-47ce-bff7-55da5c0432ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1287968723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f38967b-bb", "ovs_interfaceid": "7f38967b-bb53-4627-ad7f-6324098159a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "address": "fa:16:3e:ca:43:c6", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c207a6f-3e", "ovs_interfaceid": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "address": "fa:16:3e:56:1a:9d", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f041c8c-a9", "ovs_interfaceid": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "address": "fa:16:3e:05:5e:e3", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ae7951-da", "ovs_interfaceid": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56971077-b127-4c9f-897f-22d420785295", "address": "fa:16:3e:a9:3c:06", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56971077-b1", "ovs_interfaceid": "56971077-b127-4c9f-897f-22d420785295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a46959c2-cd58-410c-8cdb-054015f1794a", "address": "fa:16:3e:4b:1c:67", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa46959c2-cd", "ovs_interfaceid": "a46959c2-cd58-410c-8cdb-054015f1794a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:02:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-1630183d-5d0e-44bd-8932-7ce7092ac63f req-a705cf62-189d-4a03-8bf4-bd10c8c48e21 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Detach interface failed, port_id=1a556d5f-62a7-4c12-8cc2-cbbd16ac44d1, reason: Instance 04c31ea4-faaa-4289-8930-9406865e6705 could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:02:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-1630183d-5d0e-44bd-8932-7ce7092ac63f req-a705cf62-189d-4a03-8bf4-bd10c8c48e21 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-deleted-a46959c2-cd58-410c-8cdb-054015f1794a {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:30 user nova-compute[75246]: INFO nova.compute.manager [req-1630183d-5d0e-44bd-8932-7ce7092ac63f req-a705cf62-189d-4a03-8bf4-bd10c8c48e21 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Neutron deleted interface a46959c2-cd58-410c-8cdb-054015f1794a; detaching it from the instance and deleting it from the info cache
Nov 28 17:02:30 user nova-compute[75246]: DEBUG nova.network.neutron [req-1630183d-5d0e-44bd-8932-7ce7092ac63f req-a705cf62-189d-4a03-8bf4-bd10c8c48e21 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Updating instance_info_cache with network_info: [{"id": "7f38967b-bb53-4627-ad7f-6324098159a9", "address": "fa:16:3e:0e:49:2c", "network": {"id": "5d735e77-2be9-47ce-bff7-55da5c0432ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1287968723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f38967b-bb", "ovs_interfaceid": "7f38967b-bb53-4627-ad7f-6324098159a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "address": "fa:16:3e:ca:43:c6", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c207a6f-3e", "ovs_interfaceid": "0c207a6f-3e99-4122-8b4b-bf433d46193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "address": "fa:16:3e:56:1a:9d", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f041c8c-a9", "ovs_interfaceid": "8f041c8c-a943-41bd-8ea1-7629e2635d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "address": "fa:16:3e:05:5e:e3", "network": {"id": "8c3bd695-6a1f-40a6-9a4d-0ab59277b92f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1341017141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ae7951-da", "ovs_interfaceid": "53ae7951-da14-4dcb-bf28-16f035e3d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56971077-b127-4c9f-897f-22d420785295", "address": "fa:16:3e:a9:3c:06", "network": {"id": "bb32316c-05ca-45f5-a0a9-b386f0a72f31", "bridge": "br-int", "label": "tempest-device-tagging-net2-362823704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3301e46ecb36426a9225385c1fd6c6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56971077-b1", "ovs_interfaceid": "56971077-b127-4c9f-897f-22d420785295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:02:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-1630183d-5d0e-44bd-8932-7ce7092ac63f req-a705cf62-189d-4a03-8bf4-bd10c8c48e21 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Detach interface failed, port_id=a46959c2-cd58-410c-8cdb-054015f1794a, reason: Instance 04c31ea4-faaa-4289-8930-9406865e6705 could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:02:31 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:02:31 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Took 3.45 seconds to deallocate network for instance.
Nov 28 17:02:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-9972017d-6978-4397-ad68-ac7935444849 req-b58098dd-2cba-4392-af5c-eafcc29df667 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-deleted-7f38967b-bb53-4627-ad7f-6324098159a9 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-9972017d-6978-4397-ad68-ac7935444849 req-b58098dd-2cba-4392-af5c-eafcc29df667 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-deleted-56971077-b127-4c9f-897f-22d420785295 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-9972017d-6978-4397-ad68-ac7935444849 req-b58098dd-2cba-4392-af5c-eafcc29df667 service nova] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Received event network-vif-deleted-53ae7951-da14-4dcb-bf28-16f035e3d01b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG nova.objects.instance [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lazy-loading 'flavor' on Instance uuid 915bc61e-eaea-40c0-a5ed-4d2a677477f8 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac13c0b0-96a5-4e05-8d5b-59e2619a4e8e tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.727s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Acquiring lock "cd47c12d-05fd-4942-ac19-f3283c90db8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Lock "cd47c12d-05fd-4942-ac19-f3283c90db8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Acquiring lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:33 user nova-compute[75246]: INFO nova.compute.manager [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Terminating instance
Nov 28 17:02:33 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRMWKwCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f6fe7bf7-782c-4660-9612-101c9f277903', 'attached_at': '', 'detached_at': '', 'volume_id': 'b396e853-b227-4072-b566-bc9dc97a0047', 'serial': 'b396e853-b227-4072-b566-bc9dc97a0047'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dDvQHqCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '46eec365-ee40-488c-ab1d-296e8bfb0a17'}, 'status': 'reserved', 'instance': 'f6fe7bf7-782c-4660-9612-101c9f277903', 'attached_at': '', 'detached_at': '', 'volume_id': '46eec365-ee40-488c-ab1d-296e8bfb0a17', 'serial'} {{(pid=75246) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRMWKwCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:02:33 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:02:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:33 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:02:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:33 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:02:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5133de27-45cb-4c5a-98ff-3f24bb1f6ca5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:02:33 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9f13b4-66d2-4974-bcd1-4de647d3b495]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047] added
Nov 28 17:02:33 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6ed178-767c-4b68-b3ff-97ea7e3bf0bd]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Instance destroyed successfully.
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.objects.instance [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Lazy-loading 'resources' on Instance uuid cd47c12d-05fd-4942-ac19-f3283c90db8e {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6aa40e-12a0-4941-bd1d-e3b85d335687]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1384405179',display_name='tempest-VolumesNegativeTest-instance-1384405179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1384405179',id=11,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:00:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f61bb961816422ebd08a75d7054588e',ramdisk_id='',reservation_id='r-1k0xa5t2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1552569566',owner_user_name='tempest-VolumesNegativeTest-1552569566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:00:45Z,user_data=None,user_id='449b2736a5924946b1caacf0d3178f3f',uuid=cd47c12d-05fd-4942-ac19-f3283c90db8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "address": "fa:16:3e:15:a7:d6", "network": {"id": "554d0735-9205-45bc-b6d3-e572a90c8ac2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b8ef2b06a1514b5088e6adece7f4f2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedde6fa7-66", "ovs_interfaceid": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Converting VIF {"id": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "address": "fa:16:3e:15:a7:d6", "network": {"id": "554d0735-9205-45bc-b6d3-e572a90c8ac2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b8ef2b06a1514b5088e6adece7f4f2f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedde6fa7-66", "ovs_interfaceid": "edde6fa7-66d9-422c-b7a7-b79351a15fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:a7:d6,bridge_name='br-int',has_traffic_filtering=True,id=edde6fa7-66d9-422c-b7a7-b79351a15fa4,network=Network(554d0735-9205-45bc-b6d3-e572a90c8ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedde6fa7-66') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_vif [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:a7:d6,bridge_name='br-int',has_traffic_filtering=True,id=edde6fa7-66d9-422c-b7a7-b79351a15fa4,network=Network(554d0735-9205-45bc-b6d3-e572a90c8ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedde6fa7-66') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TRMWKwCD {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedde6fa7-66, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1747270-4734-4644-8f78-5275f5ab7075) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:34 user nova-compute[75246]: INFO os_vif [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:a7:d6,bridge_name='br-int',has_traffic_filtering=True,id=edde6fa7-66d9-422c-b7a7-b79351a15fa4,network=Network(554d0735-9205-45bc-b6d3-e572a90c8ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedde6fa7-66')
Nov 28 17:02:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Deleting instance files /opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e_del
Nov 28 17:02:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Deletion of /opt/stack/data/nova/instances/cd47c12d-05fd-4942-ac19-f3283c90db8e_del complete
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TRMWKwCD" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f4564b-fec7-47f8-8293-f616353516db]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TRMWKwCD'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[789c9b6f-4b30-48b0-b3e0-0281eb394dde]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:34 user nova-compute[75246]: INFO nova.compute.manager [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[97133693-1351-4538-81ee-e1cf8a8b7e05]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:34 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:34 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:34 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:34 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:34 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:34 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ca3407-1c3b-46f4-804d-4d567189ad07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047, portal: 172.16.0.220,3260]
Nov 28 17:02:34 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047, portal: 172.16.0.220,3260] successful.
Nov 28 17:02:34 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[311ec55e-6737-4edb-88e2-4045c8968a8c]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a9da5a-c5b4-4fab-a264-f160641ac4ea]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:34 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:34 user nova-compute[75246]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:34 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:34 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:34 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:34 user nova-compute[75246]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:34 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:34 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[558239b7-b9b8-4ada-938e-7ea05ddeca6c]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRMWKwCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:02:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Creating image(s)
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Did not create local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Ensure instance console log exists: /opt/stack/data/nova/instances/9f306608-7716-41e0-9aa0-afa8ba173a04/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Start _get_guest_xml network_info=[{"id": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "address": "fa:16:3e:df:ac:3a", "network": {"id": "06579a46-8d95-4c64-940c-00a80ce64cf2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-824652166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37d00748c91a42a9aa255f62e207a41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf37bb-28", "ovs_interfaceid": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '2e33e264-9297-42ff-a4d9-bd41e89e32c3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbstSmKj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9f306608-7716-41e0-9aa0-afa8ba173a04', 'attached_at': '', 'detached_at': '', 'volume_id': '5a955b08-0696-4533-b17d-0e99d36216e1', 'serial': '5a955b08-0696-4533-b17d-0e99d36216e1'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:02:34 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 17:02:34 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.objects.instance [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9f306608-7716-41e0-9aa0-afa8ba173a04 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbstSmKj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:02:34 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 17:02:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-571ea9b2-9d8f-44a8-92bd-e78dfb443544 req-09909abc-873e-4d8d-80d0-e6c667f6c572 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Received event network-vif-unplugged-edde6fa7-66d9-422c-b7a7-b79351a15fa4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-571ea9b2-9d8f-44a8-92bd-e78dfb443544 req-09909abc-873e-4d8d-80d0-e6c667f6c572 service nova] Acquiring lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-571ea9b2-9d8f-44a8-92bd-e78dfb443544 req-09909abc-873e-4d8d-80d0-e6c667f6c572 service nova] Lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-571ea9b2-9d8f-44a8-92bd-e78dfb443544 req-09909abc-873e-4d8d-80d0-e6c667f6c572 service nova] Lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-571ea9b2-9d8f-44a8-92bd-e78dfb443544 req-09909abc-873e-4d8d-80d0-e6c667f6c572 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] No waiting events found dispatching network-vif-unplugged-edde6fa7-66d9-422c-b7a7-b79351a15fa4 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-571ea9b2-9d8f-44a8-92bd-e78dfb443544 req-09909abc-873e-4d8d-80d0-e6c667f6c572 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Received event network-vif-unplugged-edde6fa7-66d9-422c-b7a7-b79351a15fa4 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-571ea9b2-9d8f-44a8-92bd-e78dfb443544 req-09909abc-873e-4d8d-80d0-e6c667f6c572 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Received event network-vif-plugged-edde6fa7-66d9-422c-b7a7-b79351a15fa4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-571ea9b2-9d8f-44a8-92bd-e78dfb443544 req-09909abc-873e-4d8d-80d0-e6c667f6c572 service nova] Acquiring lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-571ea9b2-9d8f-44a8-92bd-e78dfb443544 req-09909abc-873e-4d8d-80d0-e6c667f6c572 service nova] Lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-571ea9b2-9d8f-44a8-92bd-e78dfb443544 req-09909abc-873e-4d8d-80d0-e6c667f6c572 service nova] Lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-571ea9b2-9d8f-44a8-92bd-e78dfb443544 req-09909abc-873e-4d8d-80d0-e6c667f6c572 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] No waiting events found dispatching network-vif-plugged-edde6fa7-66d9-422c-b7a7-b79351a15fa4 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:34 user nova-compute[75246]: WARNING nova.compute.manager [req-571ea9b2-9d8f-44a8-92bd-e78dfb443544 req-09909abc-873e-4d8d-80d0-e6c667f6c572 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Received unexpected event network-vif-plugged-edde6fa7-66d9-422c-b7a7-b79351a15fa4 for instance with vm_state active and task_state deleting.
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-571ea9b2-9d8f-44a8-92bd-e78dfb443544 req-09909abc-873e-4d8d-80d0-e6c667f6c572 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Received event network-vif-plugged-edde6fa7-66d9-422c-b7a7-b79351a15fa4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-571ea9b2-9d8f-44a8-92bd-e78dfb443544 req-09909abc-873e-4d8d-80d0-e6c667f6c572 service nova] Acquiring lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-571ea9b2-9d8f-44a8-92bd-e78dfb443544 req-09909abc-873e-4d8d-80d0-e6c667f6c572 service nova] Lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-571ea9b2-9d8f-44a8-92bd-e78dfb443544 req-09909abc-873e-4d8d-80d0-e6c667f6c572 service nova] Lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-571ea9b2-9d8f-44a8-92bd-e78dfb443544 req-09909abc-873e-4d8d-80d0-e6c667f6c572 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] No waiting events found dispatching network-vif-plugged-edde6fa7-66d9-422c-b7a7-b79351a15fa4 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:34 user nova-compute[75246]: WARNING nova.compute.manager [req-571ea9b2-9d8f-44a8-92bd-e78dfb443544 req-09909abc-873e-4d8d-80d0-e6c667f6c572 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Received unexpected event network-vif-plugged-edde6fa7-66d9-422c-b7a7-b79351a15fa4 for instance with vm_state active and task_state deleting.
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:34 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:02:34 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Took 0.80 seconds to deallocate network for instance.
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.455s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '26664393863373230', 'path': '/dev/sdc'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664393863373230', 'path': '/dev/sdc'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.852s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:35 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:35 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:02:35 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Deleted allocations for instance cd47c12d-05fd-4942-ac19-f3283c90db8e
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG nova.objects.instance [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Lazy-loading 'flavor' on Instance uuid f6fe7bf7-782c-4660-9612-101c9f277903 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f1826f-b0d1-46d8-bd5b-a7c773d07dea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:02:35 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a892ac4e-e8e7-464f-9f9f-8b0c3ce69201]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1] added
Nov 28 17:02:35 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[529d1d2b-c07b-4cde-9fa9-e389728365c5]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6a427c-356c-4137-9084-e5a2e1a4b0c3]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kbstSmKj {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kbstSmKj" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a4bab3-a137-450b-8e49-fd17c54dbe49]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kbstSmKj'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c554efde-e413-4681-b60a-fc4fe78dbcb1 tempest-VolumesNegativeTest-1552569566 tempest-VolumesNegativeTest-1552569566-project-member] Lock "cd47c12d-05fd-4942-ac19-f3283c90db8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.044s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6718f8ae-96d5-436d-9461-5551c35f2d54]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[250846ee-7293-40fb-a7be-26e5cf6ca68b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:35 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:35 user nova-compute[75246]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:35 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:35 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:35 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:35 user nova-compute[75246]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:35 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:35 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1ba859-4060-4347-81df-94cdce381e88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1, portal: 172.16.0.220,3260]
Nov 28 17:02:35 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1, portal: 172.16.0.220,3260] successful.
Nov 28 17:02:35 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7307f0f6-953d-4ec3-9eab-87cfcd8afc85]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9808117d-3453-4638-ae13-0b3c379cc7cb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:35 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:35 user nova-compute[75246]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:35 user nova-compute[75246]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:35 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:35 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:35 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:35 user nova-compute[75246]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:35 user nova-compute[75246]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:35 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:35 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7891ba7f-dac4-4ad7-9d29-65644a7b7f1b]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbstSmKj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:02:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:36 user nova-compute[75246]: INFO nova.compute.manager [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] [instance: 04c31ea4-faaa-4289-8930-9406865e6705] Took 4.80 seconds to detach 3 volumes for instance.
Nov 28 17:02:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 77594624 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-cd38072f-5e60-4821-af59-acdea62f7416 req-9424b016-8284-4d55-a6ee-d26d9e9f4f51 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Received event network-vif-plugged-edde6fa7-66d9-422c-b7a7-b79351a15fa4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cd38072f-5e60-4821-af59-acdea62f7416 req-9424b016-8284-4d55-a6ee-d26d9e9f4f51 service nova] Acquiring lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cd38072f-5e60-4821-af59-acdea62f7416 req-9424b016-8284-4d55-a6ee-d26d9e9f4f51 service nova] Lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cd38072f-5e60-4821-af59-acdea62f7416 req-9424b016-8284-4d55-a6ee-d26d9e9f4f51 service nova] Lock "cd47c12d-05fd-4942-ac19-f3283c90db8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-cd38072f-5e60-4821-af59-acdea62f7416 req-9424b016-8284-4d55-a6ee-d26d9e9f4f51 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] No waiting events found dispatching network-vif-plugged-edde6fa7-66d9-422c-b7a7-b79351a15fa4 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:36 user nova-compute[75246]: WARNING nova.compute.manager [req-cd38072f-5e60-4821-af59-acdea62f7416 req-9424b016-8284-4d55-a6ee-d26d9e9f4f51 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Received unexpected event network-vif-plugged-edde6fa7-66d9-422c-b7a7-b79351a15fa4 for instance with vm_state deleted and task_state None.
Nov 28 17:02:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-cd38072f-5e60-4821-af59-acdea62f7416 req-9424b016-8284-4d55-a6ee-d26d9e9f4f51 service nova] [instance: cd47c12d-05fd-4942-ac19-f3283c90db8e] Received event network-vif-deleted-edde6fa7-66d9-422c-b7a7-b79351a15fa4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] <== connect_volume: return (2163ms) {'type': 'block', 'scsi_wwn': '23965346666303434', 'path': '/dev/sdd'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965346666303434', 'path': '/dev/sdd'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.535s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T17:00:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2073692504',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1449270168',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/bT5nFFmbZrOpaZ0HmyZXCELWLX9dTZ/XfZD4hqIrK3t2MR0LlLUdxpI/bFXzxh3UZ4VIGEMreeSaxuGWiHlXx7TOkvrFpJoQFIrSk/kIxGBFPzpcWuMsi8ubkeEskCA==',key_name='tempest-keypair-1686207482',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:00:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='37d00748c91a42a9aa255f62e207a41c',ramdisk_id='',reservation_id='r-r7anrgfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1837306517',owner_user_name='tempest-ServerActionsV293TestJSON-1837306517-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3465e183420e4370a02046024827d21f',uuid=9f306608-7716-41e0-9aa0-afa8ba173a04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "address": "fa:16:3e:df:ac:3a", "network": {"id": "06579a46-8d95-4c64-940c-00a80ce64cf2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-824652166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37d00748c91a42a9aa255f62e207a41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf37bb-28", "ovs_interfaceid": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Converting VIF {"id": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "address": "fa:16:3e:df:ac:3a", "network": {"id": "06579a46-8d95-4c64-940c-00a80ce64cf2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-824652166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37d00748c91a42a9aa255f62e207a41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf37bb-28", "ovs_interfaceid": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:3a,bridge_name='br-int',has_traffic_filtering=True,id=8ccf37bb-28f1-4f69-ba57-e168eff668e4,network=Network(06579a46-8d95-4c64-940c-00a80ce64cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf37bb-28') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:02:36 user nova-compute[75246]:   <uuid>9f306608-7716-41e0-9aa0-afa8ba173a04</uuid>
Nov 28 17:02:36 user nova-compute[75246]:   <name>instance-00000009</name>
Nov 28 17:02:36 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:02:36 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:02:36 user nova-compute[75246]:   <metadata>
Nov 28 17:02:36 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:02:36 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:02:36 user nova-compute[75246]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2073692504</nova:name>
Nov 28 17:02:36 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:02:34</nova:creationTime>
Nov 28 17:02:36 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:02:36 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:02:36 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:02:36 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:02:36 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:02:36 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:02:36 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:02:36 user nova-compute[75246]:       <nova:owner>
Nov 28 17:02:36 user nova-compute[75246]:         <nova:user uuid="3465e183420e4370a02046024827d21f">tempest-ServerActionsV293TestJSON-1837306517-project-member</nova:user>
Nov 28 17:02:36 user nova-compute[75246]:         <nova:project uuid="37d00748c91a42a9aa255f62e207a41c">tempest-ServerActionsV293TestJSON-1837306517</nova:project>
Nov 28 17:02:36 user nova-compute[75246]:       </nova:owner>
Nov 28 17:02:36 user nova-compute[75246]:       <nova:ports>
Nov 28 17:02:36 user nova-compute[75246]:         <nova:port uuid="8ccf37bb-28f1-4f69-ba57-e168eff668e4">
Nov 28 17:02:36 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 17:02:36 user nova-compute[75246]:         </nova:port>
Nov 28 17:02:36 user nova-compute[75246]:       </nova:ports>
Nov 28 17:02:36 user nova-compute[75246]:     </nova:instance>
Nov 28 17:02:36 user nova-compute[75246]:   </metadata>
Nov 28 17:02:36 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:02:36 user nova-compute[75246]:     <system>
Nov 28 17:02:36 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:02:36 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:02:36 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:02:36 user nova-compute[75246]:       <entry name="serial">9f306608-7716-41e0-9aa0-afa8ba173a04</entry>
Nov 28 17:02:36 user nova-compute[75246]:       <entry name="uuid">9f306608-7716-41e0-9aa0-afa8ba173a04</entry>
Nov 28 17:02:36 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:02:36 user nova-compute[75246]:     </system>
Nov 28 17:02:36 user nova-compute[75246]:   </sysinfo>
Nov 28 17:02:36 user nova-compute[75246]:   <os>
Nov 28 17:02:36 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:02:36 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:02:36 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:02:36 user nova-compute[75246]:   </os>
Nov 28 17:02:36 user nova-compute[75246]:   <features>
Nov 28 17:02:36 user nova-compute[75246]:     <acpi/>
Nov 28 17:02:36 user nova-compute[75246]:     <apic/>
Nov 28 17:02:36 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:02:36 user nova-compute[75246]:   </features>
Nov 28 17:02:36 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:02:36 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:02:36 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:02:36 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:02:36 user nova-compute[75246]:   </clock>
Nov 28 17:02:36 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:02:36 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:02:36 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:02:36 user nova-compute[75246]:   </cpu>
Nov 28 17:02:36 user nova-compute[75246]:   <devices>
Nov 28 17:02:36 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:02:36 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:02:36 user nova-compute[75246]:       <source dev="/dev/sdd"/>
Nov 28 17:02:36 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:02:36 user nova-compute[75246]:       <serial>5a955b08-0696-4533-b17d-0e99d36216e1</serial>
Nov 28 17:02:36 user nova-compute[75246]:     </disk>
Nov 28 17:02:36 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:02:36 user nova-compute[75246]:       <mac address="fa:16:3e:df:ac:3a"/>
Nov 28 17:02:36 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:02:36 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:02:36 user nova-compute[75246]:       <target dev="tap8ccf37bb-28"/>
Nov 28 17:02:36 user nova-compute[75246]:     </interface>
Nov 28 17:02:36 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:02:36 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/9f306608-7716-41e0-9aa0-afa8ba173a04/console.log" append="off"/>
Nov 28 17:02:36 user nova-compute[75246]:     </serial>
Nov 28 17:02:36 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:02:36 user nova-compute[75246]:     <video>
Nov 28 17:02:36 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:02:36 user nova-compute[75246]:     </video>
Nov 28 17:02:36 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:02:36 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:02:36 user nova-compute[75246]:     </rng>
Nov 28 17:02:36 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:02:36 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:02:36 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:02:36 user nova-compute[75246]:     </memballoon>
Nov 28 17:02:36 user nova-compute[75246]:   </devices>
Nov 28 17:02:36 user nova-compute[75246]: </domain>
Nov 28 17:02:36 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T17:00:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2073692504',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1449270168',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/bT5nFFmbZrOpaZ0HmyZXCELWLX9dTZ/XfZD4hqIrK3t2MR0LlLUdxpI/bFXzxh3UZ4VIGEMreeSaxuGWiHlXx7TOkvrFpJoQFIrSk/kIxGBFPzpcWuMsi8ubkeEskCA==',key_name='tempest-keypair-1686207482',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:00:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='37d00748c91a42a9aa255f62e207a41c',ramdisk_id='',reservation_id='r-r7anrgfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1837306517',owner_user_name='tempest-ServerActionsV293TestJSON-1837306517-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3465e183420e4370a02046024827d21f',uuid=9f306608-7716-41e0-9aa0-afa8ba173a04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "address": "fa:16:3e:df:ac:3a", "network": {"id": "06579a46-8d95-4c64-940c-00a80ce64cf2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-824652166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37d00748c91a42a9aa255f62e207a41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf37bb-28", "ovs_interfaceid": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Converting VIF {"id": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "address": "fa:16:3e:df:ac:3a", "network": {"id": "06579a46-8d95-4c64-940c-00a80ce64cf2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-824652166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37d00748c91a42a9aa255f62e207a41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf37bb-28", "ovs_interfaceid": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:3a,bridge_name='br-int',has_traffic_filtering=True,id=8ccf37bb-28f1-4f69-ba57-e168eff668e4,network=Network(06579a46-8d95-4c64-940c-00a80ce64cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf37bb-28') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG os_vif [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:3a,bridge_name='br-int',has_traffic_filtering=True,id=8ccf37bb-28f1-4f69-ba57-e168eff668e4,network=Network(06579a46-8d95-4c64-940c-00a80ce64cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf37bb-28') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c3826b0-bae8-5658-9624-1bb0042830a7', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ccf37bb-28, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ccf37bb-28, col_values=(('qos', UUID('48df49aa-794d-4bef-b5d1-1be1155ca7bf')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ccf37bb-28, col_values=(('external_ids', {'iface-id': '8ccf37bb-28f1-4f69-ba57-e168eff668e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:ac:3a', 'vm-uuid': '9f306608-7716-41e0-9aa0-afa8ba173a04'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:36 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Deleted allocations for instance 04c31ea4-faaa-4289-8930-9406865e6705
Nov 28 17:02:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:36 user nova-compute[75246]: INFO os_vif [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:3a,bridge_name='br-int',has_traffic_filtering=True,id=8ccf37bb-28f1-4f69-ba57-e168eff668e4,network=Network(06579a46-8d95-4c64-940c-00a80ce64cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf37bb-28')
Nov 28 17:02:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 205520896 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] No VIF found with MAC fa:16:3e:df:ac:3a, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e06f9d53-b614-4158-b60f-395b45ea058f tempest-TaggedBootDevicesTest_v242-1662440183 tempest-TaggedBootDevicesTest_v242-1662440183-project-member] Lock "04c31ea4-faaa-4289-8930-9406865e6705" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.573s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:36 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 24d45b28-61df-43cb-bdae-f8ce6b3aaca3 is timed out.
Nov 28 17:02:36 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Successfully detached device vdb from instance 24d45b28-61df-43cb-bdae-f8ce6b3aaca3 from the live domain config.
Nov 28 17:02:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnBhQcIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:02:36 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:02:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[28812925-fab2-453d-b193-cf6b5fea3be6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:02:37 user nova-compute[75246]: No targets found.
Nov 28 17:02:37 user nova-compute[75246]: iSNS:
Nov 28 17:02:37 user nova-compute[75246]: No targets found.
Nov 28 17:02:37 user nova-compute[75246]: STATIC:
Nov 28 17:02:37 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047
Nov 28 17:02:37 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:37 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:37 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633
Nov 28 17:02:37 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:37 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:37 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1
Nov 28 17:02:37 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:37 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:37 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353
Nov 28 17:02:37 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:37 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:37 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17
Nov 28 17:02:37 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:37 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:37 user nova-compute[75246]: FIRMWARE:
Nov 28 17:02:37 user nova-compute[75246]: No targets found.
Nov 28 17:02:37 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:02:37 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:02:37 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a09d7f7-bc8c-4e7f-b026-a63313c989b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6eb10a-799a-457d-ab91-1b2bcd3d4137]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:37 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:37 user nova-compute[75246]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:37 user nova-compute[75246]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:37 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:37 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 (non-flash)
Nov 28 17:02:37 user nova-compute[75246]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:37 user nova-compute[75246]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:37 user nova-compute[75246]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:37 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:37 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d83c1900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633'): ({'sdb'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Removing single pathed devices sdb {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf525957-3d8c-4901-a96c-1f18315afdde]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc7dca9-67f2-48d6-9cb9-a8f90d37e389]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Flushing IO for device /dev/sdb {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb10835-c53f-45e8-b28f-14897aea2b49]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0c6f65-591a-4dff-a856-137f62ab52b4]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aedf304-c972-4a99-94b6-3560e89675b5]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[50da1039-d004-4ce7-8d77-1ae27dae831a]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633, portal: 172.16.0.220,3260]
Nov 28 17:02:37 user nova-compute[75246]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633, portal: 172.16.0.220,3260] successful.
Nov 28 17:02:37 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 381681664 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:939fb158-7a40-4076-be46-1a0a29b28633 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[525d5e2e-7185-4052-8bb0-79a13bc70e38]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] <== disconnect_volume: return (419ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:02:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 481296384 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 608174080 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-d122d561-d0a0-4cbc-8ef0-de4f3fbb9137 req-174431ea-75df-40c4-b09f-1e4d1e95945e service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received event network-vif-plugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d122d561-d0a0-4cbc-8ef0-de4f3fbb9137 req-174431ea-75df-40c4-b09f-1e4d1e95945e service nova] Acquiring lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d122d561-d0a0-4cbc-8ef0-de4f3fbb9137 req-174431ea-75df-40c4-b09f-1e4d1e95945e service nova] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d122d561-d0a0-4cbc-8ef0-de4f3fbb9137 req-174431ea-75df-40c4-b09f-1e4d1e95945e service nova] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-d122d561-d0a0-4cbc-8ef0-de4f3fbb9137 req-174431ea-75df-40c4-b09f-1e4d1e95945e service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] No waiting events found dispatching network-vif-plugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:38 user nova-compute[75246]: WARNING nova.compute.manager [req-d122d561-d0a0-4cbc-8ef0-de4f3fbb9137 req-174431ea-75df-40c4-b09f-1e4d1e95945e service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received unexpected event network-vif-plugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 17:02:38 user nova-compute[75246]: DEBUG nova.objects.instance [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Lazy-loading 'flavor' on Instance uuid 24d45b28-61df-43cb-bdae-f8ce6b3aaca3 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:02:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a58508dc-bd53-435a-b3b3-1d217af0a589 tempest-VolumesAssistedSnapshotsTest-29039190 tempest-VolumesAssistedSnapshotsTest-29039190-project-admin] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.597s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 703594496 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 882900992 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 1030750208 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dDvQHqCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '46eec365-ee40-488c-ab1d-296e8bfb0a17'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:02:40 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[028b90f4-3c68-4600-bc8b-b3ed4b1dd705]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:02:40 user nova-compute[75246]: No targets found.
Nov 28 17:02:40 user nova-compute[75246]: iSNS:
Nov 28 17:02:40 user nova-compute[75246]: No targets found.
Nov 28 17:02:40 user nova-compute[75246]: STATIC:
Nov 28 17:02:40 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047
Nov 28 17:02:40 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:40 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:40 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1
Nov 28 17:02:40 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:40 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:40 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353
Nov 28 17:02:40 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:40 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:40 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17
Nov 28 17:02:40 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:02:40 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:02:40 user nova-compute[75246]: FIRMWARE:
Nov 28 17:02:40 user nova-compute[75246]: No targets found.
Nov 28 17:02:40 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:02:40 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:02:40 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[392061ea-a050-4e80-bf47-ff0fdd31c883]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e725cc-3bf8-491a-8c01-0a0db30dfd90]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:40 user nova-compute[75246]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:40 user nova-compute[75246]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:40 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:40 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 (non-flash)
Nov 28 17:02:40 user nova-compute[75246]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:02:40 user nova-compute[75246]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:02:40 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:02:40 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d8360160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17'): ({'sdk'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Removing single pathed devices sdk {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c135879f-025d-4d78-a920-0e5f79ac8b84]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d2fbd9-ffce-41c3-8458-2338955646e2]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Flushing IO for device /dev/sdk {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3c2181-a3f5-4faf-b153-4b934c99e7fe]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.031s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc9a7fa-4edf-4e0c-a3ba-ec999a8c3422]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] SCSI volumes sdk have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d048f24-39e2-4433-86fd-a59b0e5e3e90]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-29c10e84-3fb9-42aa-9f7d-90e15ae008fc req-9a947b93-a0c9-452a-9f08-c0500c4d8eb7 service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received event network-vif-plugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-29c10e84-3fb9-42aa-9f7d-90e15ae008fc req-9a947b93-a0c9-452a-9f08-c0500c4d8eb7 service nova] Acquiring lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-29c10e84-3fb9-42aa-9f7d-90e15ae008fc req-9a947b93-a0c9-452a-9f08-c0500c4d8eb7 service nova] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-29c10e84-3fb9-42aa-9f7d-90e15ae008fc req-9a947b93-a0c9-452a-9f08-c0500c4d8eb7 service nova] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-29c10e84-3fb9-42aa-9f7d-90e15ae008fc req-9a947b93-a0c9-452a-9f08-c0500c4d8eb7 service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] No waiting events found dispatching network-vif-plugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:40 user nova-compute[75246]: WARNING nova.compute.manager [req-29c10e84-3fb9-42aa-9f7d-90e15ae008fc req-9a947b93-a0c9-452a-9f08-c0500c4d8eb7 service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received unexpected event network-vif-plugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1f1cbd-1205-4469-bbf0-9117f033eb0b]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17, portal: 172.16.0.220,3260]
Nov 28 17:02:40 user nova-compute[75246]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17, portal: 172.16.0.220,3260] successful.
Nov 28 17:02:40 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46eec365-ee40-488c-ab1d-296e8bfb0a17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9bd712-1757-444c-aee9-6f8d2f05c522]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] <== disconnect_volume: return (314ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG nova.compute.manager [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:02:40 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Instance spawned successfully.
Nov 28 17:02:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRMWKwCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f6fe7bf7-782c-4660-9612-101c9f277903', 'attached_at': '', 'detached_at': '', 'volume_id': 'b396e853-b227-4072-b566-bc9dc97a0047', 'serial'} {{(pid=75246) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] swap_volume: removing Cinder connection for volume 46eec365-ee40-488c-ab1d-296e8bfb0a17 {{(pid=75246) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:02:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:02:41 user nova-compute[75246]: DEBUG nova.compute.manager [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:02:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:41 user nova-compute[75246]: DEBUG nova.objects.instance [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75246) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 28 17:02:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-40d21ee3-d32f-4fb3-a97d-1f98bbdd294c tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.102s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:41 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] swap_volume: Updating volume 46eec365-ee40-488c-ab1d-296e8bfb0a17 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "TRMWKwCD", "auth_password": "0JwYUMKcadz9bE", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "b396e853-b227-4072-b566-bc9dc97a0047"}, "status": "reserved", "instance": "f6fe7bf7-782c-4660-9612-101c9f277903", "attached_at": "", "detached_at": "", "volume_id": "b396e853-b227-4072-b566-bc9dc97a0047", "serial": "b396e853-b227-4072-b566-bc9dc97a0047"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b396e853-b227-4072-b566-bc9dc97a0047', 'no_device': None, 'attachment_id': '11b78509-6094-4e49-92ff-c1bc9c3c8708'} {{(pid=75246) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 28 17:02:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f9e10ac2-a470-4567-86a3-6660b29e02e7 tempest-TestVolumeSwap-1709382921 tempest-TestVolumeSwap-1709382921-project-admin] Lock "f6fe7bf7-782c-4660-9612-101c9f277903" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.478s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Acquiring lock "f6fe7bf7-782c-4660-9612-101c9f277903" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "f6fe7bf7-782c-4660-9612-101c9f277903" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:42 user nova-compute[75246]: INFO nova.compute.manager [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Detaching volume b396e853-b227-4072-b566-bc9dc97a0047
Nov 28 17:02:42 user nova-compute[75246]: INFO nova.virt.block_device [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Attempting to driver detach volume b396e853-b227-4072-b566-bc9dc97a0047 from mountpoint /dev/vdb
Nov 28 17:02:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Attempting to detach device vdb from instance f6fe7bf7-782c-4660-9612-101c9f277903 from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:02:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:02:42 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:02:42 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:02:42 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:02:42 user nova-compute[75246]:   <serial>b396e853-b227-4072-b566-bc9dc97a0047</serial>
Nov 28 17:02:42 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:02:42 user nova-compute[75246]: </disk>
Nov 28 17:02:42 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:02:42 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Successfully detached device vdb from instance f6fe7bf7-782c-4660-9612-101c9f277903 from the persistent domain config.
Nov 28 17:02:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6fe7bf7-782c-4660-9612-101c9f277903 from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:02:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:02:42 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:02:42 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:02:42 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:02:42 user nova-compute[75246]:   <serial>b396e853-b227-4072-b566-bc9dc97a0047</serial>
Nov 28 17:02:42 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:02:42 user nova-compute[75246]: </disk>
Nov 28 17:02:42 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:02:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6fe7bf7-782c-4660-9612-101c9f277903 {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:02:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:55 user nova-compute[75246]: DEBUG nova.compute.manager [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:02:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:02:55 user nova-compute[75246]: INFO nova.compute.claims [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Claim successful on node user
Nov 28 17:02:55 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:02:55 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:02:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:55 user nova-compute[75246]: DEBUG nova.compute.manager [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:02:55 user nova-compute[75246]: DEBUG nova.compute.manager [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:02:55 user nova-compute[75246]: DEBUG nova.network.neutron [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:02:55 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:02:55 user nova-compute[75246]: DEBUG nova.compute.manager [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:02:55 user nova-compute[75246]: DEBUG nova.policy [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '136ea37d7d6a4cd1a2f4779f8e8c4cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559858a844e64c6c80e194efd0b71c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG nova.compute.manager [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:02:56 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Creating image(s)
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "/opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "/opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.194s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.197s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/disk 1073741824" returned: 0 in 0.054s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.168s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Cannot resize image /opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Ensure instance console log exists: /opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.network.neutron [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Successfully created port: d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.network.neutron [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Successfully updated port: d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "refresh_cache-9f711268-28e4-4e2e-b5eb-e875c0d72e5b" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquired lock "refresh_cache-9f711268-28e4-4e2e-b5eb-e875c0d72e5b" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.network.neutron [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-301526b9-210a-469a-b380-4dac5806d43a req-76839559-5c8a-46c0-a9e4-7d1fe6be37d0 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Received event network-changed-d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-301526b9-210a-469a-b380-4dac5806d43a req-76839559-5c8a-46c0-a9e4-7d1fe6be37d0 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Refreshing instance network info cache due to event network-changed-d2b06fbc-0c49-459a-900c-f7a178b91bda. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-301526b9-210a-469a-b380-4dac5806d43a req-76839559-5c8a-46c0-a9e4-7d1fe6be37d0 service nova] Acquiring lock "refresh_cache-9f711268-28e4-4e2e-b5eb-e875c0d72e5b" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.network.neutron [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.network.neutron [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Updating instance_info_cache with network_info: [{"id": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "address": "fa:16:3e:b4:44:79", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b06fbc-0c", "ovs_interfaceid": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Releasing lock "refresh_cache-9f711268-28e4-4e2e-b5eb-e875c0d72e5b" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Instance network_info: |[{"id": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "address": "fa:16:3e:b4:44:79", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b06fbc-0c", "ovs_interfaceid": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-301526b9-210a-469a-b380-4dac5806d43a req-76839559-5c8a-46c0-a9e4-7d1fe6be37d0 service nova] Acquired lock "refresh_cache-9f711268-28e4-4e2e-b5eb-e875c0d72e5b" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.network.neutron [req-301526b9-210a-469a-b380-4dac5806d43a req-76839559-5c8a-46c0-a9e4-7d1fe6be37d0 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Refreshing network info cache for port d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Start _get_guest_xml network_info=[{"id": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "address": "fa:16:3e:b4:44:79", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b06fbc-0c", "ovs_interfaceid": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:02:57 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:02:57 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1496002471',display_name='tempest-VolumesAdminNegativeTest-server-1496002471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1496002471',id=14,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='559858a844e64c6c80e194efd0b71c9c',ramdisk_id='',reservation_id='r-fq3bhmiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-996939064',owner_user_name='tempest-VolumesAdminNegativeTest-996939064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:02:56Z,user_data=None,user_id='136ea37d7d6a4cd1a2f4779f8e8c4cb7',uuid=9f711268-28e4-4e2e-b5eb-e875c0d72e5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "address": "fa:16:3e:b4:44:79", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b06fbc-0c", "ovs_interfaceid": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Converting VIF {"id": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "address": "fa:16:3e:b4:44:79", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b06fbc-0c", "ovs_interfaceid": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:44:79,bridge_name='br-int',has_traffic_filtering=True,id=d2b06fbc-0c49-459a-900c-f7a178b91bda,network=Network(7c4b4f14-738c-4741-a7d1-b831c7557206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2b06fbc-0c') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.objects.instance [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f711268-28e4-4e2e-b5eb-e875c0d72e5b {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:02:57 user nova-compute[75246]:   <uuid>9f711268-28e4-4e2e-b5eb-e875c0d72e5b</uuid>
Nov 28 17:02:57 user nova-compute[75246]:   <name>instance-0000000e</name>
Nov 28 17:02:57 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:02:57 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:02:57 user nova-compute[75246]:   <metadata>
Nov 28 17:02:57 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:02:57 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:02:57 user nova-compute[75246]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1496002471</nova:name>
Nov 28 17:02:57 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:02:57</nova:creationTime>
Nov 28 17:02:57 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:02:57 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:02:57 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:02:57 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:02:57 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:02:57 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:02:57 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:02:57 user nova-compute[75246]:       <nova:owner>
Nov 28 17:02:57 user nova-compute[75246]:         <nova:user uuid="136ea37d7d6a4cd1a2f4779f8e8c4cb7">tempest-VolumesAdminNegativeTest-996939064-project-member</nova:user>
Nov 28 17:02:57 user nova-compute[75246]:         <nova:project uuid="559858a844e64c6c80e194efd0b71c9c">tempest-VolumesAdminNegativeTest-996939064</nova:project>
Nov 28 17:02:57 user nova-compute[75246]:       </nova:owner>
Nov 28 17:02:57 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:02:57 user nova-compute[75246]:       <nova:ports>
Nov 28 17:02:57 user nova-compute[75246]:         <nova:port uuid="d2b06fbc-0c49-459a-900c-f7a178b91bda">
Nov 28 17:02:57 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 17:02:57 user nova-compute[75246]:         </nova:port>
Nov 28 17:02:57 user nova-compute[75246]:       </nova:ports>
Nov 28 17:02:57 user nova-compute[75246]:     </nova:instance>
Nov 28 17:02:57 user nova-compute[75246]:   </metadata>
Nov 28 17:02:57 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:02:57 user nova-compute[75246]:     <system>
Nov 28 17:02:57 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:02:57 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:02:57 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:02:57 user nova-compute[75246]:       <entry name="serial">9f711268-28e4-4e2e-b5eb-e875c0d72e5b</entry>
Nov 28 17:02:57 user nova-compute[75246]:       <entry name="uuid">9f711268-28e4-4e2e-b5eb-e875c0d72e5b</entry>
Nov 28 17:02:57 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:02:57 user nova-compute[75246]:     </system>
Nov 28 17:02:57 user nova-compute[75246]:   </sysinfo>
Nov 28 17:02:57 user nova-compute[75246]:   <os>
Nov 28 17:02:57 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:02:57 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:02:57 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:02:57 user nova-compute[75246]:   </os>
Nov 28 17:02:57 user nova-compute[75246]:   <features>
Nov 28 17:02:57 user nova-compute[75246]:     <acpi/>
Nov 28 17:02:57 user nova-compute[75246]:     <apic/>
Nov 28 17:02:57 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:02:57 user nova-compute[75246]:   </features>
Nov 28 17:02:57 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:02:57 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:02:57 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:02:57 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:02:57 user nova-compute[75246]:   </clock>
Nov 28 17:02:57 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:02:57 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:02:57 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:02:57 user nova-compute[75246]:   </cpu>
Nov 28 17:02:57 user nova-compute[75246]:   <devices>
Nov 28 17:02:57 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:02:57 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:02:57 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/disk"/>
Nov 28 17:02:57 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:02:57 user nova-compute[75246]:     </disk>
Nov 28 17:02:57 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:02:57 user nova-compute[75246]:       <mac address="fa:16:3e:b4:44:79"/>
Nov 28 17:02:57 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:02:57 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:02:57 user nova-compute[75246]:       <target dev="tapd2b06fbc-0c"/>
Nov 28 17:02:57 user nova-compute[75246]:     </interface>
Nov 28 17:02:57 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:02:57 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/console.log" append="off"/>
Nov 28 17:02:57 user nova-compute[75246]:     </serial>
Nov 28 17:02:57 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:02:57 user nova-compute[75246]:     <video>
Nov 28 17:02:57 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:02:57 user nova-compute[75246]:     </video>
Nov 28 17:02:57 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:02:57 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:02:57 user nova-compute[75246]:     </rng>
Nov 28 17:02:57 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:02:57 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:02:57 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:02:57 user nova-compute[75246]:     </memballoon>
Nov 28 17:02:57 user nova-compute[75246]:   </devices>
Nov 28 17:02:57 user nova-compute[75246]: </domain>
Nov 28 17:02:57 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1496002471',display_name='tempest-VolumesAdminNegativeTest-server-1496002471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1496002471',id=14,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='559858a844e64c6c80e194efd0b71c9c',ramdisk_id='',reservation_id='r-fq3bhmiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-996939064',owner_user_name='tempest-VolumesAdminNegativeTest-996939064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:02:56Z,user_data=None,user_id='136ea37d7d6a4cd1a2f4779f8e8c4cb7',uuid=9f711268-28e4-4e2e-b5eb-e875c0d72e5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "address": "fa:16:3e:b4:44:79", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b06fbc-0c", "ovs_interfaceid": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Converting VIF {"id": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "address": "fa:16:3e:b4:44:79", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b06fbc-0c", "ovs_interfaceid": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:44:79,bridge_name='br-int',has_traffic_filtering=True,id=d2b06fbc-0c49-459a-900c-f7a178b91bda,network=Network(7c4b4f14-738c-4741-a7d1-b831c7557206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2b06fbc-0c') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG os_vif [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:44:79,bridge_name='br-int',has_traffic_filtering=True,id=d2b06fbc-0c49-459a-900c-f7a178b91bda,network=Network(7c4b4f14-738c-4741-a7d1-b831c7557206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2b06fbc-0c') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7da7056a-eabf-5855-9799-732e430ce5ee', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2b06fbc-0c, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2b06fbc-0c, col_values=(('qos', UUID('91cb2fdc-8142-4955-9290-f9f3238868fd')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2b06fbc-0c, col_values=(('external_ids', {'iface-id': 'd2b06fbc-0c49-459a-900c-f7a178b91bda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:44:79', 'vm-uuid': '9f711268-28e4-4e2e-b5eb-e875c0d72e5b'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:02:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:02:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:58 user nova-compute[75246]: INFO os_vif [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:44:79,bridge_name='br-int',has_traffic_filtering=True,id=d2b06fbc-0c49-459a-900c-f7a178b91bda,network=Network(7c4b4f14-738c-4741-a7d1-b831c7557206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2b06fbc-0c')
Nov 28 17:02:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:02:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] No VIF found with MAC fa:16:3e:b4:44:79, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:02:58 user nova-compute[75246]: DEBUG nova.network.neutron [req-301526b9-210a-469a-b380-4dac5806d43a req-76839559-5c8a-46c0-a9e4-7d1fe6be37d0 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Updated VIF entry in instance network info cache for port d2b06fbc-0c49-459a-900c-f7a178b91bda. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:02:58 user nova-compute[75246]: DEBUG nova.network.neutron [req-301526b9-210a-469a-b380-4dac5806d43a req-76839559-5c8a-46c0-a9e4-7d1fe6be37d0 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Updating instance_info_cache with network_info: [{"id": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "address": "fa:16:3e:b4:44:79", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b06fbc-0c", "ovs_interfaceid": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:02:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-301526b9-210a-469a-b380-4dac5806d43a req-76839559-5c8a-46c0-a9e4-7d1fe6be37d0 service nova] Releasing lock "refresh_cache-9f711268-28e4-4e2e-b5eb-e875c0d72e5b" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:02:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:02:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-16554565-55a0-4c6c-92dd-a6d9f1b664aa req-d15c755d-f82b-406d-ae2c-88093a9a39e8 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Received event network-vif-plugged-d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:02:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-16554565-55a0-4c6c-92dd-a6d9f1b664aa req-d15c755d-f82b-406d-ae2c-88093a9a39e8 service nova] Acquiring lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:02:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-16554565-55a0-4c6c-92dd-a6d9f1b664aa req-d15c755d-f82b-406d-ae2c-88093a9a39e8 service nova] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:02:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-16554565-55a0-4c6c-92dd-a6d9f1b664aa req-d15c755d-f82b-406d-ae2c-88093a9a39e8 service nova] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:02:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-16554565-55a0-4c6c-92dd-a6d9f1b664aa req-d15c755d-f82b-406d-ae2c-88093a9a39e8 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] No waiting events found dispatching network-vif-plugged-d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:02:59 user nova-compute[75246]: WARNING nova.compute.manager [req-16554565-55a0-4c6c-92dd-a6d9f1b664aa req-d15c755d-f82b-406d-ae2c-88093a9a39e8 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Received unexpected event network-vif-plugged-d2b06fbc-0c49-459a-900c-f7a178b91bda for instance with vm_state building and task_state spawning.
Nov 28 17:02:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:01 user nova-compute[75246]: DEBUG nova.compute.manager [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:03:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:03:01 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Instance spawned successfully.
Nov 28 17:03:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:03:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-214d776e-6ec5-4a57-8556-cc78bdb70a01 req-a9e86d79-2fc8-4228-8805-72d31bac9261 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Received event network-vif-plugged-d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-214d776e-6ec5-4a57-8556-cc78bdb70a01 req-a9e86d79-2fc8-4228-8805-72d31bac9261 service nova] Acquiring lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-214d776e-6ec5-4a57-8556-cc78bdb70a01 req-a9e86d79-2fc8-4228-8805-72d31bac9261 service nova] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-214d776e-6ec5-4a57-8556-cc78bdb70a01 req-a9e86d79-2fc8-4228-8805-72d31bac9261 service nova] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-214d776e-6ec5-4a57-8556-cc78bdb70a01 req-a9e86d79-2fc8-4228-8805-72d31bac9261 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] No waiting events found dispatching network-vif-plugged-d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:01 user nova-compute[75246]: WARNING nova.compute.manager [req-214d776e-6ec5-4a57-8556-cc78bdb70a01 req-a9e86d79-2fc8-4228-8805-72d31bac9261 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Received unexpected event network-vif-plugged-d2b06fbc-0c49-459a-900c-f7a178b91bda for instance with vm_state building and task_state spawning.
Nov 28 17:03:01 user nova-compute[75246]: INFO nova.compute.manager [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 28 17:03:01 user nova-compute[75246]: DEBUG nova.compute.manager [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:03:01 user nova-compute[75246]: INFO nova.compute.manager [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Took 6.51 seconds to build instance.
Nov 28 17:03:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5f65f7ea-5f4c-4402-adaa-9fb1fbcd4c68 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.680s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:03 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f6fe7bf7-782c-4660-9612-101c9f277903 is timed out.
Nov 28 17:03:03 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Successfully detached device vdb from instance f6fe7bf7-782c-4660-9612-101c9f277903 from the live domain config.
Nov 28 17:03:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRMWKwCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'b396e853-b227-4072-b566-bc9dc97a0047'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:03:03 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a92a31-7931-4d67-926f-b943564c4ddd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:03:03 user nova-compute[75246]: No targets found.
Nov 28 17:03:03 user nova-compute[75246]: iSNS:
Nov 28 17:03:03 user nova-compute[75246]: No targets found.
Nov 28 17:03:03 user nova-compute[75246]: STATIC:
Nov 28 17:03:03 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047
Nov 28 17:03:03 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:03:03 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:03:03 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1
Nov 28 17:03:03 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:03:03 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:03:03 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353
Nov 28 17:03:03 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:03:03 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:03:03 user nova-compute[75246]: FIRMWARE:
Nov 28 17:03:03 user nova-compute[75246]: No targets found.
Nov 28 17:03:03 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:03:03 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:03:03 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24a68b9-0976-4e8b-ba14-de5bd1a471b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0c704d-592b-4005-8c3f-ab7865cee575]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:03:03 user nova-compute[75246]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:03:03 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:03:03 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 (non-flash)
Nov 28 17:03:03 user nova-compute[75246]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:03:03 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:03:03 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d83f6b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047'): ({'sdc'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Removing single pathed devices sdc {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e1b13a-3447-4a7e-90c0-667b148907cb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a6175d-cf0a-40c0-a3fa-f283238187b2]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Flushing IO for device /dev/sdc {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6157538-4733-48fa-9556-4f540dc38b93]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3cbff3-8688-4813-a00c-8f454977cf2a]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd485229-4eaa-45e5-9cfc-8219fcbbb6b3]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6eb974-c3aa-4617-9ade-bd9efdf9fe19]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047, portal: 172.16.0.220,3260]
Nov 28 17:03:03 user nova-compute[75246]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047, portal: 172.16.0.220,3260] successful.
Nov 28 17:03:03 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b396e853-b227-4072-b566-bc9dc97a0047 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[187c7308-8bec-4438-aeb3-210ba4928ad8]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] <== disconnect_volume: return (328ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:03:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:03:04 user nova-compute[75246]: DEBUG nova.objects.instance [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lazy-loading 'flavor' on Instance uuid f6fe7bf7-782c-4660-9612-101c9f277903 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:03:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8285e281-250d-42a8-b701-5869eb6e9d5e tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "f6fe7bf7-782c-4660-9612-101c9f277903" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.974s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "1358a444-8765-4863-a9b6-9b0e53eaff51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "1358a444-8765-4863-a9b6-9b0e53eaff51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:08 user nova-compute[75246]: INFO nova.compute.manager [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Terminating instance
Nov 28 17:03:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:03:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-8e87be41-143f-4a94-9c5d-0a83b3bb2916 req-34f36238-4222-4dc6-b030-052148c7fd61 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Received event network-vif-unplugged-9cc4adc2-b744-448d-9393-c659ed3e33dd {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8e87be41-143f-4a94-9c5d-0a83b3bb2916 req-34f36238-4222-4dc6-b030-052148c7fd61 service nova] Acquiring lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8e87be41-143f-4a94-9c5d-0a83b3bb2916 req-34f36238-4222-4dc6-b030-052148c7fd61 service nova] Lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8e87be41-143f-4a94-9c5d-0a83b3bb2916 req-34f36238-4222-4dc6-b030-052148c7fd61 service nova] Lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-8e87be41-143f-4a94-9c5d-0a83b3bb2916 req-34f36238-4222-4dc6-b030-052148c7fd61 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] No waiting events found dispatching network-vif-unplugged-9cc4adc2-b744-448d-9393-c659ed3e33dd {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-8e87be41-143f-4a94-9c5d-0a83b3bb2916 req-34f36238-4222-4dc6-b030-052148c7fd61 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Received event network-vif-unplugged-9cc4adc2-b744-448d-9393-c659ed3e33dd for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:09 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Instance destroyed successfully.
Nov 28 17:03:09 user nova-compute[75246]: DEBUG nova.objects.instance [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lazy-loading 'resources' on Instance uuid 1358a444-8765-4863-a9b6-9b0e53eaff51 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-439501669',display_name='tempest-ServersNegativeTestJSON-server-439501669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-439501669',id=12,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:01:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbde1b5b56914297ab276a983b4dd56b',ramdisk_id='',reservation_id='r-ud0p2c3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-368898789',owner_user_name='tempest-ServersNegativeTestJSON-368898789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:01:28Z,user_data=None,user_id='ed5bb6d3f84b4c90990c68ed1d55b1c0',uuid=1358a444-8765-4863-a9b6-9b0e53eaff51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "address": "fa:16:3e:00:60:8d", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc4adc2-b7", "ovs_interfaceid": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Converting VIF {"id": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "address": "fa:16:3e:00:60:8d", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cc4adc2-b7", "ovs_interfaceid": "9cc4adc2-b744-448d-9393-c659ed3e33dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:60:8d,bridge_name='br-int',has_traffic_filtering=True,id=9cc4adc2-b744-448d-9393-c659ed3e33dd,network=Network(75d646d7-52d6-4455-8014-0381aa33c56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cc4adc2-b7') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG os_vif [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:60:8d,bridge_name='br-int',has_traffic_filtering=True,id=9cc4adc2-b744-448d-9393-c659ed3e33dd,network=Network(75d646d7-52d6-4455-8014-0381aa33c56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cc4adc2-b7') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cc4adc2-b7, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b8ff953-13c7-4ea6-9909-761f936ed49d) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:03:09 user nova-compute[75246]: INFO os_vif [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:60:8d,bridge_name='br-int',has_traffic_filtering=True,id=9cc4adc2-b744-448d-9393-c659ed3e33dd,network=Network(75d646d7-52d6-4455-8014-0381aa33c56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cc4adc2-b7')
Nov 28 17:03:09 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Deleting instance files /opt/stack/data/nova/instances/1358a444-8765-4863-a9b6-9b0e53eaff51_del
Nov 28 17:03:09 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Deletion of /opt/stack/data/nova/instances/1358a444-8765-4863-a9b6-9b0e53eaff51_del complete
Nov 28 17:03:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:09 user nova-compute[75246]: INFO nova.compute.manager [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 28 17:03:09 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:10 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-d362524f-ae4e-4ab3-80d3-113b798fbeaf req-8657f732-a342-4e47-9456-2b58e3b0530e service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Received event network-vif-deleted-9cc4adc2-b744-448d-9393-c659ed3e33dd {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:10 user nova-compute[75246]: INFO nova.compute.manager [req-d362524f-ae4e-4ab3-80d3-113b798fbeaf req-8657f732-a342-4e47-9456-2b58e3b0530e service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Neutron deleted interface 9cc4adc2-b744-448d-9393-c659ed3e33dd; detaching it from the instance and deleting it from the info cache
Nov 28 17:03:10 user nova-compute[75246]: DEBUG nova.network.neutron [req-d362524f-ae4e-4ab3-80d3-113b798fbeaf req-8657f732-a342-4e47-9456-2b58e3b0530e service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:10 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Took 0.80 seconds to deallocate network for instance.
Nov 28 17:03:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-d362524f-ae4e-4ab3-80d3-113b798fbeaf req-8657f732-a342-4e47-9456-2b58e3b0530e service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Detach interface failed, port_id=9cc4adc2-b744-448d-9393-c659ed3e33dd, reason: Instance 1358a444-8765-4863-a9b6-9b0e53eaff51 could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:03:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:10 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:03:10 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:03:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:10 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Deleted allocations for instance 1358a444-8765-4863-a9b6-9b0e53eaff51
Nov 28 17:03:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-11c1ee24-d1de-4724-a1f3-1a2ac98e6fa0 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "1358a444-8765-4863-a9b6-9b0e53eaff51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.349s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-094544cb-f4c6-4269-9c31-35f1e0c03075 req-9b3dd10b-2528-4c85-a34f-6f00c37dc025 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Received event network-vif-plugged-9cc4adc2-b744-448d-9393-c659ed3e33dd {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-094544cb-f4c6-4269-9c31-35f1e0c03075 req-9b3dd10b-2528-4c85-a34f-6f00c37dc025 service nova] Acquiring lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-094544cb-f4c6-4269-9c31-35f1e0c03075 req-9b3dd10b-2528-4c85-a34f-6f00c37dc025 service nova] Lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-094544cb-f4c6-4269-9c31-35f1e0c03075 req-9b3dd10b-2528-4c85-a34f-6f00c37dc025 service nova] Lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-094544cb-f4c6-4269-9c31-35f1e0c03075 req-9b3dd10b-2528-4c85-a34f-6f00c37dc025 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] No waiting events found dispatching network-vif-plugged-9cc4adc2-b744-448d-9393-c659ed3e33dd {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:11 user nova-compute[75246]: WARNING nova.compute.manager [req-094544cb-f4c6-4269-9c31-35f1e0c03075 req-9b3dd10b-2528-4c85-a34f-6f00c37dc025 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Received unexpected event network-vif-plugged-9cc4adc2-b744-448d-9393-c659ed3e33dd for instance with vm_state deleted and task_state None.
Nov 28 17:03:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-094544cb-f4c6-4269-9c31-35f1e0c03075 req-9b3dd10b-2528-4c85-a34f-6f00c37dc025 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Received event network-vif-plugged-9cc4adc2-b744-448d-9393-c659ed3e33dd {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-094544cb-f4c6-4269-9c31-35f1e0c03075 req-9b3dd10b-2528-4c85-a34f-6f00c37dc025 service nova] Acquiring lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-094544cb-f4c6-4269-9c31-35f1e0c03075 req-9b3dd10b-2528-4c85-a34f-6f00c37dc025 service nova] Lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-094544cb-f4c6-4269-9c31-35f1e0c03075 req-9b3dd10b-2528-4c85-a34f-6f00c37dc025 service nova] Lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-094544cb-f4c6-4269-9c31-35f1e0c03075 req-9b3dd10b-2528-4c85-a34f-6f00c37dc025 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] No waiting events found dispatching network-vif-plugged-9cc4adc2-b744-448d-9393-c659ed3e33dd {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:11 user nova-compute[75246]: WARNING nova.compute.manager [req-094544cb-f4c6-4269-9c31-35f1e0c03075 req-9b3dd10b-2528-4c85-a34f-6f00c37dc025 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Received unexpected event network-vif-plugged-9cc4adc2-b744-448d-9393-c659ed3e33dd for instance with vm_state deleted and task_state None.
Nov 28 17:03:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-094544cb-f4c6-4269-9c31-35f1e0c03075 req-9b3dd10b-2528-4c85-a34f-6f00c37dc025 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Received event network-vif-plugged-9cc4adc2-b744-448d-9393-c659ed3e33dd {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-094544cb-f4c6-4269-9c31-35f1e0c03075 req-9b3dd10b-2528-4c85-a34f-6f00c37dc025 service nova] Acquiring lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-094544cb-f4c6-4269-9c31-35f1e0c03075 req-9b3dd10b-2528-4c85-a34f-6f00c37dc025 service nova] Lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-094544cb-f4c6-4269-9c31-35f1e0c03075 req-9b3dd10b-2528-4c85-a34f-6f00c37dc025 service nova] Lock "1358a444-8765-4863-a9b6-9b0e53eaff51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-094544cb-f4c6-4269-9c31-35f1e0c03075 req-9b3dd10b-2528-4c85-a34f-6f00c37dc025 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] No waiting events found dispatching network-vif-plugged-9cc4adc2-b744-448d-9393-c659ed3e33dd {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:11 user nova-compute[75246]: WARNING nova.compute.manager [req-094544cb-f4c6-4269-9c31-35f1e0c03075 req-9b3dd10b-2528-4c85-a34f-6f00c37dc025 service nova] [instance: 1358a444-8765-4863-a9b6-9b0e53eaff51] Received unexpected event network-vif-plugged-9cc4adc2-b744-448d-9393-c659ed3e33dd for instance with vm_state deleted and task_state None.
Nov 28 17:03:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Acquiring lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Acquiring lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:11 user nova-compute[75246]: INFO nova.compute.manager [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Terminating instance
Nov 28 17:03:11 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:11 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Instance destroyed successfully.
Nov 28 17:03:11 user nova-compute[75246]: DEBUG nova.objects.instance [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Lazy-loading 'resources' on Instance uuid 24d45b28-61df-43cb-bdae-f8ce6b3aaca3 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:03:12 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:00:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-431930084',display_name='tempest-VolumesAssistedSnapshotsTest-server-431930084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-431930084',id=8,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzOrOPbbIAYO+R2rf6r1TtZhub/aUKWWdBbYdczir+SVyqYlLhnLFVioE7anmQ4XMimHE1WLBBQZ5JEZpp08+lr2ifeSLV/IYz1Pw8xmcN4Cy/0HjYrxAju7Jo0juw+EQ==',key_name='tempest-keypair-1417787953',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:00:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='131b53fb281648c79ad65e38978a7c3b',ramdisk_id='',reservation_id='r-0vpp7evw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-97764733',owner_user_name='tempest-VolumesAssistedSnapshotsTest-97764733-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:00:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45b2d3471ff74cdca08768d09ca4ee0a',uuid=24d45b28-61df-43cb-bdae-f8ce6b3aaca3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "address": "fa:16:3e:54:89:d5", "network": {"id": "52ca7b7f-3ab7-4a79-a471-baeb55da51eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1832570935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131b53fb281648c79ad65e38978a7c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac51a369-6c", "ovs_interfaceid": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:03:12 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Converting VIF {"id": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "address": "fa:16:3e:54:89:d5", "network": {"id": "52ca7b7f-3ab7-4a79-a471-baeb55da51eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1832570935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131b53fb281648c79ad65e38978a7c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac51a369-6c", "ovs_interfaceid": "ac51a369-6c87-41c1-8b7c-a313a3b72ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:03:12 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:89:d5,bridge_name='br-int',has_traffic_filtering=True,id=ac51a369-6c87-41c1-8b7c-a313a3b72ee3,network=Network(52ca7b7f-3ab7-4a79-a471-baeb55da51eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac51a369-6c') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:03:12 user nova-compute[75246]: DEBUG os_vif [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:89:d5,bridge_name='br-int',has_traffic_filtering=True,id=ac51a369-6c87-41c1-8b7c-a313a3b72ee3,network=Network(52ca7b7f-3ab7-4a79-a471-baeb55da51eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac51a369-6c') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:03:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac51a369-6c, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=07357e4d-cf31-4865-a8d6-b9d7e71515a2) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:12 user nova-compute[75246]: INFO os_vif [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:89:d5,bridge_name='br-int',has_traffic_filtering=True,id=ac51a369-6c87-41c1-8b7c-a313a3b72ee3,network=Network(52ca7b7f-3ab7-4a79-a471-baeb55da51eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac51a369-6c')
Nov 28 17:03:12 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Deleting instance files /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3_del
Nov 28 17:03:12 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Deletion of /opt/stack/data/nova/instances/24d45b28-61df-43cb-bdae-f8ce6b3aaca3_del complete
Nov 28 17:03:12 user nova-compute[75246]: INFO nova.compute.manager [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 28 17:03:12 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:03:12 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:03:12 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:03:12 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:12 user nova-compute[75246]: DEBUG nova.compute.manager [req-d1c52c26-241a-4aee-9b5a-0aadffdf655f req-59d345eb-de63-49da-a5af-00f4181c01c3 service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Received event network-vif-deleted-ac51a369-6c87-41c1-8b7c-a313a3b72ee3 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:12 user nova-compute[75246]: INFO nova.compute.manager [req-d1c52c26-241a-4aee-9b5a-0aadffdf655f req-59d345eb-de63-49da-a5af-00f4181c01c3 service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Neutron deleted interface ac51a369-6c87-41c1-8b7c-a313a3b72ee3; detaching it from the instance and deleting it from the info cache
Nov 28 17:03:12 user nova-compute[75246]: DEBUG nova.network.neutron [req-d1c52c26-241a-4aee-9b5a-0aadffdf655f req-59d345eb-de63-49da-a5af-00f4181c01c3 service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:12 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Took 0.87 seconds to deallocate network for instance.
Nov 28 17:03:12 user nova-compute[75246]: DEBUG nova.compute.manager [req-d1c52c26-241a-4aee-9b5a-0aadffdf655f req-59d345eb-de63-49da-a5af-00f4181c01c3 service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Detach interface failed, port_id=ac51a369-6c87-41c1-8b7c-a313a3b72ee3, reason: Instance 24d45b28-61df-43cb-bdae-f8ce6b3aaca3 could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:03:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-35b32ced-7fbd-4ab7-8413-826304a3d8b7 req-8a275569-c926-47bb-a677-93ead9c4ed59 service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Received event network-vif-unplugged-ac51a369-6c87-41c1-8b7c-a313a3b72ee3 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-35b32ced-7fbd-4ab7-8413-826304a3d8b7 req-8a275569-c926-47bb-a677-93ead9c4ed59 service nova] Acquiring lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-35b32ced-7fbd-4ab7-8413-826304a3d8b7 req-8a275569-c926-47bb-a677-93ead9c4ed59 service nova] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-35b32ced-7fbd-4ab7-8413-826304a3d8b7 req-8a275569-c926-47bb-a677-93ead9c4ed59 service nova] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-35b32ced-7fbd-4ab7-8413-826304a3d8b7 req-8a275569-c926-47bb-a677-93ead9c4ed59 service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] No waiting events found dispatching network-vif-unplugged-ac51a369-6c87-41c1-8b7c-a313a3b72ee3 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-35b32ced-7fbd-4ab7-8413-826304a3d8b7 req-8a275569-c926-47bb-a677-93ead9c4ed59 service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Received event network-vif-unplugged-ac51a369-6c87-41c1-8b7c-a313a3b72ee3 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:03:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-35b32ced-7fbd-4ab7-8413-826304a3d8b7 req-8a275569-c926-47bb-a677-93ead9c4ed59 service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Received event network-vif-plugged-ac51a369-6c87-41c1-8b7c-a313a3b72ee3 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-35b32ced-7fbd-4ab7-8413-826304a3d8b7 req-8a275569-c926-47bb-a677-93ead9c4ed59 service nova] Acquiring lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-35b32ced-7fbd-4ab7-8413-826304a3d8b7 req-8a275569-c926-47bb-a677-93ead9c4ed59 service nova] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-35b32ced-7fbd-4ab7-8413-826304a3d8b7 req-8a275569-c926-47bb-a677-93ead9c4ed59 service nova] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-35b32ced-7fbd-4ab7-8413-826304a3d8b7 req-8a275569-c926-47bb-a677-93ead9c4ed59 service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] No waiting events found dispatching network-vif-plugged-ac51a369-6c87-41c1-8b7c-a313a3b72ee3 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:13 user nova-compute[75246]: WARNING nova.compute.manager [req-35b32ced-7fbd-4ab7-8413-826304a3d8b7 req-8a275569-c926-47bb-a677-93ead9c4ed59 service nova] [instance: 24d45b28-61df-43cb-bdae-f8ce6b3aaca3] Received unexpected event network-vif-plugged-ac51a369-6c87-41c1-8b7c-a313a3b72ee3 for instance with vm_state active and task_state deleting.
Nov 28 17:03:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:13 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:03:13 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:03:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:13 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Deleted allocations for instance 24d45b28-61df-43cb-bdae-f8ce6b3aaca3
Nov 28 17:03:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e461fd4-266a-4876-83b8-14e5603619bd tempest-VolumesAssistedSnapshotsTest-97764733 tempest-VolumesAssistedSnapshotsTest-97764733-project-member] Lock "24d45b28-61df-43cb-bdae-f8ce6b3aaca3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.500s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:17 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:03:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "86142721-b9dd-44ab-b994-f81443b5383c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "86142721-b9dd-44ab-b994-f81443b5383c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:03:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:03:18 user nova-compute[75246]: INFO nova.compute.claims [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Claim successful on node user
Nov 28 17:03:18 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:03:18 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:03:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:03:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:03:18 user nova-compute[75246]: DEBUG nova.network.neutron [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:03:18 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:03:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:03:18 user nova-compute[75246]: DEBUG nova.policy [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39d2eb0837eb4c729fe9ca2964cbe789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be06eee4e74a41b799f1df75ea55b955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:03:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:03:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:03:18 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Creating image(s)
Nov 28 17:03:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "/opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "/opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "/opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.197s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.296s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk 1073741824" returned: 0 in 0.162s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.468s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG nova.network.neutron [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Successfully created port: 2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.194s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Cannot resize image /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Ensure instance console log exists: /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "4b650a57-5870-4f77-bca2-abe50d970b40" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:20 user nova-compute[75246]: DEBUG nova.objects.instance [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lazy-loading 'flavor' on Instance uuid 4b650a57-5870-4f77-bca2-abe50d970b40 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:03:20 user nova-compute[75246]: DEBUG nova.network.neutron [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Successfully updated port: 2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:03:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "4b650a57-5870-4f77-bca2-abe50d970b40" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "refresh_cache-86142721-b9dd-44ab-b994-f81443b5383c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:03:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquired lock "refresh_cache-86142721-b9dd-44ab-b994-f81443b5383c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:03:20 user nova-compute[75246]: DEBUG nova.network.neutron [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:03:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-326181fa-b794-4c5b-8a2b-06c15eab7ba0 req-9f2d6afa-e2f7-4c9e-8ded-a1caf8dc7ad8 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received event network-changed-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-326181fa-b794-4c5b-8a2b-06c15eab7ba0 req-9f2d6afa-e2f7-4c9e-8ded-a1caf8dc7ad8 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Refreshing instance network info cache due to event network-changed-2438ce69-6032-4ced-abea-84518ff89dfb. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:03:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-326181fa-b794-4c5b-8a2b-06c15eab7ba0 req-9f2d6afa-e2f7-4c9e-8ded-a1caf8dc7ad8 service nova] Acquiring lock "refresh_cache-86142721-b9dd-44ab-b994-f81443b5383c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:03:20 user nova-compute[75246]: DEBUG nova.network.neutron [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:03:20 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:03:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "4b650a57-5870-4f77-bca2-abe50d970b40" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:20 user nova-compute[75246]: INFO nova.compute.manager [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Attaching volume 3d2f58a0-30e0-4819-aae0-07657c5f32b4 to /dev/vdb
Nov 28 17:03:20 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG os_brick.utils [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e3e0b8-8d3b-4661-8cb5-834977d252c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[035a3997-13fa-4216-ad03-0c3cfc0fa1c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e5a0b8-314d-44a4-a114-67415cb4aa6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[981ea15c-49da-4e19-96a3-0e7c7d2e6632]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.network.neutron [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Updating instance_info_cache with network_info: [{"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Releasing lock "refresh_cache-86142721-b9dd-44ab-b994-f81443b5383c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Instance network_info: |[{"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:03:21 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b500c329-89ff-4957-903a-dd8148c2368c]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-326181fa-b794-4c5b-8a2b-06c15eab7ba0 req-9f2d6afa-e2f7-4c9e-8ded-a1caf8dc7ad8 service nova] Acquired lock "refresh_cache-86142721-b9dd-44ab-b994-f81443b5383c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.network.neutron [req-326181fa-b794-4c5b-8a2b-06c15eab7ba0 req-9f2d6afa-e2f7-4c9e-8ded-a1caf8dc7ad8 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Refreshing network info cache for port 2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Start _get_guest_xml network_info=[{"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG os_brick.utils [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Updating existing volume attachment record: 882aa8bd-b419-4797-a813-ac831b15c4b1 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:03:21 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:03:21 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:03:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-982853153',display_name='tempest-tempest.common.compute-instance-982853153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-982853153',id=15,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsIJC+q4Y4+55AC0y9HnA2vvt/v6RCSMYzioCDQ5Wqsi/6fMiuZzeuzQCkQ89dqnBC2m8g7FsGK4x+WMLFrWYG5HbTNoob2Sth9T+5kRFE/RvVS0LYqJNwESjTmUvS1xg==',key_name='tempest-keypair-2146767292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be06eee4e74a41b799f1df75ea55b955',ramdisk_id='',reservation_id='r-j7yi3b0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1554281978',owner_user_name='tempest-ServerActionsTestOtherA-1554281978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:03:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39d2eb0837eb4c729fe9ca2964cbe789',uuid=86142721-b9dd-44ab-b994-f81443b5383c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converting VIF {"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:31:e2,bridge_name='br-int',has_traffic_filtering=True,id=2438ce69-6032-4ced-abea-84518ff89dfb,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2438ce69-60') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.objects.instance [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lazy-loading 'pci_devices' on Instance uuid 86142721-b9dd-44ab-b994-f81443b5383c {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:03:21 user nova-compute[75246]:   <uuid>86142721-b9dd-44ab-b994-f81443b5383c</uuid>
Nov 28 17:03:21 user nova-compute[75246]:   <name>instance-0000000f</name>
Nov 28 17:03:21 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:03:21 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:03:21 user nova-compute[75246]:   <metadata>
Nov 28 17:03:21 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:03:21 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:03:21 user nova-compute[75246]:       <nova:name>tempest-tempest.common.compute-instance-982853153</nova:name>
Nov 28 17:03:21 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:03:21</nova:creationTime>
Nov 28 17:03:21 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:03:21 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:03:21 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:03:21 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:03:21 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:03:21 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:03:21 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:03:21 user nova-compute[75246]:       <nova:owner>
Nov 28 17:03:21 user nova-compute[75246]:         <nova:user uuid="39d2eb0837eb4c729fe9ca2964cbe789">tempest-ServerActionsTestOtherA-1554281978-project-member</nova:user>
Nov 28 17:03:21 user nova-compute[75246]:         <nova:project uuid="be06eee4e74a41b799f1df75ea55b955">tempest-ServerActionsTestOtherA-1554281978</nova:project>
Nov 28 17:03:21 user nova-compute[75246]:       </nova:owner>
Nov 28 17:03:21 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:03:21 user nova-compute[75246]:       <nova:ports>
Nov 28 17:03:21 user nova-compute[75246]:         <nova:port uuid="2438ce69-6032-4ced-abea-84518ff89dfb">
Nov 28 17:03:21 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 17:03:21 user nova-compute[75246]:         </nova:port>
Nov 28 17:03:21 user nova-compute[75246]:       </nova:ports>
Nov 28 17:03:21 user nova-compute[75246]:     </nova:instance>
Nov 28 17:03:21 user nova-compute[75246]:   </metadata>
Nov 28 17:03:21 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:03:21 user nova-compute[75246]:     <system>
Nov 28 17:03:21 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:03:21 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:03:21 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:03:21 user nova-compute[75246]:       <entry name="serial">86142721-b9dd-44ab-b994-f81443b5383c</entry>
Nov 28 17:03:21 user nova-compute[75246]:       <entry name="uuid">86142721-b9dd-44ab-b994-f81443b5383c</entry>
Nov 28 17:03:21 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:03:21 user nova-compute[75246]:     </system>
Nov 28 17:03:21 user nova-compute[75246]:   </sysinfo>
Nov 28 17:03:21 user nova-compute[75246]:   <os>
Nov 28 17:03:21 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:03:21 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:03:21 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:03:21 user nova-compute[75246]:   </os>
Nov 28 17:03:21 user nova-compute[75246]:   <features>
Nov 28 17:03:21 user nova-compute[75246]:     <acpi/>
Nov 28 17:03:21 user nova-compute[75246]:     <apic/>
Nov 28 17:03:21 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:03:21 user nova-compute[75246]:   </features>
Nov 28 17:03:21 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:03:21 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:03:21 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:03:21 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:03:21 user nova-compute[75246]:   </clock>
Nov 28 17:03:21 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:03:21 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:03:21 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:03:21 user nova-compute[75246]:   </cpu>
Nov 28 17:03:21 user nova-compute[75246]:   <devices>
Nov 28 17:03:21 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:03:21 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:03:21 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk"/>
Nov 28 17:03:21 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:03:21 user nova-compute[75246]:     </disk>
Nov 28 17:03:21 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:03:21 user nova-compute[75246]:       <mac address="fa:16:3e:b8:31:e2"/>
Nov 28 17:03:21 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:03:21 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:03:21 user nova-compute[75246]:       <target dev="tap2438ce69-60"/>
Nov 28 17:03:21 user nova-compute[75246]:     </interface>
Nov 28 17:03:21 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:03:21 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/console.log" append="off"/>
Nov 28 17:03:21 user nova-compute[75246]:     </serial>
Nov 28 17:03:21 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:03:21 user nova-compute[75246]:     <video>
Nov 28 17:03:21 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:03:21 user nova-compute[75246]:     </video>
Nov 28 17:03:21 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:03:21 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:03:21 user nova-compute[75246]:     </rng>
Nov 28 17:03:21 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:03:21 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:03:21 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:03:21 user nova-compute[75246]:     </memballoon>
Nov 28 17:03:21 user nova-compute[75246]:   </devices>
Nov 28 17:03:21 user nova-compute[75246]: </domain>
Nov 28 17:03:21 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:03:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-982853153',display_name='tempest-tempest.common.compute-instance-982853153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-982853153',id=15,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsIJC+q4Y4+55AC0y9HnA2vvt/v6RCSMYzioCDQ5Wqsi/6fMiuZzeuzQCkQ89dqnBC2m8g7FsGK4x+WMLFrWYG5HbTNoob2Sth9T+5kRFE/RvVS0LYqJNwESjTmUvS1xg==',key_name='tempest-keypair-2146767292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be06eee4e74a41b799f1df75ea55b955',ramdisk_id='',reservation_id='r-j7yi3b0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1554281978',owner_user_name='tempest-ServerActionsTestOtherA-1554281978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:03:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39d2eb0837eb4c729fe9ca2964cbe789',uuid=86142721-b9dd-44ab-b994-f81443b5383c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converting VIF {"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:31:e2,bridge_name='br-int',has_traffic_filtering=True,id=2438ce69-6032-4ced-abea-84518ff89dfb,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2438ce69-60') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG os_vif [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:31:e2,bridge_name='br-int',has_traffic_filtering=True,id=2438ce69-6032-4ced-abea-84518ff89dfb,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2438ce69-60') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04822151-fcb6-5cba-b726-88e781d36cf3', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2438ce69-60, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2438ce69-60, col_values=(('qos', UUID('74e197d1-70f3-448c-afd7-e0ad6933fe32')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2438ce69-60, col_values=(('external_ids', {'iface-id': '2438ce69-6032-4ced-abea-84518ff89dfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:31:e2', 'vm-uuid': '86142721-b9dd-44ab-b994-f81443b5383c'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:21 user nova-compute[75246]: INFO os_vif [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:31:e2,bridge_name='br-int',has_traffic_filtering=True,id=2438ce69-6032-4ced-abea-84518ff89dfb,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2438ce69-60')
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] No VIF found with MAC fa:16:3e:b8:31:e2, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.network.neutron [req-326181fa-b794-4c5b-8a2b-06c15eab7ba0 req-9f2d6afa-e2f7-4c9e-8ded-a1caf8dc7ad8 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Updated VIF entry in instance network info cache for port 2438ce69-6032-4ced-abea-84518ff89dfb. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.network.neutron [req-326181fa-b794-4c5b-8a2b-06c15eab7ba0 req-9f2d6afa-e2f7-4c9e-8ded-a1caf8dc7ad8 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Updating instance_info_cache with network_info: [{"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-326181fa-b794-4c5b-8a2b-06c15eab7ba0 req-9f2d6afa-e2f7-4c9e-8ded-a1caf8dc7ad8 service nova] Releasing lock "refresh_cache-86142721-b9dd-44ab-b994-f81443b5383c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:03:21 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:03:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-915bc61e-eaea-40c0-a5ed-4d2a677477f8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:03:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-915bc61e-eaea-40c0-a5ed-4d2a677477f8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:03:22 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:03:22 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Updating instance_info_cache with network_info: [{"id": "40798d97-9143-4283-90ba-2bf3f34c1f51", "address": "fa:16:3e:14:c6:95", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40798d97-91", "ovs_interfaceid": "40798d97-9143-4283-90ba-2bf3f34c1f51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-915bc61e-eaea-40c0-a5ed-4d2a677477f8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:03:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:03:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:03:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:03:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:22 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:03:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-5add6930-eb60-4b3a-955d-6992863b8d11 req-11c0b68f-ebe1-49f8-82bf-7debd2391e24 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received event network-vif-plugged-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5add6930-eb60-4b3a-955d-6992863b8d11 req-11c0b68f-ebe1-49f8-82bf-7debd2391e24 service nova] Acquiring lock "86142721-b9dd-44ab-b994-f81443b5383c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5add6930-eb60-4b3a-955d-6992863b8d11 req-11c0b68f-ebe1-49f8-82bf-7debd2391e24 service nova] Lock "86142721-b9dd-44ab-b994-f81443b5383c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5add6930-eb60-4b3a-955d-6992863b8d11 req-11c0b68f-ebe1-49f8-82bf-7debd2391e24 service nova] Lock "86142721-b9dd-44ab-b994-f81443b5383c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-5add6930-eb60-4b3a-955d-6992863b8d11 req-11c0b68f-ebe1-49f8-82bf-7debd2391e24 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] No waiting events found dispatching network-vif-plugged-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:23 user nova-compute[75246]: WARNING nova.compute.manager [req-5add6930-eb60-4b3a-955d-6992863b8d11 req-11c0b68f-ebe1-49f8-82bf-7debd2391e24 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received unexpected event network-vif-plugged-2438ce69-6032-4ced-abea-84518ff89dfb for instance with vm_state building and task_state spawning.
Nov 28 17:03:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-31670270-18a2-4854-87f3-872dc8fc43ee req-75863b80-8947-4bae-9d3f-cc49339d70e9 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received event network-vif-plugged-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-31670270-18a2-4854-87f3-872dc8fc43ee req-75863b80-8947-4bae-9d3f-cc49339d70e9 service nova] Acquiring lock "86142721-b9dd-44ab-b994-f81443b5383c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-31670270-18a2-4854-87f3-872dc8fc43ee req-75863b80-8947-4bae-9d3f-cc49339d70e9 service nova] Lock "86142721-b9dd-44ab-b994-f81443b5383c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-31670270-18a2-4854-87f3-872dc8fc43ee req-75863b80-8947-4bae-9d3f-cc49339d70e9 service nova] Lock "86142721-b9dd-44ab-b994-f81443b5383c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-31670270-18a2-4854-87f3-872dc8fc43ee req-75863b80-8947-4bae-9d3f-cc49339d70e9 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] No waiting events found dispatching network-vif-plugged-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:25 user nova-compute[75246]: WARNING nova.compute.manager [req-31670270-18a2-4854-87f3-872dc8fc43ee req-75863b80-8947-4bae-9d3f-cc49339d70e9 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received unexpected event network-vif-plugged-2438ce69-6032-4ced-abea-84518ff89dfb for instance with vm_state building and task_state spawning.
Nov 28 17:03:25 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:03:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:03:25 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Instance spawned successfully.
Nov 28 17:03:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:03:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:25 user nova-compute[75246]: INFO nova.compute.manager [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Took 6.80 seconds to spawn the instance on the hypervisor.
Nov 28 17:03:25 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:03:25 user nova-compute[75246]: INFO nova.compute.manager [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Took 7.61 seconds to build instance.
Nov 28 17:03:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ac8b9c42-78c1-4b6b-8716-7e583d27c27c tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "86142721-b9dd-44ab-b994-f81443b5383c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.758s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:28 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:03:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:29 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjtFMPWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:03:30 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:03:30 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:03:30 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:03:30 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:03:30 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=7594MB free_disk=25.694774627685547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbd7b91-9fb9-495b-88fc-9a4a55d2916e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:03:30 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a22c770-3ddd-49c2-943f-8b94bcc7619a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4] added
Nov 28 17:03:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6a6075-4f7a-4874-a07e-6d85ae666854]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55cf933-8543-40d8-9690-ca89f4408393]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjtFMPWJ {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjtFMPWJ" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5963de1-5a6c-40c5-b683-25d5404f7c83]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AjtFMPWJ'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[baeca8a9-7a28-48c7-9052-17d5d3575ed6]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 25480185-8c9c-4aad-9c46-573cfbf65364 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e1266470-c182-4c0c-a575-4c5043f54745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 4b650a57-5870-4f77-bca2-abe50d970b40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 915bc61e-eaea-40c0-a5ed-4d2a677477f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance f6fe7bf7-782c-4660-9612-101c9f277903 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a3fe15c9-36ab-404e-876e-e6241cca05f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 9f306608-7716-41e0-9aa0-afa8ba173a04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 69f05219-5034-4e88-879c-9c567e2c2fcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 9f711268-28e4-4e2e-b5eb-e875c0d72e5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 86142721-b9dd-44ab-b994-f81443b5383c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b877afb7-d5ea-4a91-811f-f96c1c26ecf2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:03:30 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:03:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:03:30 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:03:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-6ed8fc26-d710-456c-a872-8d903a500393 req-8986976e-046d-4e6a-afbd-53b62844b651 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-changed-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-6ed8fc26-d710-456c-a872-8d903a500393 req-8986976e-046d-4e6a-afbd-53b62844b651 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Refreshing instance network info cache due to event network-changed-068da4fa-d42e-47e8-8e7e-81bda7521356. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6ed8fc26-d710-456c-a872-8d903a500393 req-8986976e-046d-4e6a-afbd-53b62844b651 service nova] Acquiring lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6ed8fc26-d710-456c-a872-8d903a500393 req-8986976e-046d-4e6a-afbd-53b62844b651 service nova] Acquired lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.network.neutron [req-6ed8fc26-d710-456c-a872-8d903a500393 req-8986976e-046d-4e6a-afbd-53b62844b651 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Refreshing network info cache for port 068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc3efad-cbd9-4c47-9e75-855ebc7bc32b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260]
Nov 28 17:03:30 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260] successful.
Nov 28 17:03:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[702d0fdc-dfd3-4e24-a561-19479b0fc3dd]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cfb914-14cf-45cc-84f9-25f45e3f1dc1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:03:30 user nova-compute[75246]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:03:30 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:03:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:03:30 user nova-compute[75246]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:03:30 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:03:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b33c4ea-5e46-4d4f-9e50-09582bc3953e]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjtFMPWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.740s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:03:30 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:03:31 user nova-compute[75246]: DEBUG nova.network.neutron [req-6ed8fc26-d710-456c-a872-8d903a500393 req-8986976e-046d-4e6a-afbd-53b62844b651 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Updated VIF entry in instance network info cache for port 068da4fa-d42e-47e8-8e7e-81bda7521356. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:03:31 user nova-compute[75246]: DEBUG nova.network.neutron [req-6ed8fc26-d710-456c-a872-8d903a500393 req-8986976e-046d-4e6a-afbd-53b62844b651 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Updating instance_info_cache with network_info: [{"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6ed8fc26-d710-456c-a872-8d903a500393 req-8986976e-046d-4e6a-afbd-53b62844b651 service nova] Releasing lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:03:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "69f05219-5034-4e88-879c-9c567e2c2fcd" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:31 user nova-compute[75246]: INFO nova.compute.manager [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Shelve offloading
Nov 28 17:03:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:03:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23562396665333164', 'path': '/dev/sdb'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:03:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562396665333164', 'path': '/dev/sdb'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:03:31 user nova-compute[75246]: DEBUG nova.objects.instance [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lazy-loading 'flavor' on Instance uuid 4b650a57-5870-4f77-bca2-abe50d970b40 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:03:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:03:31 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:03:31 user nova-compute[75246]:   <source dev="/dev/sdb"/>
Nov 28 17:03:31 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:03:31 user nova-compute[75246]:   <serial>3d2f58a0-30e0-4819-aae0-07657c5f32b4</serial>
Nov 28 17:03:31 user nova-compute[75246]: </disk>
Nov 28 17:03:31 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:03:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:32 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Instance destroyed successfully.
Nov 28 17:03:32 user nova-compute[75246]: DEBUG nova.compute.manager [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:03:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:03:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquired lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:03:32 user nova-compute[75246]: DEBUG nova.network.neutron [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:03:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-856f1414-cb01-4bc5-b6cf-251587a37e15 req-2a541b0d-dddf-4c41-a4b2-c357699e1dae service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-vif-unplugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-856f1414-cb01-4bc5-b6cf-251587a37e15 req-2a541b0d-dddf-4c41-a4b2-c357699e1dae service nova] Acquiring lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-856f1414-cb01-4bc5-b6cf-251587a37e15 req-2a541b0d-dddf-4c41-a4b2-c357699e1dae service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-856f1414-cb01-4bc5-b6cf-251587a37e15 req-2a541b0d-dddf-4c41-a4b2-c357699e1dae service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-856f1414-cb01-4bc5-b6cf-251587a37e15 req-2a541b0d-dddf-4c41-a4b2-c357699e1dae service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] No waiting events found dispatching network-vif-unplugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:32 user nova-compute[75246]: WARNING nova.compute.manager [req-856f1414-cb01-4bc5-b6cf-251587a37e15 req-2a541b0d-dddf-4c41-a4b2-c357699e1dae service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received unexpected event network-vif-unplugged-068da4fa-d42e-47e8-8e7e-81bda7521356 for instance with vm_state active and task_state shelving.
Nov 28 17:03:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-856f1414-cb01-4bc5-b6cf-251587a37e15 req-2a541b0d-dddf-4c41-a4b2-c357699e1dae service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-856f1414-cb01-4bc5-b6cf-251587a37e15 req-2a541b0d-dddf-4c41-a4b2-c357699e1dae service nova] Acquiring lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-856f1414-cb01-4bc5-b6cf-251587a37e15 req-2a541b0d-dddf-4c41-a4b2-c357699e1dae service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-856f1414-cb01-4bc5-b6cf-251587a37e15 req-2a541b0d-dddf-4c41-a4b2-c357699e1dae service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-856f1414-cb01-4bc5-b6cf-251587a37e15 req-2a541b0d-dddf-4c41-a4b2-c357699e1dae service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] No waiting events found dispatching network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:32 user nova-compute[75246]: WARNING nova.compute.manager [req-856f1414-cb01-4bc5-b6cf-251587a37e15 req-2a541b0d-dddf-4c41-a4b2-c357699e1dae service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received unexpected event network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 for instance with vm_state active and task_state shelving.
Nov 28 17:03:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:03:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:03:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] No VIF found with MAC fa:16:3e:d2:1a:3a, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:03:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d66aab89-8de8-4c33-911f-ebdbafd928db tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "4b650a57-5870-4f77-bca2-abe50d970b40" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.039s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Acquiring lock "f6fe7bf7-782c-4660-9612-101c9f277903" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "f6fe7bf7-782c-4660-9612-101c9f277903" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Acquiring lock "f6fe7bf7-782c-4660-9612-101c9f277903-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "f6fe7bf7-782c-4660-9612-101c9f277903-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "f6fe7bf7-782c-4660-9612-101c9f277903-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:33 user nova-compute[75246]: INFO nova.compute.manager [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Terminating instance
Nov 28 17:03:33 user nova-compute[75246]: DEBUG nova.compute.manager [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:03:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-e2919ab0-25cf-4071-9508-11539fc789cb req-254e4063-557c-4c0f-bbb8-f55fb89eb622 service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Received event network-vif-unplugged-5fe78c0a-025c-4ce0-b370-83959a0e2df7 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e2919ab0-25cf-4071-9508-11539fc789cb req-254e4063-557c-4c0f-bbb8-f55fb89eb622 service nova] Acquiring lock "f6fe7bf7-782c-4660-9612-101c9f277903-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e2919ab0-25cf-4071-9508-11539fc789cb req-254e4063-557c-4c0f-bbb8-f55fb89eb622 service nova] Lock "f6fe7bf7-782c-4660-9612-101c9f277903-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e2919ab0-25cf-4071-9508-11539fc789cb req-254e4063-557c-4c0f-bbb8-f55fb89eb622 service nova] Lock "f6fe7bf7-782c-4660-9612-101c9f277903-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-e2919ab0-25cf-4071-9508-11539fc789cb req-254e4063-557c-4c0f-bbb8-f55fb89eb622 service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] No waiting events found dispatching network-vif-unplugged-5fe78c0a-025c-4ce0-b370-83959a0e2df7 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-e2919ab0-25cf-4071-9508-11539fc789cb req-254e4063-557c-4c0f-bbb8-f55fb89eb622 service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Received event network-vif-unplugged-5fe78c0a-025c-4ce0-b370-83959a0e2df7 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG nova.network.neutron [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Updating instance_info_cache with network_info: [{"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Releasing lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Instance destroyed successfully.
Nov 28 17:03:34 user nova-compute[75246]: DEBUG nova.objects.instance [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lazy-loading 'resources' on Instance uuid f6fe7bf7-782c-4660-9612-101c9f277903 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-438192936',display_name='tempest-TestVolumeSwap-server-438192936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-438192936',id=5,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmb9iqAq8cVkq7Ta/yQKi954GQnH4/8zXmeyg2DZAENLt1AW1tNEDN9dQR2uXAryz0lRMSTv41jDirlVXQgg3NbMHiHxHeOr8GwPTx7DVZeiC04q2Yb279wpEfNqukqpw==',key_name='tempest-keypair-1299658914',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:00:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='710057a2ce0441d3a6d78aab651ee091',ramdisk_id='',reservation_id='r-v78zfrog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-84820142',owner_user_name='tempest-TestVolumeSwap-84820142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e382903dea418ab2ff2ac4b0fd193a',uuid=f6fe7bf7-782c-4660-9612-101c9f277903,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "address": "fa:16:3e:d6:6b:75", "network": {"id": "d5b830a2-9940-49dc-947f-accb65b0f73a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1793539391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710057a2ce0441d3a6d78aab651ee091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe78c0a-02", "ovs_interfaceid": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Converting VIF {"id": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "address": "fa:16:3e:d6:6b:75", "network": {"id": "d5b830a2-9940-49dc-947f-accb65b0f73a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1793539391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710057a2ce0441d3a6d78aab651ee091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe78c0a-02", "ovs_interfaceid": "5fe78c0a-025c-4ce0-b370-83959a0e2df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:6b:75,bridge_name='br-int',has_traffic_filtering=True,id=5fe78c0a-025c-4ce0-b370-83959a0e2df7,network=Network(d5b830a2-9940-49dc-947f-accb65b0f73a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe78c0a-02') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG os_vif [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:6b:75,bridge_name='br-int',has_traffic_filtering=True,id=5fe78c0a-025c-4ce0-b370-83959a0e2df7,network=Network(d5b830a2-9940-49dc-947f-accb65b0f73a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe78c0a-02') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fe78c0a-02, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a2707c9-ec2f-4817-9713-240cf1964c83) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:34 user nova-compute[75246]: INFO os_vif [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:6b:75,bridge_name='br-int',has_traffic_filtering=True,id=5fe78c0a-025c-4ce0-b370-83959a0e2df7,network=Network(d5b830a2-9940-49dc-947f-accb65b0f73a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe78c0a-02')
Nov 28 17:03:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Deleting instance files /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903_del
Nov 28 17:03:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Deletion of /opt/stack/data/nova/instances/f6fe7bf7-782c-4660-9612-101c9f277903_del complete
Nov 28 17:03:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-01c65944-8e58-4c07-a112-7fe96273a57b req-34ea2365-9ffc-4500-8e1c-eed1e0b84fa2 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-01c65944-8e58-4c07-a112-7fe96273a57b req-34ea2365-9ffc-4500-8e1c-eed1e0b84fa2 service nova] Acquiring lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-01c65944-8e58-4c07-a112-7fe96273a57b req-34ea2365-9ffc-4500-8e1c-eed1e0b84fa2 service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-01c65944-8e58-4c07-a112-7fe96273a57b req-34ea2365-9ffc-4500-8e1c-eed1e0b84fa2 service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-01c65944-8e58-4c07-a112-7fe96273a57b req-34ea2365-9ffc-4500-8e1c-eed1e0b84fa2 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] No waiting events found dispatching network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:34 user nova-compute[75246]: WARNING nova.compute.manager [req-01c65944-8e58-4c07-a112-7fe96273a57b req-34ea2365-9ffc-4500-8e1c-eed1e0b84fa2 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received unexpected event network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 for instance with vm_state active and task_state shelving.
Nov 28 17:03:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-01c65944-8e58-4c07-a112-7fe96273a57b req-34ea2365-9ffc-4500-8e1c-eed1e0b84fa2 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-01c65944-8e58-4c07-a112-7fe96273a57b req-34ea2365-9ffc-4500-8e1c-eed1e0b84fa2 service nova] Acquiring lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-01c65944-8e58-4c07-a112-7fe96273a57b req-34ea2365-9ffc-4500-8e1c-eed1e0b84fa2 service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-01c65944-8e58-4c07-a112-7fe96273a57b req-34ea2365-9ffc-4500-8e1c-eed1e0b84fa2 service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-01c65944-8e58-4c07-a112-7fe96273a57b req-34ea2365-9ffc-4500-8e1c-eed1e0b84fa2 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] No waiting events found dispatching network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:34 user nova-compute[75246]: WARNING nova.compute.manager [req-01c65944-8e58-4c07-a112-7fe96273a57b req-34ea2365-9ffc-4500-8e1c-eed1e0b84fa2 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received unexpected event network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 for instance with vm_state active and task_state shelving.
Nov 28 17:03:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-01c65944-8e58-4c07-a112-7fe96273a57b req-34ea2365-9ffc-4500-8e1c-eed1e0b84fa2 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-vif-unplugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-01c65944-8e58-4c07-a112-7fe96273a57b req-34ea2365-9ffc-4500-8e1c-eed1e0b84fa2 service nova] Acquiring lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-01c65944-8e58-4c07-a112-7fe96273a57b req-34ea2365-9ffc-4500-8e1c-eed1e0b84fa2 service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-01c65944-8e58-4c07-a112-7fe96273a57b req-34ea2365-9ffc-4500-8e1c-eed1e0b84fa2 service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-01c65944-8e58-4c07-a112-7fe96273a57b req-34ea2365-9ffc-4500-8e1c-eed1e0b84fa2 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] No waiting events found dispatching network-vif-unplugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:34 user nova-compute[75246]: WARNING nova.compute.manager [req-01c65944-8e58-4c07-a112-7fe96273a57b req-34ea2365-9ffc-4500-8e1c-eed1e0b84fa2 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received unexpected event network-vif-unplugged-068da4fa-d42e-47e8-8e7e-81bda7521356 for instance with vm_state active and task_state shelving.
Nov 28 17:03:34 user nova-compute[75246]: INFO nova.compute.manager [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 28 17:03:34 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:03:34 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:03:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Stashing vm_state: active {{(pid=75246) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-4fd29119-9df5-4805-8803-88da20990107 req-b3b346e8-2f33-4622-bcf1-2b4553d82994 service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Received event network-vif-plugged-5fe78c0a-025c-4ce0-b370-83959a0e2df7 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4fd29119-9df5-4805-8803-88da20990107 req-b3b346e8-2f33-4622-bcf1-2b4553d82994 service nova] Acquiring lock "f6fe7bf7-782c-4660-9612-101c9f277903-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4fd29119-9df5-4805-8803-88da20990107 req-b3b346e8-2f33-4622-bcf1-2b4553d82994 service nova] Lock "f6fe7bf7-782c-4660-9612-101c9f277903-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4fd29119-9df5-4805-8803-88da20990107 req-b3b346e8-2f33-4622-bcf1-2b4553d82994 service nova] Lock "f6fe7bf7-782c-4660-9612-101c9f277903-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-4fd29119-9df5-4805-8803-88da20990107 req-b3b346e8-2f33-4622-bcf1-2b4553d82994 service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] No waiting events found dispatching network-vif-plugged-5fe78c0a-025c-4ce0-b370-83959a0e2df7 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:36 user nova-compute[75246]: WARNING nova.compute.manager [req-4fd29119-9df5-4805-8803-88da20990107 req-b3b346e8-2f33-4622-bcf1-2b4553d82994 service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Received unexpected event network-vif-plugged-5fe78c0a-025c-4ce0-b370-83959a0e2df7 for instance with vm_state active and task_state deleting.
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:03:36 user nova-compute[75246]: INFO nova.compute.claims [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Claim successful on node user
Nov 28 17:03:36 user nova-compute[75246]: INFO nova.compute.resource_tracker [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Updating resource usage from migration 80be8226-a637-4d78-b2c5-26341b30b340
Nov 28 17:03:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-2d727d9f-a5bd-4d99-a2a8-9b7c5dd60f60 req-a6e50aa9-1fa2-40ef-a849-4fe185c33a09 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2d727d9f-a5bd-4d99-a2a8-9b7c5dd60f60 req-a6e50aa9-1fa2-40ef-a849-4fe185c33a09 service nova] Acquiring lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2d727d9f-a5bd-4d99-a2a8-9b7c5dd60f60 req-a6e50aa9-1fa2-40ef-a849-4fe185c33a09 service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2d727d9f-a5bd-4d99-a2a8-9b7c5dd60f60 req-a6e50aa9-1fa2-40ef-a849-4fe185c33a09 service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-2d727d9f-a5bd-4d99-a2a8-9b7c5dd60f60 req-a6e50aa9-1fa2-40ef-a849-4fe185c33a09 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] No waiting events found dispatching network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:36 user nova-compute[75246]: WARNING nova.compute.manager [req-2d727d9f-a5bd-4d99-a2a8-9b7c5dd60f60 req-a6e50aa9-1fa2-40ef-a849-4fe185c33a09 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received unexpected event network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 for instance with vm_state active and task_state shelving.
Nov 28 17:03:36 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Instance destroyed successfully.
Nov 28 17:03:36 user nova-compute[75246]: DEBUG nova.objects.instance [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lazy-loading 'resources' on Instance uuid 69f05219-5034-4e88-879c-9c567e2c2fcd {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-261959295',display_name='tempest-TestShelveInstance-server-261959295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-261959295',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSXhLKm+++wgAM7YsUZWQNI57Qq/Uvo2sGpCIC0eWLA3a2G9dj59rvWwSkvl7YMi6fzuXFku8/GYlW1BRbrTLvl4ZqaNoDq5vRDvO38j64HIwGgl9GxlRYNZCFpgggI0Q==',key_name='tempest-TestShelveInstance-1911568956',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:01:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='572ea174564b4afdbf607e501e025fd8',ramdisk_id='',reservation_id='r-hodplmom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-640383248',owner_user_name='tempest-TestShelveInstance-640383248-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:01:52Z,user_data=None,user_id='58d26618e4064fedb1bd65d14920652d',uuid=69f05219-5034-4e88-879c-9c567e2c2fcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Converting VIF {"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e6:81,bridge_name='br-int',has_traffic_filtering=True,id=068da4fa-d42e-47e8-8e7e-81bda7521356,network=Network(5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068da4fa-d4') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG os_vif [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e6:81,bridge_name='br-int',has_traffic_filtering=True,id=068da4fa-d42e-47e8-8e7e-81bda7521356,network=Network(5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068da4fa-d4') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap068da4fa-d4, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f85a0999-f9be-4233-9b73-01292cb1bd78) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:36 user nova-compute[75246]: INFO os_vif [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e6:81,bridge_name='br-int',has_traffic_filtering=True,id=068da4fa-d42e-47e8-8e7e-81bda7521356,network=Network(5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068da4fa-d4')
Nov 28 17:03:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJLxnbkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:03:36 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:03:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7af5b6a-51aa-4139-994a-c7ddd3a0360a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:03:36 user nova-compute[75246]: No targets found.
Nov 28 17:03:36 user nova-compute[75246]: iSNS:
Nov 28 17:03:36 user nova-compute[75246]: No targets found.
Nov 28 17:03:36 user nova-compute[75246]: STATIC:
Nov 28 17:03:36 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1
Nov 28 17:03:36 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:03:36 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:03:36 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353
Nov 28 17:03:36 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:03:36 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:03:36 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4
Nov 28 17:03:36 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:03:36 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:03:36 user nova-compute[75246]: FIRMWARE:
Nov 28 17:03:36 user nova-compute[75246]: No targets found.
Nov 28 17:03:36 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:03:36 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:03:36 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd3a672-9f9d-49f3-baac-ecaa35c70dd2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb0928d-bbb4-4ccb-bbd5-6c02351c3ad1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:03:36 user nova-compute[75246]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:03:36 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:03:36 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:03:36 user nova-compute[75246]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:03:36 user nova-compute[75246]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:03:36 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d83c0f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353'): ({'sdf'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Removing single pathed devices sdf {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.567s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:36 user nova-compute[75246]: INFO nova.compute.manager [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Migrating
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:03:36 user nova-compute[75246]: INFO nova.compute.rpcapi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcab12ce-98cc-4d93-a4e6-05ed83744464]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cf945c-66de-423c-9d0e-3b406a26a5de]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Flushing IO for device /dev/sdf {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4c1603-36b6-4c7d-84db-f3a442725a8c]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquired lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG nova.network.neutron [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[51aa84ed-58cd-4baf-82fe-f1d7ef669684]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] SCSI volumes sdf have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2888e8c6-bb87-4d91-9481-77b3cdb0177c]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6ad656-074e-4b1b-9073-fa6f92c4e6f6]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353, portal: 172.16.0.220,3260]
Nov 28 17:03:37 user nova-compute[75246]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353, portal: 172.16.0.220,3260] successful.
Nov 28 17:03:37 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[994b9cfb-f26c-44ef-bc82-5ba20b346fee]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] <== disconnect_volume: return (398ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:03:37 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Deleting instance files /opt/stack/data/nova/instances/69f05219-5034-4e88-879c-9c567e2c2fcd_del
Nov 28 17:03:37 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Deletion of /opt/stack/data/nova/instances/69f05219-5034-4e88-879c-9c567e2c2fcd_del complete
Nov 28 17:03:37 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:37 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Took 2.59 seconds to deallocate network for instance.
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG nova.network.neutron [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Updating instance_info_cache with network_info: [{"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Releasing lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:03:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.597s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:38 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Deleted allocations for instance f6fe7bf7-782c-4660-9612-101c9f277903
Nov 28 17:03:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-93cc463b-bfde-4218-987f-dcf64bee6bdb tempest-TestVolumeSwap-84820142 tempest-TestVolumeSwap-84820142-project-member] Lock "f6fe7bf7-782c-4660-9612-101c9f277903" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.913s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Starting migrate_disk_and_power_off {{(pid=75246) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-032d4ac2-87b1-4b80-9189-3326fdefdae2 req-cf2ecf17-335a-494d-b34d-16761e5cb67e service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received event network-vif-unplugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-032d4ac2-87b1-4b80-9189-3326fdefdae2 req-cf2ecf17-335a-494d-b34d-16761e5cb67e service nova] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-032d4ac2-87b1-4b80-9189-3326fdefdae2 req-cf2ecf17-335a-494d-b34d-16761e5cb67e service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-032d4ac2-87b1-4b80-9189-3326fdefdae2 req-cf2ecf17-335a-494d-b34d-16761e5cb67e service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-032d4ac2-87b1-4b80-9189-3326fdefdae2 req-cf2ecf17-335a-494d-b34d-16761e5cb67e service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] No waiting events found dispatching network-vif-unplugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:38 user nova-compute[75246]: WARNING nova.compute.manager [req-032d4ac2-87b1-4b80-9189-3326fdefdae2 req-cf2ecf17-335a-494d-b34d-16761e5cb67e service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received unexpected event network-vif-unplugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 for instance with vm_state active and task_state resize_migrating.
Nov 28 17:03:38 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Deleted allocations for instance 69f05219-5034-4e88-879c-9c567e2c2fcd
Nov 28 17:03:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG nova.objects.instance [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lazy-loading 'numa_topology' on Instance uuid 69f05219-5034-4e88-879c-9c567e2c2fcd {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG nova.objects.base [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Object Instance<69f05219-5034-4e88-879c-9c567e2c2fcd> lazy-loaded attributes: resources,numa_topology {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-9e783295-b8db-4206-ad0e-a3f35f92a1ec req-422b8e3f-d360-4df4-8ab2-689be60a6c75 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-changed-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-9e783295-b8db-4206-ad0e-a3f35f92a1ec req-422b8e3f-d360-4df4-8ab2-689be60a6c75 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Refreshing instance network info cache due to event network-changed-068da4fa-d42e-47e8-8e7e-81bda7521356. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e783295-b8db-4206-ad0e-a3f35f92a1ec req-422b8e3f-d360-4df4-8ab2-689be60a6c75 service nova] Acquiring lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e783295-b8db-4206-ad0e-a3f35f92a1ec req-422b8e3f-d360-4df4-8ab2-689be60a6c75 service nova] Acquired lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:03:38 user nova-compute[75246]: DEBUG nova.network.neutron [req-9e783295-b8db-4206-ad0e-a3f35f92a1ec req-422b8e3f-d360-4df4-8ab2-689be60a6c75 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Refreshing network info cache for port 068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:03:39 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Instance destroyed successfully.
Nov 28 17:03:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-511980533',display_name='tempest-ServerActionsTestOtherB-server-511980533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-511980533',id=3,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeYN/HSLFqD4XGGEXJ9b8W5tTZ1Q+j1Wl9INcd9I7zBrxI2z/wVXkIvtrK7OKu4ZT8jqxkECEhWOY/LUm6Wr8yFYH+XfgjPLkBJ3Cg5yb8oaGQFI8Npp1mQPS7budj7Eg==',key_name='tempest-keypair-789293158',keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:59:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3098a0e0fd3640d6b0c61303e10b9269',ramdisk_id='',reservation_id='r-ibzp3hny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-779885367',owner_user_name='tempest-ServerActionsTestOtherB-779885367-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec11d8eaa57441e4b1178c39dfccd51f',uuid=4b650a57-5870-4f77-bca2-abe50d970b40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-320898042-network", "vif_mac": "fa:16:3e:d2:1a:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Converting VIF {"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-320898042-network", "vif_mac": "fa:16:3e:d2:1a:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_vif [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b26f892-a2, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed2099d0-06dc-4a05-a2f0-e4f1d9318711) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:03:39 user nova-compute[75246]: INFO os_vif [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2')
Nov 28 17:03:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjtFMPWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:03:39 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ff701e-beb1-4312-ac4b-0dcc6c5d08bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:03:39 user nova-compute[75246]: No targets found.
Nov 28 17:03:39 user nova-compute[75246]: iSNS:
Nov 28 17:03:39 user nova-compute[75246]: No targets found.
Nov 28 17:03:39 user nova-compute[75246]: STATIC:
Nov 28 17:03:39 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1
Nov 28 17:03:39 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:03:39 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:03:39 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4
Nov 28 17:03:39 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:03:39 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:03:39 user nova-compute[75246]: FIRMWARE:
Nov 28 17:03:39 user nova-compute[75246]: No targets found.
Nov 28 17:03:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:03:39 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:03:39 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8d0bc7-46fc-4f6f-97a6-f2dde84209b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c91aa8-06e3-4208-998f-e87ba204156a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:03:39 user nova-compute[75246]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:03:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:03:39 user nova-compute[75246]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:03:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d81413f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4'): ({'sdb'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Removing single pathed devices sdb {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b6f51f-3323-4dd3-bfbf-dbbfe778d602]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f861363-a593-4d35-893e-8afbe9c77f7c]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Flushing IO for device /dev/sdb {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe3490a-d85d-46bd-a0a7-76c947bbe67b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-46ad6724-cd62-4c09-bde3-66ff95623cf3 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 8.156s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed062a9-8054-4735-bb4d-3a8dc5122e6c]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[807849b9-1bcb-4ecd-98f6-23941ff5b36b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2074f9-d0c2-4ff0-8889-629c7ce36096]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260]
Nov 28 17:03:39 user nova-compute[75246]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260] successful.
Nov 28 17:03:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[df72be98-5392-46a6-90db-cb0aa59d8024]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] <== disconnect_volume: return (368ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG nova.network.neutron [req-9e783295-b8db-4206-ad0e-a3f35f92a1ec req-422b8e3f-d360-4df4-8ab2-689be60a6c75 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Updated VIF entry in instance network info cache for port 068da4fa-d42e-47e8-8e7e-81bda7521356. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG nova.network.neutron [req-9e783295-b8db-4206-ad0e-a3f35f92a1ec req-422b8e3f-d360-4df4-8ab2-689be60a6c75 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Updating instance_info_cache with network_info: [{"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": null, "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap068da4fa-d4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e783295-b8db-4206-ad0e-a3f35f92a1ec req-422b8e3f-d360-4df4-8ab2-689be60a6c75 service nova] Releasing lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG nova.compute.manager [req-9e783295-b8db-4206-ad0e-a3f35f92a1ec req-422b8e3f-d360-4df4-8ab2-689be60a6c75 service nova] [instance: f6fe7bf7-782c-4660-9612-101c9f277903] Received event network-vif-deleted-5fe78c0a-025c-4ce0-b370-83959a0e2df7 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:03:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40_resize/disk /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CMD "cp -r /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40_resize/disk /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk" returned: 0 in 0.397s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40_resize/disk.info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk.info {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CMD "cp -r /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40_resize/disk.info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk.info" returned: 0 in 0.039s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-3c287e2e-14e6-4bee-aeba-45de98a37a03 req-e13a086c-c5e9-43f2-957e-f3b03384e88a service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received event network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3c287e2e-14e6-4bee-aeba-45de98a37a03 req-e13a086c-c5e9-43f2-957e-f3b03384e88a service nova] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3c287e2e-14e6-4bee-aeba-45de98a37a03 req-e13a086c-c5e9-43f2-957e-f3b03384e88a service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3c287e2e-14e6-4bee-aeba-45de98a37a03 req-e13a086c-c5e9-43f2-957e-f3b03384e88a service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-3c287e2e-14e6-4bee-aeba-45de98a37a03 req-e13a086c-c5e9-43f2-957e-f3b03384e88a service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] No waiting events found dispatching network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:40 user nova-compute[75246]: WARNING nova.compute.manager [req-3c287e2e-14e6-4bee-aeba-45de98a37a03 req-e13a086c-c5e9-43f2-957e-f3b03384e88a service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received unexpected event network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 for instance with vm_state active and task_state resize_migrating.
Nov 28 17:03:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:42 user nova-compute[75246]: DEBUG nova.network.neutron [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Port 3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 binding to destination host user is already ACTIVE {{(pid=75246) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 17:03:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.009s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:03:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquired lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:03:42 user nova-compute[75246]: DEBUG nova.network.neutron [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG nova.network.neutron [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Updating instance_info_cache with network_info: [{"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Releasing lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG os_brick.utils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9393c109-330d-476d-a99b-c27950ec5403]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8198b1-5d3a-46d0-b90a-138eb1f56e23]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5ab36d-4510-4af6-a153-6503eb38db32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea3d8a2-14dc-4f05-9dd8-ed947b693f7f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:03:43 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:03:43 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f4d890-bede-4aef-bd1f-1cf581031cda]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:03:43 user nova-compute[75246]: DEBUG os_brick.utils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:03:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "c94900af-f484-47bf-8627-8aa863334b63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "c94900af-f484-47bf-8627-8aa863334b63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:03:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:44 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:03:44 user nova-compute[75246]: INFO nova.compute.claims [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Claim successful on node user
Nov 28 17:03:44 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:03:44 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:03:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:03:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:03:44 user nova-compute[75246]: DEBUG nova.network.neutron [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:03:44 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:03:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG nova.policy [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b79c4440e4734a2f82b08de54ed61737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60768e53b1e3414cb05eaaf23d382493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG nova.compute.manager [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:03:45 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Creating image(s)
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "/opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "/opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "/opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:03:45 user nova-compute[75246]: INFO nova.compute.claims [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Claim successful on node user
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG nova.network.neutron [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Successfully created port: 2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.232s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk 1073741824" returned: 0 in 0.057s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.196s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:03:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Cannot resize image /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Ensure instance console log exists: /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.807s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:03:46 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:03:46 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG nova.policy [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b79c4440e4734a2f82b08de54ed61737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60768e53b1e3414cb05eaaf23d382493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:03:46 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Creating image(s)
Nov 28 17:03:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "/opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "/opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.203s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG nova.network.neutron [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Successfully updated port: 2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquired lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG nova.network.neutron [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-ef00b50e-1389-41db-aad3-b8810b98ed61 req-676827b6-d1f8-4482-9db9-2e842d9581cf service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received event network-changed-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-ef00b50e-1389-41db-aad3-b8810b98ed61 req-676827b6-d1f8-4482-9db9-2e842d9581cf service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Refreshing instance network info cache due to event network-changed-2dca6bfe-f162-4bdd-af7f-af991de90b52. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ef00b50e-1389-41db-aad3-b8810b98ed61 req-676827b6-d1f8-4482-9db9-2e842d9581cf service nova] Acquiring lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.223s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:46 user nova-compute[75246]: DEBUG nova.network.neutron [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk 1073741824" returned: 0 in 0.136s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.365s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.191s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Successfully created port: 0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Cannot resize image /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Ensure instance console log exists: /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.network.neutron [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Updating instance_info_cache with network_info: [{"id": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "address": "fa:16:3e:e3:8a:cb", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dca6bfe-f1", "ovs_interfaceid": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Releasing lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.compute.manager [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Instance network_info: |[{"id": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "address": "fa:16:3e:e3:8a:cb", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dca6bfe-f1", "ovs_interfaceid": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ef00b50e-1389-41db-aad3-b8810b98ed61 req-676827b6-d1f8-4482-9db9-2e842d9581cf service nova] Acquired lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.network.neutron [req-ef00b50e-1389-41db-aad3-b8810b98ed61 req-676827b6-d1f8-4482-9db9-2e842d9581cf service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Refreshing network info cache for port 2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Start _get_guest_xml network_info=[{"id": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "address": "fa:16:3e:e3:8a:cb", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dca6bfe-f1", "ovs_interfaceid": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:03:47 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:03:47 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2005498461',display_name='tempest-ServerRescueNegativeTestJSON-server-2005498461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2005498461',id=16,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60768e53b1e3414cb05eaaf23d382493',ramdisk_id='',reservation_id='r-14jvvyem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-220335783',owner_user_name='tempest-ServerRescueNegativeTestJSON-220335783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:03:45Z,user_data=None,user_id='b79c4440e4734a2f82b08de54ed61737',uuid=c94900af-f484-47bf-8627-8aa863334b63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "address": "fa:16:3e:e3:8a:cb", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dca6bfe-f1", "ovs_interfaceid": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converting VIF {"id": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "address": "fa:16:3e:e3:8a:cb", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dca6bfe-f1", "ovs_interfaceid": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:8a:cb,bridge_name='br-int',has_traffic_filtering=True,id=2dca6bfe-f162-4bdd-af7f-af991de90b52,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dca6bfe-f1') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.objects.instance [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'pci_devices' on Instance uuid c94900af-f484-47bf-8627-8aa863334b63 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:03:47 user nova-compute[75246]:   <uuid>c94900af-f484-47bf-8627-8aa863334b63</uuid>
Nov 28 17:03:47 user nova-compute[75246]:   <name>instance-00000010</name>
Nov 28 17:03:47 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:03:47 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:03:47 user nova-compute[75246]:   <metadata>
Nov 28 17:03:47 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:03:47 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:03:47 user nova-compute[75246]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2005498461</nova:name>
Nov 28 17:03:47 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:03:47</nova:creationTime>
Nov 28 17:03:47 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:03:47 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:03:47 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:03:47 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:03:47 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:03:47 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:03:47 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:03:47 user nova-compute[75246]:       <nova:owner>
Nov 28 17:03:47 user nova-compute[75246]:         <nova:user uuid="b79c4440e4734a2f82b08de54ed61737">tempest-ServerRescueNegativeTestJSON-220335783-project-member</nova:user>
Nov 28 17:03:47 user nova-compute[75246]:         <nova:project uuid="60768e53b1e3414cb05eaaf23d382493">tempest-ServerRescueNegativeTestJSON-220335783</nova:project>
Nov 28 17:03:47 user nova-compute[75246]:       </nova:owner>
Nov 28 17:03:47 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:03:47 user nova-compute[75246]:       <nova:ports>
Nov 28 17:03:47 user nova-compute[75246]:         <nova:port uuid="2dca6bfe-f162-4bdd-af7f-af991de90b52">
Nov 28 17:03:47 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 17:03:47 user nova-compute[75246]:         </nova:port>
Nov 28 17:03:47 user nova-compute[75246]:       </nova:ports>
Nov 28 17:03:47 user nova-compute[75246]:     </nova:instance>
Nov 28 17:03:47 user nova-compute[75246]:   </metadata>
Nov 28 17:03:47 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:03:47 user nova-compute[75246]:     <system>
Nov 28 17:03:47 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:03:47 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:03:47 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:03:47 user nova-compute[75246]:       <entry name="serial">c94900af-f484-47bf-8627-8aa863334b63</entry>
Nov 28 17:03:47 user nova-compute[75246]:       <entry name="uuid">c94900af-f484-47bf-8627-8aa863334b63</entry>
Nov 28 17:03:47 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:03:47 user nova-compute[75246]:     </system>
Nov 28 17:03:47 user nova-compute[75246]:   </sysinfo>
Nov 28 17:03:47 user nova-compute[75246]:   <os>
Nov 28 17:03:47 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:03:47 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:03:47 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:03:47 user nova-compute[75246]:   </os>
Nov 28 17:03:47 user nova-compute[75246]:   <features>
Nov 28 17:03:47 user nova-compute[75246]:     <acpi/>
Nov 28 17:03:47 user nova-compute[75246]:     <apic/>
Nov 28 17:03:47 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:03:47 user nova-compute[75246]:   </features>
Nov 28 17:03:47 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:03:47 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:03:47 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:03:47 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:03:47 user nova-compute[75246]:   </clock>
Nov 28 17:03:47 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:03:47 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:03:47 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:03:47 user nova-compute[75246]:   </cpu>
Nov 28 17:03:47 user nova-compute[75246]:   <devices>
Nov 28 17:03:47 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:03:47 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:03:47 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk"/>
Nov 28 17:03:47 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:03:47 user nova-compute[75246]:     </disk>
Nov 28 17:03:47 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:03:47 user nova-compute[75246]:       <mac address="fa:16:3e:e3:8a:cb"/>
Nov 28 17:03:47 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:03:47 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:03:47 user nova-compute[75246]:       <target dev="tap2dca6bfe-f1"/>
Nov 28 17:03:47 user nova-compute[75246]:     </interface>
Nov 28 17:03:47 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:03:47 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/console.log" append="off"/>
Nov 28 17:03:47 user nova-compute[75246]:     </serial>
Nov 28 17:03:47 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:03:47 user nova-compute[75246]:     <video>
Nov 28 17:03:47 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:03:47 user nova-compute[75246]:     </video>
Nov 28 17:03:47 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:03:47 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:03:47 user nova-compute[75246]:     </rng>
Nov 28 17:03:47 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:03:47 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:03:47 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:03:47 user nova-compute[75246]:     </memballoon>
Nov 28 17:03:47 user nova-compute[75246]:   </devices>
Nov 28 17:03:47 user nova-compute[75246]: </domain>
Nov 28 17:03:47 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2005498461',display_name='tempest-ServerRescueNegativeTestJSON-server-2005498461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2005498461',id=16,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60768e53b1e3414cb05eaaf23d382493',ramdisk_id='',reservation_id='r-14jvvyem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-220335783',owner_user_name='tempest-ServerRescueNegativeTestJSON-220335783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:03:45Z,user_data=None,user_id='b79c4440e4734a2f82b08de54ed61737',uuid=c94900af-f484-47bf-8627-8aa863334b63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "address": "fa:16:3e:e3:8a:cb", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dca6bfe-f1", "ovs_interfaceid": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converting VIF {"id": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "address": "fa:16:3e:e3:8a:cb", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dca6bfe-f1", "ovs_interfaceid": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:8a:cb,bridge_name='br-int',has_traffic_filtering=True,id=2dca6bfe-f162-4bdd-af7f-af991de90b52,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dca6bfe-f1') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG os_vif [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:8a:cb,bridge_name='br-int',has_traffic_filtering=True,id=2dca6bfe-f162-4bdd-af7f-af991de90b52,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dca6bfe-f1') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b9daeea-fe77-5969-b068-c9f630db23e2', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dca6bfe-f1, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2dca6bfe-f1, col_values=(('qos', UUID('fe20d084-4f59-456b-8fd7-63da5b0dbd53')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2dca6bfe-f1, col_values=(('external_ids', {'iface-id': '2dca6bfe-f162-4bdd-af7f-af991de90b52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:8a:cb', 'vm-uuid': 'c94900af-f484-47bf-8627-8aa863334b63'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:47 user nova-compute[75246]: INFO os_vif [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:8a:cb,bridge_name='br-int',has_traffic_filtering=True,id=2dca6bfe-f162-4bdd-af7f-af991de90b52,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dca6bfe-f1')
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:03:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] No VIF found with MAC fa:16:3e:e3:8a:cb, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.network.neutron [req-ef00b50e-1389-41db-aad3-b8810b98ed61 req-676827b6-d1f8-4482-9db9-2e842d9581cf service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Updated VIF entry in instance network info cache for port 2dca6bfe-f162-4bdd-af7f-af991de90b52. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.network.neutron [req-ef00b50e-1389-41db-aad3-b8810b98ed61 req-676827b6-d1f8-4482-9db9-2e842d9581cf service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Updating instance_info_cache with network_info: [{"id": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "address": "fa:16:3e:e3:8a:cb", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dca6bfe-f1", "ovs_interfaceid": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ef00b50e-1389-41db-aad3-b8810b98ed61 req-676827b6-d1f8-4482-9db9-2e842d9581cf service nova] Releasing lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Successfully updated port: 0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "refresh_cache-c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquired lock "refresh_cache-c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Updating instance_info_cache with network_info: [{"id": "0a3da48f-457a-450f-8102-d758c18d2554", "address": "fa:16:3e:a5:be:9f", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a3da48f-45", "ovs_interfaceid": "0a3da48f-457a-450f-8102-d758c18d2554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Releasing lock "refresh_cache-c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Instance network_info: |[{"id": "0a3da48f-457a-450f-8102-d758c18d2554", "address": "fa:16:3e:a5:be:9f", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a3da48f-45", "ovs_interfaceid": "0a3da48f-457a-450f-8102-d758c18d2554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Start _get_guest_xml network_info=[{"id": "0a3da48f-457a-450f-8102-d758c18d2554", "address": "fa:16:3e:a5:be:9f", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a3da48f-45", "ovs_interfaceid": "0a3da48f-457a-450f-8102-d758c18d2554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:48 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:03:48 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:03:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-917092269',display_name='tempest-ServerRescueNegativeTestJSON-server-917092269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-917092269',id=17,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60768e53b1e3414cb05eaaf23d382493',ramdisk_id='',reservation_id='r-s8iqr3jc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-220335783',owner_user_name='tempest-ServerRescueNegativeTestJSON-220335783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:03:46Z,user_data=None,user_id='b79c4440e4734a2f82b08de54ed61737',uuid=c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a3da48f-457a-450f-8102-d758c18d2554", "address": "fa:16:3e:a5:be:9f", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a3da48f-45", "ovs_interfaceid": "0a3da48f-457a-450f-8102-d758c18d2554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converting VIF {"id": "0a3da48f-457a-450f-8102-d758c18d2554", "address": "fa:16:3e:a5:be:9f", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a3da48f-45", "ovs_interfaceid": "0a3da48f-457a-450f-8102-d758c18d2554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:be:9f,bridge_name='br-int',has_traffic_filtering=True,id=0a3da48f-457a-450f-8102-d758c18d2554,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a3da48f-45') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'pci_devices' on Instance uuid c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:03:48 user nova-compute[75246]:   <uuid>c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5</uuid>
Nov 28 17:03:48 user nova-compute[75246]:   <name>instance-00000011</name>
Nov 28 17:03:48 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:03:48 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:03:48 user nova-compute[75246]:   <metadata>
Nov 28 17:03:48 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:03:48 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:03:48 user nova-compute[75246]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-917092269</nova:name>
Nov 28 17:03:48 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:03:48</nova:creationTime>
Nov 28 17:03:48 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:03:48 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:03:48 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:03:48 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:03:48 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:03:48 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:03:48 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:03:48 user nova-compute[75246]:       <nova:owner>
Nov 28 17:03:48 user nova-compute[75246]:         <nova:user uuid="b79c4440e4734a2f82b08de54ed61737">tempest-ServerRescueNegativeTestJSON-220335783-project-member</nova:user>
Nov 28 17:03:48 user nova-compute[75246]:         <nova:project uuid="60768e53b1e3414cb05eaaf23d382493">tempest-ServerRescueNegativeTestJSON-220335783</nova:project>
Nov 28 17:03:48 user nova-compute[75246]:       </nova:owner>
Nov 28 17:03:48 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:03:48 user nova-compute[75246]:       <nova:ports>
Nov 28 17:03:48 user nova-compute[75246]:         <nova:port uuid="0a3da48f-457a-450f-8102-d758c18d2554">
Nov 28 17:03:48 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 17:03:48 user nova-compute[75246]:         </nova:port>
Nov 28 17:03:48 user nova-compute[75246]:       </nova:ports>
Nov 28 17:03:48 user nova-compute[75246]:     </nova:instance>
Nov 28 17:03:48 user nova-compute[75246]:   </metadata>
Nov 28 17:03:48 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:03:48 user nova-compute[75246]:     <system>
Nov 28 17:03:48 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:03:48 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:03:48 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:03:48 user nova-compute[75246]:       <entry name="serial">c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5</entry>
Nov 28 17:03:48 user nova-compute[75246]:       <entry name="uuid">c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5</entry>
Nov 28 17:03:48 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:03:48 user nova-compute[75246]:     </system>
Nov 28 17:03:48 user nova-compute[75246]:   </sysinfo>
Nov 28 17:03:48 user nova-compute[75246]:   <os>
Nov 28 17:03:48 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:03:48 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:03:48 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:03:48 user nova-compute[75246]:   </os>
Nov 28 17:03:48 user nova-compute[75246]:   <features>
Nov 28 17:03:48 user nova-compute[75246]:     <acpi/>
Nov 28 17:03:48 user nova-compute[75246]:     <apic/>
Nov 28 17:03:48 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:03:48 user nova-compute[75246]:   </features>
Nov 28 17:03:48 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:03:48 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:03:48 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:03:48 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:03:48 user nova-compute[75246]:   </clock>
Nov 28 17:03:48 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:03:48 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:03:48 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:03:48 user nova-compute[75246]:   </cpu>
Nov 28 17:03:48 user nova-compute[75246]:   <devices>
Nov 28 17:03:48 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:03:48 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:03:48 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk"/>
Nov 28 17:03:48 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:03:48 user nova-compute[75246]:     </disk>
Nov 28 17:03:48 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:03:48 user nova-compute[75246]:       <mac address="fa:16:3e:a5:be:9f"/>
Nov 28 17:03:48 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:03:48 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:03:48 user nova-compute[75246]:       <target dev="tap0a3da48f-45"/>
Nov 28 17:03:48 user nova-compute[75246]:     </interface>
Nov 28 17:03:48 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:03:48 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/console.log" append="off"/>
Nov 28 17:03:48 user nova-compute[75246]:     </serial>
Nov 28 17:03:48 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:03:48 user nova-compute[75246]:     <video>
Nov 28 17:03:48 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:03:48 user nova-compute[75246]:     </video>
Nov 28 17:03:48 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:03:48 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:03:48 user nova-compute[75246]:     </rng>
Nov 28 17:03:48 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:03:48 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:03:48 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:03:48 user nova-compute[75246]:     </memballoon>
Nov 28 17:03:48 user nova-compute[75246]:   </devices>
Nov 28 17:03:48 user nova-compute[75246]: </domain>
Nov 28 17:03:48 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:03:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-917092269',display_name='tempest-ServerRescueNegativeTestJSON-server-917092269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-917092269',id=17,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60768e53b1e3414cb05eaaf23d382493',ramdisk_id='',reservation_id='r-s8iqr3jc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-220335783',owner_user_name='tempest-ServerRescueNegativeTestJSON-220335783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:03:46Z,user_data=None,user_id='b79c4440e4734a2f82b08de54ed61737',uuid=c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a3da48f-457a-450f-8102-d758c18d2554", "address": "fa:16:3e:a5:be:9f", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a3da48f-45", "ovs_interfaceid": "0a3da48f-457a-450f-8102-d758c18d2554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converting VIF {"id": "0a3da48f-457a-450f-8102-d758c18d2554", "address": "fa:16:3e:a5:be:9f", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a3da48f-45", "ovs_interfaceid": "0a3da48f-457a-450f-8102-d758c18d2554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:be:9f,bridge_name='br-int',has_traffic_filtering=True,id=0a3da48f-457a-450f-8102-d758c18d2554,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a3da48f-45') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG os_vif [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:be:9f,bridge_name='br-int',has_traffic_filtering=True,id=0a3da48f-457a-450f-8102-d758c18d2554,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a3da48f-45') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df12b0b4-41c8-5309-bcb9-cca4bf299855', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a3da48f-45, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a3da48f-45, col_values=(('qos', UUID('9128250f-111f-440f-bde0-14c9c4f78dd4')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a3da48f-45, col_values=(('external_ids', {'iface-id': '0a3da48f-457a-450f-8102-d758c18d2554', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:be:9f', 'vm-uuid': 'c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:48 user nova-compute[75246]: INFO os_vif [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:be:9f,bridge_name='br-int',has_traffic_filtering=True,id=0a3da48f-457a-450f-8102-d758c18d2554,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a3da48f-45')
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.compute.manager [req-122e61cd-b7f7-4040-85a8-bbae2fb2a6f6 req-90954d52-30af-42b1-a7ff-aeded90da103 service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Received event network-changed-0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.compute.manager [req-122e61cd-b7f7-4040-85a8-bbae2fb2a6f6 req-90954d52-30af-42b1-a7ff-aeded90da103 service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Refreshing instance network info cache due to event network-changed-0a3da48f-457a-450f-8102-d758c18d2554. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-122e61cd-b7f7-4040-85a8-bbae2fb2a6f6 req-90954d52-30af-42b1-a7ff-aeded90da103 service nova] Acquiring lock "refresh_cache-c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-122e61cd-b7f7-4040-85a8-bbae2fb2a6f6 req-90954d52-30af-42b1-a7ff-aeded90da103 service nova] Acquired lock "refresh_cache-c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.network.neutron [req-122e61cd-b7f7-4040-85a8-bbae2fb2a6f6 req-90954d52-30af-42b1-a7ff-aeded90da103 service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Refreshing network info cache for port 0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:03:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] No VIF found with MAC fa:16:3e:a5:be:9f, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:03:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:49 user nova-compute[75246]: DEBUG nova.network.neutron [req-122e61cd-b7f7-4040-85a8-bbae2fb2a6f6 req-90954d52-30af-42b1-a7ff-aeded90da103 service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Updated VIF entry in instance network info cache for port 0a3da48f-457a-450f-8102-d758c18d2554. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:03:49 user nova-compute[75246]: DEBUG nova.network.neutron [req-122e61cd-b7f7-4040-85a8-bbae2fb2a6f6 req-90954d52-30af-42b1-a7ff-aeded90da103 service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Updating instance_info_cache with network_info: [{"id": "0a3da48f-457a-450f-8102-d758c18d2554", "address": "fa:16:3e:a5:be:9f", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a3da48f-45", "ovs_interfaceid": "0a3da48f-457a-450f-8102-d758c18d2554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-122e61cd-b7f7-4040-85a8-bbae2fb2a6f6 req-90954d52-30af-42b1-a7ff-aeded90da103 service nova] Releasing lock "refresh_cache-c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:03:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquiring lock "9f306608-7716-41e0-9aa0-afa8ba173a04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquiring lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:51 user nova-compute[75246]: INFO nova.compute.manager [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Terminating instance
Nov 28 17:03:51 user nova-compute[75246]: DEBUG nova.compute.manager [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG nova.compute.manager [req-216f85b6-713a-40ba-bcee-f469d87a6f7b req-f54b7570-240c-439f-acd5-6aac9ebbe64c service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received event network-vif-unplugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-216f85b6-713a-40ba-bcee-f469d87a6f7b req-f54b7570-240c-439f-acd5-6aac9ebbe64c service nova] Acquiring lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-216f85b6-713a-40ba-bcee-f469d87a6f7b req-f54b7570-240c-439f-acd5-6aac9ebbe64c service nova] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-216f85b6-713a-40ba-bcee-f469d87a6f7b req-f54b7570-240c-439f-acd5-6aac9ebbe64c service nova] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG nova.compute.manager [req-216f85b6-713a-40ba-bcee-f469d87a6f7b req-f54b7570-240c-439f-acd5-6aac9ebbe64c service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] No waiting events found dispatching network-vif-unplugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG nova.compute.manager [req-216f85b6-713a-40ba-bcee-f469d87a6f7b req-f54b7570-240c-439f-acd5-6aac9ebbe64c service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received event network-vif-unplugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Starting finish_migration {{(pid=75246) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Instance directory exists: not creating {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 17:03:52 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Creating image(s)
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.196s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk. size=21474836480 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:52 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Instance destroyed successfully.
Nov 28 17:03:52 user nova-compute[75246]: DEBUG nova.objects.instance [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lazy-loading 'resources' on Instance uuid 9f306608-7716-41e0-9aa0-afa8ba173a04 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T17:00:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2073692504',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1449270168',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/bT5nFFmbZrOpaZ0HmyZXCELWLX9dTZ/XfZD4hqIrK3t2MR0LlLUdxpI/bFXzxh3UZ4VIGEMreeSaxuGWiHlXx7TOkvrFpJoQFIrSk/kIxGBFPzpcWuMsi8ubkeEskCA==',key_name='tempest-keypair-1686207482',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:02:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37d00748c91a42a9aa255f62e207a41c',ramdisk_id='',reservation_id='r-r7anrgfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1837306517',owner_user_name='tempest-ServerActionsV293TestJSON-1837306517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3465e183420e4370a02046024827d21f',uuid=9f306608-7716-41e0-9aa0-afa8ba173a04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "address": "fa:16:3e:df:ac:3a", "network": {"id": "06579a46-8d95-4c64-940c-00a80ce64cf2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-824652166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37d00748c91a42a9aa255f62e207a41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf37bb-28", "ovs_interfaceid": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Converting VIF {"id": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "address": "fa:16:3e:df:ac:3a", "network": {"id": "06579a46-8d95-4c64-940c-00a80ce64cf2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-824652166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37d00748c91a42a9aa255f62e207a41c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf37bb-28", "ovs_interfaceid": "8ccf37bb-28f1-4f69-ba57-e168eff668e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:3a,bridge_name='br-int',has_traffic_filtering=True,id=8ccf37bb-28f1-4f69-ba57-e168eff668e4,network=Network(06579a46-8d95-4c64-940c-00a80ce64cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf37bb-28') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG os_vif [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:3a,bridge_name='br-int',has_traffic_filtering=True,id=8ccf37bb-28f1-4f69-ba57-e168eff668e4,network=Network(06579a46-8d95-4c64-940c-00a80ce64cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf37bb-28') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ccf37bb-28, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48df49aa-794d-4bef-b5d1-1be1155ca7bf) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:03:52 user nova-compute[75246]: INFO os_vif [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ac:3a,bridge_name='br-int',has_traffic_filtering=True,id=8ccf37bb-28f1-4f69-ba57-e168eff668e4,network=Network(06579a46-8d95-4c64-940c-00a80ce64cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf37bb-28')
Nov 28 17:03:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbstSmKj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:03:52 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:03:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk 21474836480 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b6ad51-b367-41f0-9bf2-8c6eb9bd2b69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:03:52 user nova-compute[75246]: No targets found.
Nov 28 17:03:52 user nova-compute[75246]: iSNS:
Nov 28 17:03:52 user nova-compute[75246]: No targets found.
Nov 28 17:03:52 user nova-compute[75246]: STATIC:
Nov 28 17:03:52 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1
Nov 28 17:03:52 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:03:52 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:03:52 user nova-compute[75246]: FIRMWARE:
Nov 28 17:03:52 user nova-compute[75246]: No targets found.
Nov 28 17:03:52 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:03:52 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:03:52 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk 21474836480" returned: 0 in 0.059s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3b2d58-9561-45c3-962f-c5487966176c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9449da46-88d6-4b42-ad16-f946044c888b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:03:52 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 (non-flash)
Nov 28 17:03:52 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d8143520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1'): ({'sdd'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Removing single pathed devices sdd {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Did not create local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Ensure instance console log exists: /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Start _get_guest_xml network_info=[{"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-320898042-network", "vif_mac": "fa:16:3e:d2:1a:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '7618052e-a7f2-4344-b3a5-ee2cccfe5868', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjtFMPWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4b650a57-5870-4f77-bca2-abe50d970b40', 'attached_at': '2023-11-28T17:03:52.000000', 'detached_at': '', 'volume_id': '3d2f58a0-30e0-4819-aae0-07657c5f32b4', 'serial': '3d2f58a0-30e0-4819-aae0-07657c5f32b4'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d3e41b-455a-4b87-9b45-a1f8cf5fd82f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:53 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:03:53 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52d2507-2d01-4338-a51b-bd20c5234293]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Flushing IO for device /dev/sdd {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d318aa83-b8fe-4e9d-9559-83e30c97cb89]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjtFMPWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:03:53 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.compute.manager [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[311f318d-75b9-49b1-866f-f281689354f6]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f325d7c5', '/dev/disk/by-id/scsi-1SCST_BIOf325d7c5-9e4ff04427629cbe', '/dev/disk/by-id/scsi-23965346666303434') {{(pid=85745) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1dc9e0-9e09-40f0-9183-e1d4ac39bebb]: (4, None) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:53 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: c94900af-f484-47bf-8627-8aa863334b63] Instance spawned successfully.
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22b9068-b813-4d79-a70b-45324b304f1a]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[da54e6d0-4e56-4ffc-bf4e-5f74bc36884d]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1, portal: 172.16.0.220,3260]
Nov 28 17:03:53 user nova-compute[75246]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1, portal: 172.16.0.220,3260] successful.
Nov 28 17:03:53 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a955b08-0696-4533-b17d-0e99d36216e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3c9c17-3cde-4148-bf24-5a0504e43f84]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] <== disconnect_volume: return (411ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:03:53 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Deleting instance files /opt/stack/data/nova/instances/9f306608-7716-41e0-9aa0-afa8ba173a04_del
Nov 28 17:03:53 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Deletion of /opt/stack/data/nova/instances/9f306608-7716-41e0-9aa0-afa8ba173a04_del complete
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.304s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:03:53 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:03:53 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba6be96-284d-4caf-bd31-67bec1321b5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:03:53 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0342cfbf-5d0f-469f-b30d-e4edfe348e5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4] added
Nov 28 17:03:53 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:53 user nova-compute[75246]: INFO nova.compute.manager [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Took 8.28 seconds to spawn the instance on the hypervisor.
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.compute.manager [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8697006b-e2d0-481d-bc25-81091fc8eae5]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:53 user nova-compute[75246]: INFO nova.compute.manager [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Took 1.57 seconds to destroy the instance on the hypervisor.
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5aa240-02b0-4beb-a495-f28aa40f25c3]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjtFMPWJ {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjtFMPWJ" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bccc2b2-3921-43af-9e76-44e08add8eda]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AjtFMPWJ'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a757fc-ab14-4db3-821e-8cd823a5a14c]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3773b177-2630-456a-b998-affc3c36c41f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:53 user nova-compute[75246]: INFO nova.compute.manager [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Took 9.28 seconds to build instance.
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 17:03:53 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 17:03:53 user nova-compute[75246]:  {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:03:53 user nova-compute[75246]: WARNING os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 17:03:53 user nova-compute[75246]: 
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:53 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Instance spawned successfully.
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d5475b65-73fe-45f5-88e3-34f4fee2082e tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "c94900af-f484-47bf-8627-8aa863334b63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.426s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aaf938-e79a-4356-bf8d-8878da327bed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260]
Nov 28 17:03:53 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260] successful.
Nov 28 17:03:53 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d5cb08-cfd2-42ec-86ed-8efd08b03f5c]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cddb96-cc93-4fea-8365-d8250d7f71cc]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:03:53 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:03:53 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:03:53 user nova-compute[75246]: INFO nova.compute.manager [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Took 7.39 seconds to spawn the instance on the hypervisor.
Nov 28 17:03:53 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4aacda-3efc-4aac-bec0-cc0c9d91528a]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:03:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjtFMPWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:03:53 user nova-compute[75246]: INFO nova.compute.manager [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Took 8.67 seconds to build instance.
Nov 28 17:03:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c74d4e8-2c91-4c6b-909c-669b86bbbbbf tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.814s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG nova.compute.manager [req-faf3d1de-1e26-4c78-9e4f-54fcea4e2510 req-e1bb67ac-4917-45ed-b244-853ca0926f60 service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received event network-vif-plugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-faf3d1de-1e26-4c78-9e4f-54fcea4e2510 req-e1bb67ac-4917-45ed-b244-853ca0926f60 service nova] Acquiring lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-faf3d1de-1e26-4c78-9e4f-54fcea4e2510 req-e1bb67ac-4917-45ed-b244-853ca0926f60 service nova] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-faf3d1de-1e26-4c78-9e4f-54fcea4e2510 req-e1bb67ac-4917-45ed-b244-853ca0926f60 service nova] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG nova.compute.manager [req-faf3d1de-1e26-4c78-9e4f-54fcea4e2510 req-e1bb67ac-4917-45ed-b244-853ca0926f60 service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] No waiting events found dispatching network-vif-plugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:54 user nova-compute[75246]: WARNING nova.compute.manager [req-faf3d1de-1e26-4c78-9e4f-54fcea4e2510 req-e1bb67ac-4917-45ed-b244-853ca0926f60 service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received unexpected event network-vif-plugged-8ccf37bb-28f1-4f69-ba57-e168eff668e4 for instance with vm_state active and task_state deleting.
Nov 28 17:03:54 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:54 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Took 0.86 seconds to deallocate network for instance.
Nov 28 17:03:54 user nova-compute[75246]: DEBUG nova.compute.manager [req-90fef300-d56b-41f5-9c48-023074e2375b req-40104ead-0d95-4b78-a054-71b9b5d49b9d service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Received event network-vif-deleted-8ccf37bb-28f1-4f69-ba57-e168eff668e4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:54 user nova-compute[75246]: INFO nova.compute.manager [req-90fef300-d56b-41f5-9c48-023074e2375b req-40104ead-0d95-4b78-a054-71b9b5d49b9d service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Neutron deleted interface 8ccf37bb-28f1-4f69-ba57-e168eff668e4; detaching it from the instance and deleting it from the info cache
Nov 28 17:03:54 user nova-compute[75246]: DEBUG nova.network.neutron [req-90fef300-d56b-41f5-9c48-023074e2375b req-40104ead-0d95-4b78-a054-71b9b5d49b9d service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG nova.compute.manager [req-90fef300-d56b-41f5-9c48-023074e2375b req-40104ead-0d95-4b78-a054-71b9b5d49b9d service nova] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Detach interface failed, port_id=8ccf37bb-28f1-4f69-ba57-e168eff668e4, reason: Instance 9f306608-7716-41e0-9aa0-afa8ba173a04 could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] <== connect_volume: return (1714ms) {'type': 'block', 'scsi_wwn': '23562396665333164', 'path': '/dev/sdb'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562396665333164', 'path': '/dev/sdb'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-511980533',display_name='tempest-ServerActionsTestOtherB-server-511980533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-511980533',id=3,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeYN/HSLFqD4XGGEXJ9b8W5tTZ1Q+j1Wl9INcd9I7zBrxI2z/wVXkIvtrK7OKu4ZT8jqxkECEhWOY/LUm6Wr8yFYH+XfgjPLkBJ3Cg5yb8oaGQFI8Npp1mQPS7budj7Eg==',key_name='tempest-keypair-789293158',keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:59:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3098a0e0fd3640d6b0c61303e10b9269',ramdisk_id='',reservation_id='r-ibzp3hny',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-779885367',owner_user_name='tempest-ServerActionsTestOtherB-779885367-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:03:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec11d8eaa57441e4b1178c39dfccd51f',uuid=4b650a57-5870-4f77-bca2-abe50d970b40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-320898042-network", "vif_mac": "fa:16:3e:d2:1a:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Converting VIF {"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-320898042-network", "vif_mac": "fa:16:3e:d2:1a:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:03:54 user nova-compute[75246]:   <uuid>4b650a57-5870-4f77-bca2-abe50d970b40</uuid>
Nov 28 17:03:54 user nova-compute[75246]:   <name>instance-00000003</name>
Nov 28 17:03:54 user nova-compute[75246]:   <memory>2097152</memory>
Nov 28 17:03:54 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:03:54 user nova-compute[75246]:   <metadata>
Nov 28 17:03:54 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:03:54 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:03:54 user nova-compute[75246]:       <nova:name>tempest-ServerActionsTestOtherB-server-511980533</nova:name>
Nov 28 17:03:54 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:03:53</nova:creationTime>
Nov 28 17:03:54 user nova-compute[75246]:       <nova:flavor name="m1.small">
Nov 28 17:03:54 user nova-compute[75246]:         <nova:memory>2048</nova:memory>
Nov 28 17:03:54 user nova-compute[75246]:         <nova:disk>20</nova:disk>
Nov 28 17:03:54 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:03:54 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:03:54 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:03:54 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:03:54 user nova-compute[75246]:       <nova:owner>
Nov 28 17:03:54 user nova-compute[75246]:         <nova:user uuid="ec11d8eaa57441e4b1178c39dfccd51f">tempest-ServerActionsTestOtherB-779885367-project-member</nova:user>
Nov 28 17:03:54 user nova-compute[75246]:         <nova:project uuid="3098a0e0fd3640d6b0c61303e10b9269">tempest-ServerActionsTestOtherB-779885367</nova:project>
Nov 28 17:03:54 user nova-compute[75246]:       </nova:owner>
Nov 28 17:03:54 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:03:54 user nova-compute[75246]:       <nova:ports>
Nov 28 17:03:54 user nova-compute[75246]:         <nova:port uuid="3b26f892-a21c-4c9f-b4f2-627ed62fb2c0">
Nov 28 17:03:54 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 17:03:54 user nova-compute[75246]:         </nova:port>
Nov 28 17:03:54 user nova-compute[75246]:       </nova:ports>
Nov 28 17:03:54 user nova-compute[75246]:     </nova:instance>
Nov 28 17:03:54 user nova-compute[75246]:   </metadata>
Nov 28 17:03:54 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:03:54 user nova-compute[75246]:     <system>
Nov 28 17:03:54 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:03:54 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:03:54 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:03:54 user nova-compute[75246]:       <entry name="serial">4b650a57-5870-4f77-bca2-abe50d970b40</entry>
Nov 28 17:03:54 user nova-compute[75246]:       <entry name="uuid">4b650a57-5870-4f77-bca2-abe50d970b40</entry>
Nov 28 17:03:54 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:03:54 user nova-compute[75246]:     </system>
Nov 28 17:03:54 user nova-compute[75246]:   </sysinfo>
Nov 28 17:03:54 user nova-compute[75246]:   <os>
Nov 28 17:03:54 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:03:54 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:03:54 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:03:54 user nova-compute[75246]:   </os>
Nov 28 17:03:54 user nova-compute[75246]:   <features>
Nov 28 17:03:54 user nova-compute[75246]:     <acpi/>
Nov 28 17:03:54 user nova-compute[75246]:     <apic/>
Nov 28 17:03:54 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:03:54 user nova-compute[75246]:   </features>
Nov 28 17:03:54 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:03:54 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:03:54 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:03:54 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:03:54 user nova-compute[75246]:   </clock>
Nov 28 17:03:54 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:03:54 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:03:54 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:03:54 user nova-compute[75246]:   </cpu>
Nov 28 17:03:54 user nova-compute[75246]:   <devices>
Nov 28 17:03:54 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:03:54 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:03:54 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk"/>
Nov 28 17:03:54 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:03:54 user nova-compute[75246]:     </disk>
Nov 28 17:03:54 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:03:54 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:03:54 user nova-compute[75246]:       <source dev="/dev/sdb"/>
Nov 28 17:03:54 user nova-compute[75246]:       <target dev="vdb" bus="virtio"/>
Nov 28 17:03:54 user nova-compute[75246]:       <serial>3d2f58a0-30e0-4819-aae0-07657c5f32b4</serial>
Nov 28 17:03:54 user nova-compute[75246]:     </disk>
Nov 28 17:03:54 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:03:54 user nova-compute[75246]:       <mac address="fa:16:3e:d2:1a:3a"/>
Nov 28 17:03:54 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:03:54 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:03:54 user nova-compute[75246]:       <target dev="tap3b26f892-a2"/>
Nov 28 17:03:54 user nova-compute[75246]:     </interface>
Nov 28 17:03:54 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:03:54 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/console.log" append="off"/>
Nov 28 17:03:54 user nova-compute[75246]:     </serial>
Nov 28 17:03:54 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:03:54 user nova-compute[75246]:     <video>
Nov 28 17:03:54 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:03:54 user nova-compute[75246]:     </video>
Nov 28 17:03:54 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:03:54 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:03:54 user nova-compute[75246]:     </rng>
Nov 28 17:03:54 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:03:54 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:03:54 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:03:54 user nova-compute[75246]:     </memballoon>
Nov 28 17:03:54 user nova-compute[75246]:   </devices>
Nov 28 17:03:54 user nova-compute[75246]: </domain>
Nov 28 17:03:54 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-511980533',display_name='tempest-ServerActionsTestOtherB-server-511980533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-511980533',id=3,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeYN/HSLFqD4XGGEXJ9b8W5tTZ1Q+j1Wl9INcd9I7zBrxI2z/wVXkIvtrK7OKu4ZT8jqxkECEhWOY/LUm6Wr8yFYH+XfgjPLkBJ3Cg5yb8oaGQFI8Npp1mQPS7budj7Eg==',key_name='tempest-keypair-789293158',keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:59:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3098a0e0fd3640d6b0c61303e10b9269',ramdisk_id='',reservation_id='r-ibzp3hny',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-779885367',owner_user_name='tempest-ServerActionsTestOtherB-779885367-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:03:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec11d8eaa57441e4b1178c39dfccd51f',uuid=4b650a57-5870-4f77-bca2-abe50d970b40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-320898042-network", "vif_mac": "fa:16:3e:d2:1a:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Converting VIF {"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-320898042-network", "vif_mac": "fa:16:3e:d2:1a:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG os_vif [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab6fb5da-1db5-5550-9a5a-f117fb67053e', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b26f892-a2, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b26f892-a2, col_values=(('qos', UUID('6308e1b3-db2d-49d6-b3c1-ebbc8cb077cb')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b26f892-a2, col_values=(('external_ids', {'iface-id': '3b26f892-a21c-4c9f-b4f2-627ed62fb2c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:1a:3a', 'vm-uuid': '4b650a57-5870-4f77-bca2-abe50d970b40'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:03:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:54 user nova-compute[75246]: INFO os_vif [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2')
Nov 28 17:03:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:03:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:03:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] No VIF found with MAC fa:16:3e:d2:1a:3a, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:03:55 user nova-compute[75246]: INFO nova.compute.manager [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Took 0.90 seconds to detach 1 volumes for instance.
Nov 28 17:03:55 user nova-compute[75246]: DEBUG nova.compute.manager [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] [instance: 9f306608-7716-41e0-9aa0-afa8ba173a04] Deleting volume: 5a955b08-0696-4533-b17d-0e99d36216e1 {{(pid=75246) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 17:03:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-993999dc-fe10-4cf4-99e8-5371cb17b7f5 req-fa66f6a7-46b9-429d-81e9-90b86b453690 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received event network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-993999dc-fe10-4cf4-99e8-5371cb17b7f5 req-fa66f6a7-46b9-429d-81e9-90b86b453690 service nova] Acquiring lock "c94900af-f484-47bf-8627-8aa863334b63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-993999dc-fe10-4cf4-99e8-5371cb17b7f5 req-fa66f6a7-46b9-429d-81e9-90b86b453690 service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-993999dc-fe10-4cf4-99e8-5371cb17b7f5 req-fa66f6a7-46b9-429d-81e9-90b86b453690 service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-993999dc-fe10-4cf4-99e8-5371cb17b7f5 req-fa66f6a7-46b9-429d-81e9-90b86b453690 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] No waiting events found dispatching network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:55 user nova-compute[75246]: WARNING nova.compute.manager [req-993999dc-fe10-4cf4-99e8-5371cb17b7f5 req-fa66f6a7-46b9-429d-81e9-90b86b453690 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received unexpected event network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 for instance with vm_state active and task_state None.
Nov 28 17:03:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:56 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:03:56 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:03:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.774s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:56 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Deleted allocations for instance 9f306608-7716-41e0-9aa0-afa8ba173a04
Nov 28 17:03:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-413e5f70-c71f-4d44-8dda-802e717f4c3e tempest-ServerActionsV293TestJSON-1837306517 tempest-ServerActionsV293TestJSON-1837306517-project-member] Lock "9f306608-7716-41e0-9aa0-afa8ba173a04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.455s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received event network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] Acquiring lock "c94900af-f484-47bf-8627-8aa863334b63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] No waiting events found dispatching network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:57 user nova-compute[75246]: WARNING nova.compute.manager [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received unexpected event network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 for instance with vm_state active and task_state None.
Nov 28 17:03:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Received event network-vif-plugged-0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] Acquiring lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] No waiting events found dispatching network-vif-plugged-0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:57 user nova-compute[75246]: WARNING nova.compute.manager [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Received unexpected event network-vif-plugged-0a3da48f-457a-450f-8102-d758c18d2554 for instance with vm_state active and task_state None.
Nov 28 17:03:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Received event network-vif-plugged-0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] Acquiring lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] No waiting events found dispatching network-vif-plugged-0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:57 user nova-compute[75246]: WARNING nova.compute.manager [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Received unexpected event network-vif-plugged-0a3da48f-457a-450f-8102-d758c18d2554 for instance with vm_state active and task_state None.
Nov 28 17:03:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received event network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] No waiting events found dispatching network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:57 user nova-compute[75246]: WARNING nova.compute.manager [req-d71fa476-2db1-470d-b1bd-1043e076335b req-816d3c28-e0ac-4b04-a093-f53e292a2cae service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received unexpected event network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 for instance with vm_state active and task_state resize_finish.
Nov 28 17:03:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:03:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-522436d2-a7dc-48b9-addf-7ab140e02f62 req-99779434-2445-4a82-a485-7a7bc0573b71 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received event network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:03:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-522436d2-a7dc-48b9-addf-7ab140e02f62 req-99779434-2445-4a82-a485-7a7bc0573b71 service nova] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:03:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-522436d2-a7dc-48b9-addf-7ab140e02f62 req-99779434-2445-4a82-a485-7a7bc0573b71 service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:03:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-522436d2-a7dc-48b9-addf-7ab140e02f62 req-99779434-2445-4a82-a485-7a7bc0573b71 service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:03:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-522436d2-a7dc-48b9-addf-7ab140e02f62 req-99779434-2445-4a82-a485-7a7bc0573b71 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] No waiting events found dispatching network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:03:59 user nova-compute[75246]: WARNING nova.compute.manager [req-522436d2-a7dc-48b9-addf-7ab140e02f62 req-99779434-2445-4a82-a485-7a7bc0573b71 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received unexpected event network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 for instance with vm_state active and task_state resize_finish.
Nov 28 17:03:59 user nova-compute[75246]: DEBUG nova.compute.manager [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:03:59 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Instance running successfully.
Nov 28 17:03:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Failed to set time: agent not configured {{(pid=75246) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 28 17:03:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0adc19a7-82f8-4e12-8f16-8b67cf371109 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] finish_migration finished successfully. {{(pid=75246) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 28 17:03:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:01 user nova-compute[75246]: DEBUG nova.compute.manager [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:04:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:04:01 user nova-compute[75246]: INFO nova.compute.claims [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Claim successful on node user
Nov 28 17:04:02 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:04:02 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:04:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.770s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:04:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:04:02 user nova-compute[75246]: DEBUG nova.network.neutron [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:04:02 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:04:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:04:02 user nova-compute[75246]: DEBUG nova.policy [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '194df496b87a48d68835cb7aa0802560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d01a3eaa26b4fc790abe7761fb2bb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:04:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:04:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:04:02 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Creating image(s)
Nov 28 17:04:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "/opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "/opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "/opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "462e134ce8e9ab66bc35c7320aac7946ae6a4904" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "462e134ce8e9ab66bc35c7320aac7946ae6a4904" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904.part --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:03 user nova-compute[75246]: DEBUG nova.network.neutron [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Successfully created port: 8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:04:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904.part --force-share --output=json" returned: 0 in 0.205s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:03 user nova-compute[75246]: DEBUG nova.virt.images [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] 314c5acf-fabe-491c-8951-2240751d2dd2 was qcow2, converting to raw {{(pid=75246) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 17:04:03 user nova-compute[75246]: DEBUG nova.privsep.utils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75246) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 17:04:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904.part /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904.converted {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904.part /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904.converted" returned: 0 in 0.309s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904.converted --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904.converted --force-share --output=json" returned: 0 in 0.258s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "462e134ce8e9ab66bc35c7320aac7946ae6a4904" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.501s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904 --force-share --output=json" returned: 0 in 0.234s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "462e134ce8e9ab66bc35c7320aac7946ae6a4904" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "462e134ce8e9ab66bc35c7320aac7946ae6a4904" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904 --force-share --output=json" returned: 0 in 0.270s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904,backing_fmt=raw /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:04 user nova-compute[75246]: DEBUG nova.network.neutron [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Successfully updated port: 8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:04:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904,backing_fmt=raw /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk 1073741824" returned: 0 in 0.089s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "462e134ce8e9ab66bc35c7320aac7946ae6a4904" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.369s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquired lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.network.neutron [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-6d2ca109-e713-4e50-9896-1853cbed6a8a req-fe3e252b-3241-47a6-b1e0-ab651226372e service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received event network-changed-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-6d2ca109-e713-4e50-9896-1853cbed6a8a req-fe3e252b-3241-47a6-b1e0-ab651226372e service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Refreshing instance network info cache due to event network-changed-8932d31b-ff61-4b52-9f2d-a646560d3777. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6d2ca109-e713-4e50-9896-1853cbed6a8a req-fe3e252b-3241-47a6-b1e0-ab651226372e service nova] Acquiring lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.network.neutron [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904 --force-share --output=json" returned: 0 in 0.250s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Cannot resize image /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Ensure instance console log exists: /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.network.neutron [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Updating instance_info_cache with network_info: [{"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Releasing lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.compute.manager [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Instance network_info: |[{"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6d2ca109-e713-4e50-9896-1853cbed6a8a req-fe3e252b-3241-47a6-b1e0-ab651226372e service nova] Acquired lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.network.neutron [req-6d2ca109-e713-4e50-9896-1853cbed6a8a req-fe3e252b-3241-47a6-b1e0-ab651226372e service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Refreshing network info cache for port 8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Start _get_guest_xml network_info=[{"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T17:03:58Z,direct_url=<?>,disk_format='qcow2',id=314c5acf-fabe-491c-8951-2240751d2dd2,min_disk=0,min_ram=0,name='tempest-scenario-img--1842276246',owner='2d01a3eaa26b4fc790abe7761fb2bb8a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T17:04:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '314c5acf-fabe-491c-8951-2240751d2dd2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:04:05 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:04:05 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T17:03:58Z,direct_url=<?>,disk_format='qcow2',id=314c5acf-fabe-491c-8951-2240751d2dd2,min_disk=0,min_ram=0,name='tempest-scenario-img--1842276246',owner='2d01a3eaa26b4fc790abe7761fb2bb8a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T17:04:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:04:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1459152348',display_name='tempest-TestMinimumBasicScenario-server-1459152348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1459152348',id=18,image_ref='314c5acf-fabe-491c-8951-2240751d2dd2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV+cCKVKkKjippHw8fvg8ZUQ588Q45fV8SzYDVWZENrWtuGg6Vh8hnO4mjpQRK6qsK31ree66V8juizOkiDArzejhbRH/K2TpIsEaUaC5icEpgo6owAmBBXtqppX4HiNQ==',key_name='tempest-TestMinimumBasicScenario-700258823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d01a3eaa26b4fc790abe7761fb2bb8a',ramdisk_id='',reservation_id='r-5f8m3x0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='314c5acf-fabe-491c-8951-2240751d2dd2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-433831737',owner_user_name='tempest-TestMinimumBasicScenario-433831737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:04:03Z,user_data=None,user_id='194df496b87a48d68835cb7aa0802560',uuid=6579e6f5-93be-4b39-9c61-ca3dbc40b79f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Converting VIF {"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:21:7a,bridge_name='br-int',has_traffic_filtering=True,id=8932d31b-ff61-4b52-9f2d-a646560d3777,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8932d31b-ff') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.objects.instance [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lazy-loading 'pci_devices' on Instance uuid 6579e6f5-93be-4b39-9c61-ca3dbc40b79f {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:04:05 user nova-compute[75246]:   <uuid>6579e6f5-93be-4b39-9c61-ca3dbc40b79f</uuid>
Nov 28 17:04:05 user nova-compute[75246]:   <name>instance-00000012</name>
Nov 28 17:04:05 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:04:05 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:04:05 user nova-compute[75246]:   <metadata>
Nov 28 17:04:05 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:04:05 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:04:05 user nova-compute[75246]:       <nova:name>tempest-TestMinimumBasicScenario-server-1459152348</nova:name>
Nov 28 17:04:05 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:04:05</nova:creationTime>
Nov 28 17:04:05 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:04:05 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:04:05 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:04:05 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:04:05 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:04:05 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:04:05 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:04:05 user nova-compute[75246]:       <nova:owner>
Nov 28 17:04:05 user nova-compute[75246]:         <nova:user uuid="194df496b87a48d68835cb7aa0802560">tempest-TestMinimumBasicScenario-433831737-project-member</nova:user>
Nov 28 17:04:05 user nova-compute[75246]:         <nova:project uuid="2d01a3eaa26b4fc790abe7761fb2bb8a">tempest-TestMinimumBasicScenario-433831737</nova:project>
Nov 28 17:04:05 user nova-compute[75246]:       </nova:owner>
Nov 28 17:04:05 user nova-compute[75246]:       <nova:root type="image" uuid="314c5acf-fabe-491c-8951-2240751d2dd2"/>
Nov 28 17:04:05 user nova-compute[75246]:       <nova:ports>
Nov 28 17:04:05 user nova-compute[75246]:         <nova:port uuid="8932d31b-ff61-4b52-9f2d-a646560d3777">
Nov 28 17:04:05 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 17:04:05 user nova-compute[75246]:         </nova:port>
Nov 28 17:04:05 user nova-compute[75246]:       </nova:ports>
Nov 28 17:04:05 user nova-compute[75246]:     </nova:instance>
Nov 28 17:04:05 user nova-compute[75246]:   </metadata>
Nov 28 17:04:05 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:04:05 user nova-compute[75246]:     <system>
Nov 28 17:04:05 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:04:05 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:04:05 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:04:05 user nova-compute[75246]:       <entry name="serial">6579e6f5-93be-4b39-9c61-ca3dbc40b79f</entry>
Nov 28 17:04:05 user nova-compute[75246]:       <entry name="uuid">6579e6f5-93be-4b39-9c61-ca3dbc40b79f</entry>
Nov 28 17:04:05 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:04:05 user nova-compute[75246]:     </system>
Nov 28 17:04:05 user nova-compute[75246]:   </sysinfo>
Nov 28 17:04:05 user nova-compute[75246]:   <os>
Nov 28 17:04:05 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:04:05 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:04:05 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:04:05 user nova-compute[75246]:   </os>
Nov 28 17:04:05 user nova-compute[75246]:   <features>
Nov 28 17:04:05 user nova-compute[75246]:     <acpi/>
Nov 28 17:04:05 user nova-compute[75246]:     <apic/>
Nov 28 17:04:05 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:04:05 user nova-compute[75246]:   </features>
Nov 28 17:04:05 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:04:05 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:04:05 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:04:05 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:04:05 user nova-compute[75246]:   </clock>
Nov 28 17:04:05 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:04:05 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:04:05 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:04:05 user nova-compute[75246]:   </cpu>
Nov 28 17:04:05 user nova-compute[75246]:   <devices>
Nov 28 17:04:05 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:04:05 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:04:05 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk"/>
Nov 28 17:04:05 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:04:05 user nova-compute[75246]:     </disk>
Nov 28 17:04:05 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:04:05 user nova-compute[75246]:       <mac address="fa:16:3e:2c:21:7a"/>
Nov 28 17:04:05 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:04:05 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:04:05 user nova-compute[75246]:       <target dev="tap8932d31b-ff"/>
Nov 28 17:04:05 user nova-compute[75246]:     </interface>
Nov 28 17:04:05 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:04:05 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/console.log" append="off"/>
Nov 28 17:04:05 user nova-compute[75246]:     </serial>
Nov 28 17:04:05 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:04:05 user nova-compute[75246]:     <video>
Nov 28 17:04:05 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:04:05 user nova-compute[75246]:     </video>
Nov 28 17:04:05 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:04:05 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:04:05 user nova-compute[75246]:     </rng>
Nov 28 17:04:05 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:04:05 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:04:05 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:04:05 user nova-compute[75246]:     </memballoon>
Nov 28 17:04:05 user nova-compute[75246]:   </devices>
Nov 28 17:04:05 user nova-compute[75246]: </domain>
Nov 28 17:04:05 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:04:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1459152348',display_name='tempest-TestMinimumBasicScenario-server-1459152348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1459152348',id=18,image_ref='314c5acf-fabe-491c-8951-2240751d2dd2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV+cCKVKkKjippHw8fvg8ZUQ588Q45fV8SzYDVWZENrWtuGg6Vh8hnO4mjpQRK6qsK31ree66V8juizOkiDArzejhbRH/K2TpIsEaUaC5icEpgo6owAmBBXtqppX4HiNQ==',key_name='tempest-TestMinimumBasicScenario-700258823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d01a3eaa26b4fc790abe7761fb2bb8a',ramdisk_id='',reservation_id='r-5f8m3x0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='314c5acf-fabe-491c-8951-2240751d2dd2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-433831737',owner_user_name='tempest-TestMinimumBasicScenario-433831737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:04:03Z,user_data=None,user_id='194df496b87a48d68835cb7aa0802560',uuid=6579e6f5-93be-4b39-9c61-ca3dbc40b79f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Converting VIF {"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:21:7a,bridge_name='br-int',has_traffic_filtering=True,id=8932d31b-ff61-4b52-9f2d-a646560d3777,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8932d31b-ff') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG os_vif [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:21:7a,bridge_name='br-int',has_traffic_filtering=True,id=8932d31b-ff61-4b52-9f2d-a646560d3777,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8932d31b-ff') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd78c8b5a-a79a-5f18-9d8e-5242ea5db70e', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8932d31b-ff, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8932d31b-ff, col_values=(('qos', UUID('1928304c-d7c7-4ebc-aacf-437bfcc46476')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8932d31b-ff, col_values=(('external_ids', {'iface-id': '8932d31b-ff61-4b52-9f2d-a646560d3777', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:21:7a', 'vm-uuid': '6579e6f5-93be-4b39-9c61-ca3dbc40b79f'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:05 user nova-compute[75246]: INFO os_vif [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:21:7a,bridge_name='br-int',has_traffic_filtering=True,id=8932d31b-ff61-4b52-9f2d-a646560d3777,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8932d31b-ff')
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:04:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] No VIF found with MAC fa:16:3e:2c:21:7a, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:04:06 user nova-compute[75246]: DEBUG nova.network.neutron [req-6d2ca109-e713-4e50-9896-1853cbed6a8a req-fe3e252b-3241-47a6-b1e0-ab651226372e service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Updated VIF entry in instance network info cache for port 8932d31b-ff61-4b52-9f2d-a646560d3777. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:04:06 user nova-compute[75246]: DEBUG nova.network.neutron [req-6d2ca109-e713-4e50-9896-1853cbed6a8a req-fe3e252b-3241-47a6-b1e0-ab651226372e service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Updating instance_info_cache with network_info: [{"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:04:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6d2ca109-e713-4e50-9896-1853cbed6a8a req-fe3e252b-3241-47a6-b1e0-ab651226372e service nova] Releasing lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:04:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:08 user nova-compute[75246]: DEBUG nova.compute.manager [req-fb53202b-8f56-46f8-bb05-50100c01732f req-67a9efb9-c0b6-4b9e-8df6-b47bd8217766 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received event network-vif-plugged-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:04:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb53202b-8f56-46f8-bb05-50100c01732f req-67a9efb9-c0b6-4b9e-8df6-b47bd8217766 service nova] Acquiring lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb53202b-8f56-46f8-bb05-50100c01732f req-67a9efb9-c0b6-4b9e-8df6-b47bd8217766 service nova] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb53202b-8f56-46f8-bb05-50100c01732f req-67a9efb9-c0b6-4b9e-8df6-b47bd8217766 service nova] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:08 user nova-compute[75246]: DEBUG nova.compute.manager [req-fb53202b-8f56-46f8-bb05-50100c01732f req-67a9efb9-c0b6-4b9e-8df6-b47bd8217766 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] No waiting events found dispatching network-vif-plugged-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:04:08 user nova-compute[75246]: WARNING nova.compute.manager [req-fb53202b-8f56-46f8-bb05-50100c01732f req-67a9efb9-c0b6-4b9e-8df6-b47bd8217766 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received unexpected event network-vif-plugged-8932d31b-ff61-4b52-9f2d-a646560d3777 for instance with vm_state building and task_state spawning.
Nov 28 17:04:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-cd890029-9e5a-4d76-8359-af6ea8b893af req-d60e83b8-ad97-4cf2-9ba6-87893284aff1 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received event network-vif-plugged-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:04:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cd890029-9e5a-4d76-8359-af6ea8b893af req-d60e83b8-ad97-4cf2-9ba6-87893284aff1 service nova] Acquiring lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cd890029-9e5a-4d76-8359-af6ea8b893af req-d60e83b8-ad97-4cf2-9ba6-87893284aff1 service nova] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cd890029-9e5a-4d76-8359-af6ea8b893af req-d60e83b8-ad97-4cf2-9ba6-87893284aff1 service nova] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-cd890029-9e5a-4d76-8359-af6ea8b893af req-d60e83b8-ad97-4cf2-9ba6-87893284aff1 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] No waiting events found dispatching network-vif-plugged-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:04:10 user nova-compute[75246]: WARNING nova.compute.manager [req-cd890029-9e5a-4d76-8359-af6ea8b893af req-d60e83b8-ad97-4cf2-9ba6-87893284aff1 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received unexpected event network-vif-plugged-8932d31b-ff61-4b52-9f2d-a646560d3777 for instance with vm_state building and task_state spawning.
Nov 28 17:04:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:10 user nova-compute[75246]: DEBUG nova.compute.manager [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:04:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:04:10 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Instance spawned successfully.
Nov 28 17:04:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:04:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:04:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:04:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:04:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:04:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:04:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:04:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:10 user nova-compute[75246]: INFO nova.compute.manager [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Took 7.95 seconds to spawn the instance on the hypervisor.
Nov 28 17:04:10 user nova-compute[75246]: DEBUG nova.compute.manager [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:04:10 user nova-compute[75246]: INFO nova.compute.manager [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Took 9.23 seconds to build instance.
Nov 28 17:04:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7d46b1ef-8ff7-4582-926f-c41e16240c09 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.376s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:04:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:21 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:04:21 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:04:23 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:04:23 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:04:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-a3fe15c9-36ab-404e-876e-e6241cca05f4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:04:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-a3fe15c9-36ab-404e-876e-e6241cca05f4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:04:23 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:04:23 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Updating instance_info_cache with network_info: [{"id": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "address": "fa:16:3e:4a:b0:8a", "network": {"id": "ab6145d5-6573-4554-af98-a03fc795d945", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1474432451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768ccf6f-fd", "ovs_interfaceid": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2e784b7-3e89-4751-854f-5456cc694388", "address": "fa:16:3e:81:7f:b4", "network": {"id": "ff598896-c7ba-4144-b8d4-1b3e7a7848e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-7575623", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e784b7-3e", "ovs_interfaceid": "a2e784b7-3e89-4751-854f-5456cc694388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:04:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-a3fe15c9-36ab-404e-876e-e6241cca05f4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:04:23 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:04:23 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:04:23 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:04:23 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:04:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:24 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:04:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:26 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:04:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:29 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:04:29 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:04:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=7170MB free_disk=25.522022247314453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Applying migration context for instance 4b650a57-5870-4f77-bca2-abe50d970b40 as it has an incoming, in-progress migration 80be8226-a637-4d78-b2c5-26341b30b340. Migration status is finished {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 17:04:29 user nova-compute[75246]: INFO nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Updating resource usage from migration 80be8226-a637-4d78-b2c5-26341b30b340
Nov 28 17:04:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 25480185-8c9c-4aad-9c46-573cfbf65364 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e1266470-c182-4c0c-a575-4c5043f54745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 915bc61e-eaea-40c0-a5ed-4d2a677477f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a3fe15c9-36ab-404e-876e-e6241cca05f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 9f711268-28e4-4e2e-b5eb-e875c0d72e5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 86142721-b9dd-44ab-b994-f81443b5383c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Migration 80be8226-a637-4d78-b2c5-26341b30b340 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 4b650a57-5870-4f77-bca2-abe50d970b40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c94900af-f484-47bf-8627-8aa863334b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 6579e6f5-93be-4b39-9c61-ca3dbc40b79f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:04:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.647s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:31 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:04:31 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:04:31 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:04:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:52 user nova-compute[75246]: INFO nova.compute.manager [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Terminating instance
Nov 28 17:04:52 user nova-compute[75246]: DEBUG nova.compute.manager [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:04:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-1eba7faf-408c-4b1d-b242-c7c4ec1021c6 req-cb31527f-6054-40e3-a39a-1f6ebfa19173 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Received event network-vif-unplugged-d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1eba7faf-408c-4b1d-b242-c7c4ec1021c6 req-cb31527f-6054-40e3-a39a-1f6ebfa19173 service nova] Acquiring lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1eba7faf-408c-4b1d-b242-c7c4ec1021c6 req-cb31527f-6054-40e3-a39a-1f6ebfa19173 service nova] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1eba7faf-408c-4b1d-b242-c7c4ec1021c6 req-cb31527f-6054-40e3-a39a-1f6ebfa19173 service nova] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-1eba7faf-408c-4b1d-b242-c7c4ec1021c6 req-cb31527f-6054-40e3-a39a-1f6ebfa19173 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] No waiting events found dispatching network-vif-unplugged-d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-1eba7faf-408c-4b1d-b242-c7c4ec1021c6 req-cb31527f-6054-40e3-a39a-1f6ebfa19173 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Received event network-vif-unplugged-d2b06fbc-0c49-459a-900c-f7a178b91bda for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:53 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Instance destroyed successfully.
Nov 28 17:04:53 user nova-compute[75246]: DEBUG nova.objects.instance [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lazy-loading 'resources' on Instance uuid 9f711268-28e4-4e2e-b5eb-e875c0d72e5b {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1496002471',display_name='tempest-VolumesAdminNegativeTest-server-1496002471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1496002471',id=14,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:03:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='559858a844e64c6c80e194efd0b71c9c',ramdisk_id='',reservation_id='r-fq3bhmiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-996939064',owner_user_name='tempest-VolumesAdminNegativeTest-996939064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:03:02Z,user_data=None,user_id='136ea37d7d6a4cd1a2f4779f8e8c4cb7',uuid=9f711268-28e4-4e2e-b5eb-e875c0d72e5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "address": "fa:16:3e:b4:44:79", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b06fbc-0c", "ovs_interfaceid": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Converting VIF {"id": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "address": "fa:16:3e:b4:44:79", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b06fbc-0c", "ovs_interfaceid": "d2b06fbc-0c49-459a-900c-f7a178b91bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:44:79,bridge_name='br-int',has_traffic_filtering=True,id=d2b06fbc-0c49-459a-900c-f7a178b91bda,network=Network(7c4b4f14-738c-4741-a7d1-b831c7557206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2b06fbc-0c') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG os_vif [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:44:79,bridge_name='br-int',has_traffic_filtering=True,id=d2b06fbc-0c49-459a-900c-f7a178b91bda,network=Network(7c4b4f14-738c-4741-a7d1-b831c7557206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2b06fbc-0c') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2b06fbc-0c, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91cb2fdc-8142-4955-9290-f9f3238868fd) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:04:53 user nova-compute[75246]: INFO os_vif [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:44:79,bridge_name='br-int',has_traffic_filtering=True,id=d2b06fbc-0c49-459a-900c-f7a178b91bda,network=Network(7c4b4f14-738c-4741-a7d1-b831c7557206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2b06fbc-0c')
Nov 28 17:04:53 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Deleting instance files /opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b_del
Nov 28 17:04:53 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Deletion of /opt/stack/data/nova/instances/9f711268-28e4-4e2e-b5eb-e875c0d72e5b_del complete
Nov 28 17:04:53 user nova-compute[75246]: INFO nova.compute.manager [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 28 17:04:53 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:54 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:04:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "0d952de1-8c78-4bea-853d-21ac4f979845" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "0d952de1-8c78-4bea-853d-21ac4f979845" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:54 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Took 1.05 seconds to deallocate network for instance.
Nov 28 17:04:54 user nova-compute[75246]: DEBUG nova.compute.manager [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:04:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:54 user nova-compute[75246]: DEBUG nova.compute.manager [req-e189ac54-e3f1-43e1-b74f-11539cfe83d5 req-a5efefc5-abfc-491c-b6c5-71297c820ef1 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Received event network-vif-deleted-d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:04:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Received event network-vif-plugged-d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] Acquiring lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] No waiting events found dispatching network-vif-plugged-d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:04:55 user nova-compute[75246]: WARNING nova.compute.manager [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Received unexpected event network-vif-plugged-d2b06fbc-0c49-459a-900c-f7a178b91bda for instance with vm_state deleted and task_state None.
Nov 28 17:04:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Received event network-vif-plugged-d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] Acquiring lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] No waiting events found dispatching network-vif-plugged-d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:04:55 user nova-compute[75246]: WARNING nova.compute.manager [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Received unexpected event network-vif-plugged-d2b06fbc-0c49-459a-900c-f7a178b91bda for instance with vm_state deleted and task_state None.
Nov 28 17:04:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Received event network-vif-plugged-d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] Acquiring lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] No waiting events found dispatching network-vif-plugged-d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:04:55 user nova-compute[75246]: WARNING nova.compute.manager [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Received unexpected event network-vif-plugged-d2b06fbc-0c49-459a-900c-f7a178b91bda for instance with vm_state deleted and task_state None.
Nov 28 17:04:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Received event network-vif-unplugged-d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] Acquiring lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] No waiting events found dispatching network-vif-unplugged-d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:04:55 user nova-compute[75246]: WARNING nova.compute.manager [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Received unexpected event network-vif-unplugged-d2b06fbc-0c49-459a-900c-f7a178b91bda for instance with vm_state deleted and task_state None.
Nov 28 17:04:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Received event network-vif-plugged-d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] Acquiring lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] No waiting events found dispatching network-vif-plugged-d2b06fbc-0c49-459a-900c-f7a178b91bda {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:04:55 user nova-compute[75246]: WARNING nova.compute.manager [req-d261f66b-ec5e-4703-8336-a6afe839f269 req-0f26d4ef-de08-4a22-9964-5191ffa22af3 service nova] [instance: 9f711268-28e4-4e2e-b5eb-e875c0d72e5b] Received unexpected event network-vif-plugged-d2b06fbc-0c49-459a-900c-f7a178b91bda for instance with vm_state deleted and task_state None.
Nov 28 17:04:55 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.783s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.714s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:04:55 user nova-compute[75246]: INFO nova.compute.claims [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Claim successful on node user
Nov 28 17:04:55 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Deleted allocations for instance 9f711268-28e4-4e2e-b5eb-e875c0d72e5b
Nov 28 17:04:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5d13ae7e-95ad-490c-bfeb-496e3164e7da tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "9f711268-28e4-4e2e-b5eb-e875c0d72e5b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.903s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:04:55 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG nova.compute.manager [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG nova.compute.manager [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG nova.network.neutron [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:04:56 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:04:56 user nova-compute[75246]: DEBUG nova.compute.manager [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG nova.policy [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0ed095223674edebcee82e4183c8ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd94665acd9a4448a1ad1350d71d8f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG nova.compute.manager [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:04:56 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Creating image(s)
Nov 28 17:04:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "/opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "/opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.204s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.189s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk 1073741824" returned: 0 in 0.061s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:56 user nova-compute[75246]: DEBUG nova.network.neutron [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Successfully created port: ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:04:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.213s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:57 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:04:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:04:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:04:57 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Cannot resize image /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:04:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:04:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Ensure instance console log exists: /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:04:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:57 user nova-compute[75246]: DEBUG nova.network.neutron [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Successfully updated port: ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:04:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:04:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquired lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:04:57 user nova-compute[75246]: DEBUG nova.network.neutron [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:04:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-51d2205b-de2e-4104-aab8-e1256eb4cf2c req-42832542-a92a-4236-aa1d-ca16c98036f7 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received event network-changed-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:04:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-51d2205b-de2e-4104-aab8-e1256eb4cf2c req-42832542-a92a-4236-aa1d-ca16c98036f7 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Refreshing instance network info cache due to event network-changed-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:04:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-51d2205b-de2e-4104-aab8-e1256eb4cf2c req-42832542-a92a-4236-aa1d-ca16c98036f7 service nova] Acquiring lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:04:57 user nova-compute[75246]: DEBUG nova.network.neutron [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.network.neutron [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Updating instance_info_cache with network_info: [{"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Releasing lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.compute.manager [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Instance network_info: |[{"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-51d2205b-de2e-4104-aab8-e1256eb4cf2c req-42832542-a92a-4236-aa1d-ca16c98036f7 service nova] Acquired lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.network.neutron [req-51d2205b-de2e-4104-aab8-e1256eb4cf2c req-42832542-a92a-4236-aa1d-ca16c98036f7 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Refreshing network info cache for port ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Start _get_guest_xml network_info=[{"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:04:58 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:04:58 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-278996386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-278996386',id=19,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/npncOA40T5UkpCTyoa9FE5URXN0CYEj19/p021hTQeiVdLEH7PgJXMG03aUYxg6AGun6gVIWPfrOtmZUotLJEBPXKB78yX8pcTgDSssDMf4QF1Q6mL0Cbl/SHy8/Bng==',key_name='tempest-keypair-1103265416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd94665acd9a4448a1ad1350d71d8f72',ramdisk_id='',reservation_id='r-eelgg57i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726606277',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726606277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ed095223674edebcee82e4183c8ea0',uuid=0d952de1-8c78-4bea-853d-21ac4f979845,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converting VIF {"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:37:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebb7a52b-f2f1-43e8-bea2-02a136b62aa1,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb7a52b-f2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.objects.instance [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d952de1-8c78-4bea-853d-21ac4f979845 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:04:58 user nova-compute[75246]:   <uuid>0d952de1-8c78-4bea-853d-21ac4f979845</uuid>
Nov 28 17:04:58 user nova-compute[75246]:   <name>instance-00000013</name>
Nov 28 17:04:58 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:04:58 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:04:58 user nova-compute[75246]:   <metadata>
Nov 28 17:04:58 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:04:58 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:04:58 user nova-compute[75246]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-278996386</nova:name>
Nov 28 17:04:58 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:04:58</nova:creationTime>
Nov 28 17:04:58 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:04:58 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:04:58 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:04:58 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:04:58 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:04:58 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:04:58 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:04:58 user nova-compute[75246]:       <nova:owner>
Nov 28 17:04:58 user nova-compute[75246]:         <nova:user uuid="a0ed095223674edebcee82e4183c8ea0">tempest-AttachVolumeShelveTestJSON-1726606277-project-member</nova:user>
Nov 28 17:04:58 user nova-compute[75246]:         <nova:project uuid="cd94665acd9a4448a1ad1350d71d8f72">tempest-AttachVolumeShelveTestJSON-1726606277</nova:project>
Nov 28 17:04:58 user nova-compute[75246]:       </nova:owner>
Nov 28 17:04:58 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:04:58 user nova-compute[75246]:       <nova:ports>
Nov 28 17:04:58 user nova-compute[75246]:         <nova:port uuid="ebb7a52b-f2f1-43e8-bea2-02a136b62aa1">
Nov 28 17:04:58 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 17:04:58 user nova-compute[75246]:         </nova:port>
Nov 28 17:04:58 user nova-compute[75246]:       </nova:ports>
Nov 28 17:04:58 user nova-compute[75246]:     </nova:instance>
Nov 28 17:04:58 user nova-compute[75246]:   </metadata>
Nov 28 17:04:58 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:04:58 user nova-compute[75246]:     <system>
Nov 28 17:04:58 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:04:58 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:04:58 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:04:58 user nova-compute[75246]:       <entry name="serial">0d952de1-8c78-4bea-853d-21ac4f979845</entry>
Nov 28 17:04:58 user nova-compute[75246]:       <entry name="uuid">0d952de1-8c78-4bea-853d-21ac4f979845</entry>
Nov 28 17:04:58 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:04:58 user nova-compute[75246]:     </system>
Nov 28 17:04:58 user nova-compute[75246]:   </sysinfo>
Nov 28 17:04:58 user nova-compute[75246]:   <os>
Nov 28 17:04:58 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:04:58 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:04:58 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:04:58 user nova-compute[75246]:   </os>
Nov 28 17:04:58 user nova-compute[75246]:   <features>
Nov 28 17:04:58 user nova-compute[75246]:     <acpi/>
Nov 28 17:04:58 user nova-compute[75246]:     <apic/>
Nov 28 17:04:58 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:04:58 user nova-compute[75246]:   </features>
Nov 28 17:04:58 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:04:58 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:04:58 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:04:58 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:04:58 user nova-compute[75246]:   </clock>
Nov 28 17:04:58 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:04:58 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:04:58 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:04:58 user nova-compute[75246]:   </cpu>
Nov 28 17:04:58 user nova-compute[75246]:   <devices>
Nov 28 17:04:58 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:04:58 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:04:58 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk"/>
Nov 28 17:04:58 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:04:58 user nova-compute[75246]:     </disk>
Nov 28 17:04:58 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:04:58 user nova-compute[75246]:       <mac address="fa:16:3e:4a:37:ae"/>
Nov 28 17:04:58 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:04:58 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:04:58 user nova-compute[75246]:       <target dev="tapebb7a52b-f2"/>
Nov 28 17:04:58 user nova-compute[75246]:     </interface>
Nov 28 17:04:58 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:04:58 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/console.log" append="off"/>
Nov 28 17:04:58 user nova-compute[75246]:     </serial>
Nov 28 17:04:58 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:04:58 user nova-compute[75246]:     <video>
Nov 28 17:04:58 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:04:58 user nova-compute[75246]:     </video>
Nov 28 17:04:58 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:04:58 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:04:58 user nova-compute[75246]:     </rng>
Nov 28 17:04:58 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:04:58 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:04:58 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:04:58 user nova-compute[75246]:     </memballoon>
Nov 28 17:04:58 user nova-compute[75246]:   </devices>
Nov 28 17:04:58 user nova-compute[75246]: </domain>
Nov 28 17:04:58 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-278996386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-278996386',id=19,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/npncOA40T5UkpCTyoa9FE5URXN0CYEj19/p021hTQeiVdLEH7PgJXMG03aUYxg6AGun6gVIWPfrOtmZUotLJEBPXKB78yX8pcTgDSssDMf4QF1Q6mL0Cbl/SHy8/Bng==',key_name='tempest-keypair-1103265416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd94665acd9a4448a1ad1350d71d8f72',ramdisk_id='',reservation_id='r-eelgg57i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726606277',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726606277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ed095223674edebcee82e4183c8ea0',uuid=0d952de1-8c78-4bea-853d-21ac4f979845,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converting VIF {"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:37:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebb7a52b-f2f1-43e8-bea2-02a136b62aa1,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb7a52b-f2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG os_vif [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:37:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebb7a52b-f2f1-43e8-bea2-02a136b62aa1,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb7a52b-f2') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e58420c6-ca61-5a62-b0dc-de4e7643046d', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebb7a52b-f2, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebb7a52b-f2, col_values=(('qos', UUID('cbdd079e-f7ea-40a5-bb81-4731c70b54fa')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebb7a52b-f2, col_values=(('external_ids', {'iface-id': 'ebb7a52b-f2f1-43e8-bea2-02a136b62aa1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:37:ae', 'vm-uuid': '0d952de1-8c78-4bea-853d-21ac4f979845'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:58 user nova-compute[75246]: INFO os_vif [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:37:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebb7a52b-f2f1-43e8-bea2-02a136b62aa1,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb7a52b-f2')
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] No VIF found with MAC fa:16:3e:4a:37:ae, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.network.neutron [req-51d2205b-de2e-4104-aab8-e1256eb4cf2c req-42832542-a92a-4236-aa1d-ca16c98036f7 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Updated VIF entry in instance network info cache for port ebb7a52b-f2f1-43e8-bea2-02a136b62aa1. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG nova.network.neutron [req-51d2205b-de2e-4104-aab8-e1256eb4cf2c req-42832542-a92a-4236-aa1d-ca16c98036f7 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Updating instance_info_cache with network_info: [{"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:04:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-51d2205b-de2e-4104-aab8-e1256eb4cf2c req-42832542-a92a-4236-aa1d-ca16c98036f7 service nova] Releasing lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:04:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:04:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-bc7d1e54-2c40-43b4-ac9f-64b9c34870eb req-0435a121-65e9-4ac2-ba1e-ca2cb25cbac7 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received event network-vif-plugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:04:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-bc7d1e54-2c40-43b4-ac9f-64b9c34870eb req-0435a121-65e9-4ac2-ba1e-ca2cb25cbac7 service nova] Acquiring lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:04:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-bc7d1e54-2c40-43b4-ac9f-64b9c34870eb req-0435a121-65e9-4ac2-ba1e-ca2cb25cbac7 service nova] Lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:04:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-bc7d1e54-2c40-43b4-ac9f-64b9c34870eb req-0435a121-65e9-4ac2-ba1e-ca2cb25cbac7 service nova] Lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:04:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-bc7d1e54-2c40-43b4-ac9f-64b9c34870eb req-0435a121-65e9-4ac2-ba1e-ca2cb25cbac7 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] No waiting events found dispatching network-vif-plugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:04:59 user nova-compute[75246]: WARNING nova.compute.manager [req-bc7d1e54-2c40-43b4-ac9f-64b9c34870eb req-0435a121-65e9-4ac2-ba1e-ca2cb25cbac7 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received unexpected event network-vif-plugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 for instance with vm_state building and task_state spawning.
Nov 28 17:05:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-325676e5-3808-4413-920e-e69a5c6220a7 req-1a92eaf7-8184-4003-890b-439f722ca39d service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received event network-vif-plugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-325676e5-3808-4413-920e-e69a5c6220a7 req-1a92eaf7-8184-4003-890b-439f722ca39d service nova] Acquiring lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-325676e5-3808-4413-920e-e69a5c6220a7 req-1a92eaf7-8184-4003-890b-439f722ca39d service nova] Lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-325676e5-3808-4413-920e-e69a5c6220a7 req-1a92eaf7-8184-4003-890b-439f722ca39d service nova] Lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-325676e5-3808-4413-920e-e69a5c6220a7 req-1a92eaf7-8184-4003-890b-439f722ca39d service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] No waiting events found dispatching network-vif-plugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:02 user nova-compute[75246]: WARNING nova.compute.manager [req-325676e5-3808-4413-920e-e69a5c6220a7 req-1a92eaf7-8184-4003-890b-439f722ca39d service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received unexpected event network-vif-plugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 for instance with vm_state building and task_state spawning.
Nov 28 17:05:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:05:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:05:02 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Instance spawned successfully.
Nov 28 17:05:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:05:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:05:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:05:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:05:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:05:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:05:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:05:02 user nova-compute[75246]: INFO nova.compute.manager [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Took 5.93 seconds to spawn the instance on the hypervisor.
Nov 28 17:05:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:05:02 user nova-compute[75246]: INFO nova.compute.manager [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Took 7.73 seconds to build instance.
Nov 28 17:05:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-acfd969d-4a6c-4bcf-85ca-7b2a5cc17c8b tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "0d952de1-8c78-4bea-853d-21ac4f979845" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.867s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-6b74f762-174f-462b-94dc-428f0c7f5218 req-ea1ce3a3-7b19-45bb-a5b5-6f0287a84b88 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received event network-changed-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-6b74f762-174f-462b-94dc-428f0c7f5218 req-ea1ce3a3-7b19-45bb-a5b5-6f0287a84b88 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Refreshing instance network info cache due to event network-changed-2438ce69-6032-4ced-abea-84518ff89dfb. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:05:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6b74f762-174f-462b-94dc-428f0c7f5218 req-ea1ce3a3-7b19-45bb-a5b5-6f0287a84b88 service nova] Acquiring lock "refresh_cache-86142721-b9dd-44ab-b994-f81443b5383c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:05:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6b74f762-174f-462b-94dc-428f0c7f5218 req-ea1ce3a3-7b19-45bb-a5b5-6f0287a84b88 service nova] Acquired lock "refresh_cache-86142721-b9dd-44ab-b994-f81443b5383c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:05:09 user nova-compute[75246]: DEBUG nova.network.neutron [req-6b74f762-174f-462b-94dc-428f0c7f5218 req-ea1ce3a3-7b19-45bb-a5b5-6f0287a84b88 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Refreshing network info cache for port 2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "86142721-b9dd-44ab-b994-f81443b5383c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "86142721-b9dd-44ab-b994-f81443b5383c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG nova.objects.instance [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lazy-loading 'flavor' on Instance uuid 86142721-b9dd-44ab-b994-f81443b5383c {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG nova.network.neutron [req-6b74f762-174f-462b-94dc-428f0c7f5218 req-ea1ce3a3-7b19-45bb-a5b5-6f0287a84b88 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Updated VIF entry in instance network info cache for port 2438ce69-6032-4ced-abea-84518ff89dfb. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG nova.network.neutron [req-6b74f762-174f-462b-94dc-428f0c7f5218 req-ea1ce3a3-7b19-45bb-a5b5-6f0287a84b88 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Updating instance_info_cache with network_info: [{"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "86142721-b9dd-44ab-b994-f81443b5383c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6b74f762-174f-462b-94dc-428f0c7f5218 req-ea1ce3a3-7b19-45bb-a5b5-6f0287a84b88 service nova] Releasing lock "refresh_cache-86142721-b9dd-44ab-b994-f81443b5383c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "86142721-b9dd-44ab-b994-f81443b5383c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "86142721-b9dd-44ab-b994-f81443b5383c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:10 user nova-compute[75246]: INFO nova.compute.manager [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Attaching volume 80ff9554-4dcc-4603-8d71-cf41cf34fc2f to /dev/vdb
Nov 28 17:05:10 user nova-compute[75246]: DEBUG os_brick.utils [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3baf8fc-8589-4175-a7df-a7c450d3b89c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[811615f8-de68-4787-a8ee-ecaa9efbda8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fc124b-e56a-4817-9140-8b16ce9117a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[499d4edc-5ec3-45dc-9b82-70173e124891]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:05:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:05:11 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:05:11 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[308b5217-4987-41d0-b779-068aa91ad4ce]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:05:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:05:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:05:11 user nova-compute[75246]: DEBUG os_brick.utils [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:05:11 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Updating existing volume attachment record: 022ba984-7cf0-4126-8593-dd9cbfd70b16 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:05:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Acquiring lock "a3fe15c9-36ab-404e-876e-e6241cca05f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Acquiring lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:13 user nova-compute[75246]: INFO nova.compute.manager [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Terminating instance
Nov 28 17:05:13 user nova-compute[75246]: DEBUG nova.compute.manager [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:05:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-1ec6a0bc-f3da-4dea-998a-a0e9c28064a6 req-d3c38ec7-a1a6-4f41-992c-f2b8138a4818 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received event network-vif-unplugged-768ccf6f-fd61-45d1-b92f-1757a17dd630 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1ec6a0bc-f3da-4dea-998a-a0e9c28064a6 req-d3c38ec7-a1a6-4f41-992c-f2b8138a4818 service nova] Acquiring lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1ec6a0bc-f3da-4dea-998a-a0e9c28064a6 req-d3c38ec7-a1a6-4f41-992c-f2b8138a4818 service nova] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1ec6a0bc-f3da-4dea-998a-a0e9c28064a6 req-d3c38ec7-a1a6-4f41-992c-f2b8138a4818 service nova] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-1ec6a0bc-f3da-4dea-998a-a0e9c28064a6 req-d3c38ec7-a1a6-4f41-992c-f2b8138a4818 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] No waiting events found dispatching network-vif-unplugged-768ccf6f-fd61-45d1-b92f-1757a17dd630 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-1ec6a0bc-f3da-4dea-998a-a0e9c28064a6 req-d3c38ec7-a1a6-4f41-992c-f2b8138a4818 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received event network-vif-unplugged-768ccf6f-fd61-45d1-b92f-1757a17dd630 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-a42cf003-de1c-4d6f-aadb-48239bd75006 req-456f6f43-9d20-46a1-8ab2-941ef9cb752a service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received event network-vif-unplugged-a2e784b7-3e89-4751-854f-5456cc694388 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a42cf003-de1c-4d6f-aadb-48239bd75006 req-456f6f43-9d20-46a1-8ab2-941ef9cb752a service nova] Acquiring lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a42cf003-de1c-4d6f-aadb-48239bd75006 req-456f6f43-9d20-46a1-8ab2-941ef9cb752a service nova] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a42cf003-de1c-4d6f-aadb-48239bd75006 req-456f6f43-9d20-46a1-8ab2-941ef9cb752a service nova] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-a42cf003-de1c-4d6f-aadb-48239bd75006 req-456f6f43-9d20-46a1-8ab2-941ef9cb752a service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] No waiting events found dispatching network-vif-unplugged-a2e784b7-3e89-4751-854f-5456cc694388 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-a42cf003-de1c-4d6f-aadb-48239bd75006 req-456f6f43-9d20-46a1-8ab2-941ef9cb752a service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received event network-vif-unplugged-a2e784b7-3e89-4751-854f-5456cc694388 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:14 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Instance destroyed successfully.
Nov 28 17:05:14 user nova-compute[75246]: DEBUG nova.objects.instance [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lazy-loading 'resources' on Instance uuid a3fe15c9-36ab-404e-876e-e6241cca05f4 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T16:59:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1290677406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1290677406',id=7,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJrFX4bITMkrby6ETDsYezBUA5h8p9LH12srNxdHviTlhXQIetTlR232xA8XXoc1vY6KV19PrW1yPWXcJCSTPwYRjwnPlIkcljll7OFMOW+nMc0PmFuhGMeQsruLDksRA==',key_name='tempest-keypair-693413544',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:00:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e482757bdc6447e6bbb8023603b840bf',ramdisk_id='',reservation_id='r-ib8ql4t7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1447929950',owner_user_name='tempest-TaggedAttachmentsTest-1447929950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:00:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfa371d2b74849bcaa6d181975484b66',uuid=a3fe15c9-36ab-404e-876e-e6241cca05f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "address": "fa:16:3e:4a:b0:8a", "network": {"id": "ab6145d5-6573-4554-af98-a03fc795d945", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1474432451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768ccf6f-fd", "ovs_interfaceid": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Converting VIF {"id": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "address": "fa:16:3e:4a:b0:8a", "network": {"id": "ab6145d5-6573-4554-af98-a03fc795d945", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1474432451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap768ccf6f-fd", "ovs_interfaceid": "768ccf6f-fd61-45d1-b92f-1757a17dd630", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:b0:8a,bridge_name='br-int',has_traffic_filtering=True,id=768ccf6f-fd61-45d1-b92f-1757a17dd630,network=Network(ab6145d5-6573-4554-af98-a03fc795d945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768ccf6f-fd') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG os_vif [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:b0:8a,bridge_name='br-int',has_traffic_filtering=True,id=768ccf6f-fd61-45d1-b92f-1757a17dd630,network=Network(ab6145d5-6573-4554-af98-a03fc795d945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768ccf6f-fd') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap768ccf6f-fd, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b0d5279-659b-48c5-b9e9-0001db41e331) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:14 user nova-compute[75246]: INFO os_vif [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:b0:8a,bridge_name='br-int',has_traffic_filtering=True,id=768ccf6f-fd61-45d1-b92f-1757a17dd630,network=Network(ab6145d5-6573-4554-af98-a03fc795d945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap768ccf6f-fd')
Nov 28 17:05:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T16:59:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1290677406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1290677406',id=7,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJrFX4bITMkrby6ETDsYezBUA5h8p9LH12srNxdHviTlhXQIetTlR232xA8XXoc1vY6KV19PrW1yPWXcJCSTPwYRjwnPlIkcljll7OFMOW+nMc0PmFuhGMeQsruLDksRA==',key_name='tempest-keypair-693413544',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:00:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e482757bdc6447e6bbb8023603b840bf',ramdisk_id='',reservation_id='r-ib8ql4t7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1447929950',owner_user_name='tempest-TaggedAttachmentsTest-1447929950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:00:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfa371d2b74849bcaa6d181975484b66',uuid=a3fe15c9-36ab-404e-876e-e6241cca05f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2e784b7-3e89-4751-854f-5456cc694388", "address": "fa:16:3e:81:7f:b4", "network": {"id": "ff598896-c7ba-4144-b8d4-1b3e7a7848e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-7575623", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e784b7-3e", "ovs_interfaceid": "a2e784b7-3e89-4751-854f-5456cc694388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Converting VIF {"id": "a2e784b7-3e89-4751-854f-5456cc694388", "address": "fa:16:3e:81:7f:b4", "network": {"id": "ff598896-c7ba-4144-b8d4-1b3e7a7848e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-7575623", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e482757bdc6447e6bbb8023603b840bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e784b7-3e", "ovs_interfaceid": "a2e784b7-3e89-4751-854f-5456cc694388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:7f:b4,bridge_name='br-int',has_traffic_filtering=True,id=a2e784b7-3e89-4751-854f-5456cc694388,network=Network(ff598896-c7ba-4144-b8d4-1b3e7a7848e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e784b7-3e') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG os_vif [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:7f:b4,bridge_name='br-int',has_traffic_filtering=True,id=a2e784b7-3e89-4751-854f-5456cc694388,network=Network(ff598896-c7ba-4144-b8d4-1b3e7a7848e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e784b7-3e') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2e784b7-3e, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d7a9b83-1227-4764-84b1-c92fe37f7f39) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:14 user nova-compute[75246]: INFO os_vif [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:7f:b4,bridge_name='br-int',has_traffic_filtering=True,id=a2e784b7-3e89-4751-854f-5456cc694388,network=Network(ff598896-c7ba-4144-b8d4-1b3e7a7848e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e784b7-3e')
Nov 28 17:05:14 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Deleting instance files /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4_del
Nov 28 17:05:14 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Deletion of /opt/stack/data/nova/instances/a3fe15c9-36ab-404e-876e-e6241cca05f4_del complete
Nov 28 17:05:14 user nova-compute[75246]: INFO nova.compute.manager [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 28 17:05:14 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:05:14 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:05:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:16 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:05:16 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Took 1.50 seconds to deallocate network for instance.
Nov 28 17:05:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-329b4196-4993-408f-bfa8-dc68fd611215 req-2fcb8f0f-cb64-4c31-9a14-0d9a0794173f service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received event network-vif-plugged-768ccf6f-fd61-45d1-b92f-1757a17dd630 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-329b4196-4993-408f-bfa8-dc68fd611215 req-2fcb8f0f-cb64-4c31-9a14-0d9a0794173f service nova] Acquiring lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-329b4196-4993-408f-bfa8-dc68fd611215 req-2fcb8f0f-cb64-4c31-9a14-0d9a0794173f service nova] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-329b4196-4993-408f-bfa8-dc68fd611215 req-2fcb8f0f-cb64-4c31-9a14-0d9a0794173f service nova] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-329b4196-4993-408f-bfa8-dc68fd611215 req-2fcb8f0f-cb64-4c31-9a14-0d9a0794173f service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] No waiting events found dispatching network-vif-plugged-768ccf6f-fd61-45d1-b92f-1757a17dd630 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:16 user nova-compute[75246]: WARNING nova.compute.manager [req-329b4196-4993-408f-bfa8-dc68fd611215 req-2fcb8f0f-cb64-4c31-9a14-0d9a0794173f service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received unexpected event network-vif-plugged-768ccf6f-fd61-45d1-b92f-1757a17dd630 for instance with vm_state active and task_state deleting.
Nov 28 17:05:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-d70fc8ec-0043-4b69-bf32-7ceea0fdb595 req-eb8a2b1d-1c67-4419-9cfa-2d2f1e0d3546 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received event network-vif-plugged-a2e784b7-3e89-4751-854f-5456cc694388 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d70fc8ec-0043-4b69-bf32-7ceea0fdb595 req-eb8a2b1d-1c67-4419-9cfa-2d2f1e0d3546 service nova] Acquiring lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d70fc8ec-0043-4b69-bf32-7ceea0fdb595 req-eb8a2b1d-1c67-4419-9cfa-2d2f1e0d3546 service nova] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d70fc8ec-0043-4b69-bf32-7ceea0fdb595 req-eb8a2b1d-1c67-4419-9cfa-2d2f1e0d3546 service nova] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-d70fc8ec-0043-4b69-bf32-7ceea0fdb595 req-eb8a2b1d-1c67-4419-9cfa-2d2f1e0d3546 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] No waiting events found dispatching network-vif-plugged-a2e784b7-3e89-4751-854f-5456cc694388 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:16 user nova-compute[75246]: WARNING nova.compute.manager [req-d70fc8ec-0043-4b69-bf32-7ceea0fdb595 req-eb8a2b1d-1c67-4419-9cfa-2d2f1e0d3546 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received unexpected event network-vif-plugged-a2e784b7-3e89-4751-854f-5456cc694388 for instance with vm_state active and task_state deleting.
Nov 28 17:05:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-d70fc8ec-0043-4b69-bf32-7ceea0fdb595 req-eb8a2b1d-1c67-4419-9cfa-2d2f1e0d3546 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received event network-vif-deleted-a2e784b7-3e89-4751-854f-5456cc694388 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-d70fc8ec-0043-4b69-bf32-7ceea0fdb595 req-eb8a2b1d-1c67-4419-9cfa-2d2f1e0d3546 service nova] [instance: a3fe15c9-36ab-404e-876e-e6241cca05f4] Received event network-vif-deleted-768ccf6f-fd61-45d1-b92f-1757a17dd630 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:16 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:05:16 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:05:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:16 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Deleted allocations for instance a3fe15c9-36ab-404e-876e-e6241cca05f4
Nov 28 17:05:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-71dcfb92-e3be-4292-86d7-05da776bf83d tempest-TaggedAttachmentsTest-1447929950 tempest-TaggedAttachmentsTest-1447929950-project-member] Lock "a3fe15c9-36ab-404e-876e-e6241cca05f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.521s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjrXBYVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:05:19 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:05:19 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:05:19 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[552dbc32-0dd6-4fad-aed7-e69a70486c53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:05:19 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ade143-6935-4c64-9691-6874932f6993]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f] added
Nov 28 17:05:19 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b14800-f6a2-4a7c-b1dd-af733ad4b441]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[37eb516e-4040-4f80-b785-6fb5d953bad1]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjrXBYVb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjrXBYVb" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[311dbf6c-2668-496a-b93e-dd787eaa34d5]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wjrXBYVb'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a912dd-0c99-49f3-aeb6-2dce2d5f4f47]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0d5864-17fa-4804-a86b-ecb6b389b1d0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:05:19 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:05:19 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3527ff5-c3e7-406e-9e97-ea68e584da3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f, portal: 172.16.0.220,3260]
Nov 28 17:05:19 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f, portal: 172.16.0.220,3260] successful.
Nov 28 17:05:19 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31c53f2-8c8b-4e95-949d-031f37117678]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee84b84-059a-44be-afff-9aaeced0c192]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:05:19 user nova-compute[75246]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:05:19 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:05:19 user nova-compute[75246]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:05:19 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a3fee5-4589-46a5-9815-969ca68353f1]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjrXBYVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:05:19 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 17:05:20 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] There are 0 instances to clean {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 17:05:20 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:05:20 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75246) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 17:05:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:20 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:05:20 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23361626265393765', 'path': '/dev/sdc'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:05:20 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361626265393765', 'path': '/dev/sdc'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:05:20 user nova-compute[75246]: DEBUG nova.objects.instance [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lazy-loading 'flavor' on Instance uuid 86142721-b9dd-44ab-b994-f81443b5383c {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:20 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:05:20 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:05:20 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:05:20 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:05:20 user nova-compute[75246]:   <serial>80ff9554-4dcc-4603-8d71-cf41cf34fc2f</serial>
Nov 28 17:05:20 user nova-compute[75246]: </disk>
Nov 28 17:05:20 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:05:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:05:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:05:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] No VIF found with MAC fa:16:3e:b8:31:e2, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:05:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-49ae87c6-e4f1-409a-91f9-e2a7c9973f89 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "86142721-b9dd-44ab-b994-f81443b5383c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.692s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:05:22 user nova-compute[75246]: INFO nova.compute.manager [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Rebuilding instance
Nov 28 17:05:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:05:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-2ae75dc7-b845-45b0-a7b1-fc0a1496d0d4 req-ffb5cbb9-774a-40d2-a462-1c0639fce033 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received event network-vif-unplugged-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2ae75dc7-b845-45b0-a7b1-fc0a1496d0d4 req-ffb5cbb9-774a-40d2-a462-1c0639fce033 service nova] Acquiring lock "86142721-b9dd-44ab-b994-f81443b5383c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2ae75dc7-b845-45b0-a7b1-fc0a1496d0d4 req-ffb5cbb9-774a-40d2-a462-1c0639fce033 service nova] Lock "86142721-b9dd-44ab-b994-f81443b5383c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2ae75dc7-b845-45b0-a7b1-fc0a1496d0d4 req-ffb5cbb9-774a-40d2-a462-1c0639fce033 service nova] Lock "86142721-b9dd-44ab-b994-f81443b5383c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-2ae75dc7-b845-45b0-a7b1-fc0a1496d0d4 req-ffb5cbb9-774a-40d2-a462-1c0639fce033 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] No waiting events found dispatching network-vif-unplugged-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:23 user nova-compute[75246]: WARNING nova.compute.manager [req-2ae75dc7-b845-45b0-a7b1-fc0a1496d0d4 req-ffb5cbb9-774a-40d2-a462-1c0639fce033 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received unexpected event network-vif-unplugged-2438ce69-6032-4ced-abea-84518ff89dfb for instance with vm_state active and task_state rebuilding.
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "69f05219-5034-4e88-879c-9c567e2c2fcd" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:23 user nova-compute[75246]: INFO nova.compute.manager [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Unshelving
Nov 28 17:05:23 user nova-compute[75246]: INFO nova.virt.block_device [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Booting with volume 73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 at /dev/vda
Nov 28 17:05:23 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Instance destroyed successfully.
Nov 28 17:05:23 user nova-compute[75246]: DEBUG os_brick.utils [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[628c0562-36f3-4038-b794-321682fc3010]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ef651f-f2d4-4313-bd79-0619a7fbe7cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6b1431-8097-4c69-9043-12f2623d41c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2cf126-2544-4a27-8722-7a5850644e5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:05:23 user nova-compute[75246]: INFO nova.compute.manager [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Detaching volume 80ff9554-4dcc-4603-8d71-cf41cf34fc2f
Nov 28 17:05:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:05:23 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2db609-f9af-47fe-9c12-e76760562b0e]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG os_brick.utils [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Updating existing volume attachment record: dbcc77a2-fc9d-4fae-85fc-3ce9174b7033 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:05:23 user nova-compute[75246]: INFO nova.virt.block_device [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Attempting to driver detach volume 80ff9554-4dcc-4603-8d71-cf41cf34fc2f from mountpoint /dev/vdb
Nov 28 17:05:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Attempting to detach device vdb from instance 86142721-b9dd-44ab-b994-f81443b5383c from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:05:23 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:05:23 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:05:23 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:05:23 user nova-compute[75246]:   <serial>80ff9554-4dcc-4603-8d71-cf41cf34fc2f</serial>
Nov 28 17:05:23 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:05:23 user nova-compute[75246]: </disk>
Nov 28 17:05:23 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:05:23 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Successfully detached device vdb from instance 86142721-b9dd-44ab-b994-f81443b5383c from the persistent domain config.
Nov 28 17:05:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjrXBYVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:05:23 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 17:05:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6545f732-a098-42a9-97ba-aa1554337137]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:05:23 user nova-compute[75246]: No targets found.
Nov 28 17:05:23 user nova-compute[75246]: iSNS:
Nov 28 17:05:23 user nova-compute[75246]: No targets found.
Nov 28 17:05:23 user nova-compute[75246]: STATIC:
Nov 28 17:05:23 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f
Nov 28 17:05:23 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:05:23 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:05:23 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4
Nov 28 17:05:23 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:05:23 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:05:23 user nova-compute[75246]: FIRMWARE:
Nov 28 17:05:23 user nova-compute[75246]: No targets found.
Nov 28 17:05:23 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:05:23 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:05:23 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce08984b-9869-4818-a58b-2dd9483a8cce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1d4d24-4d1f-4128-9f0c-0265a876a2ed]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:05:23 user nova-compute[75246]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:05:23 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:05:23 user nova-compute[75246]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:05:23 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d83c3130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f'): ({'sdc'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Removing single pathed devices sdc {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:05:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0897860-d583-4347-85af-cf2e0100d409]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[036da241-7ca6-4022-a11b-5012e95abe2d]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Flushing IO for device /dev/sdc {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5cf5bd-766c-4152-a0b5-a6cc8005b417]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaa8ccc-8226-496c-8520-3229150ed622]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fe694e-c1c3-45d2-a023-02458552b161]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8186930b-6711-4841-8188-5627af291f7c]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f, portal: 172.16.0.220,3260]
Nov 28 17:05:24 user nova-compute[75246]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f, portal: 172.16.0.220,3260] successful.
Nov 28 17:05:24 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a93a15-a682-477d-8fee-05b05b0872a3]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] <== disconnect_volume: return (344ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:25 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Instance destroyed successfully.
Nov 28 17:05:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:03:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-982853153',display_name='tempest-ServerActionsTestOtherA-server-1558896318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-982853153',id=15,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsIJC+q4Y4+55AC0y9HnA2vvt/v6RCSMYzioCDQ5Wqsi/6fMiuZzeuzQCkQ89dqnBC2m8g7FsGK4x+WMLFrWYG5HbTNoob2Sth9T+5kRFE/RvVS0LYqJNwESjTmUvS1xg==',key_name='tempest-keypair-2146767292',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:03:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='be06eee4e74a41b799f1df75ea55b955',ramdisk_id='',reservation_id='r-j7yi3b0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1554281978',owner_user_name='tempest-ServerActionsTestOtherA-1554281978-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:05:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39d2eb0837eb4c729fe9ca2964cbe789',uuid=86142721-b9dd-44ab-b994-f81443b5383c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converting VIF {"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:31:e2,bridge_name='br-int',has_traffic_filtering=True,id=2438ce69-6032-4ced-abea-84518ff89dfb,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2438ce69-60') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG os_vif [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:31:e2,bridge_name='br-int',has_traffic_filtering=True,id=2438ce69-6032-4ced-abea-84518ff89dfb,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2438ce69-60') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2438ce69-60, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-544f7d15-d41f-46d4-b113-7fd97cfc4e76 req-3ca8658d-0817-4f6e-9f64-7ae0400f834e service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received event network-vif-plugged-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-544f7d15-d41f-46d4-b113-7fd97cfc4e76 req-3ca8658d-0817-4f6e-9f64-7ae0400f834e service nova] Acquiring lock "86142721-b9dd-44ab-b994-f81443b5383c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-544f7d15-d41f-46d4-b113-7fd97cfc4e76 req-3ca8658d-0817-4f6e-9f64-7ae0400f834e service nova] Lock "86142721-b9dd-44ab-b994-f81443b5383c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-544f7d15-d41f-46d4-b113-7fd97cfc4e76 req-3ca8658d-0817-4f6e-9f64-7ae0400f834e service nova] Lock "86142721-b9dd-44ab-b994-f81443b5383c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-544f7d15-d41f-46d4-b113-7fd97cfc4e76 req-3ca8658d-0817-4f6e-9f64-7ae0400f834e service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] No waiting events found dispatching network-vif-plugged-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:25 user nova-compute[75246]: WARNING nova.compute.manager [req-544f7d15-d41f-46d4-b113-7fd97cfc4e76 req-3ca8658d-0817-4f6e-9f64-7ae0400f834e service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received unexpected event network-vif-plugged-2438ce69-6032-4ced-abea-84518ff89dfb for instance with vm_state active and task_state rebuilding.
Nov 28 17:05:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74e197d1-70f3-448c-afd7-e0ad6933fe32) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:05:25 user nova-compute[75246]: INFO os_vif [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:31:e2,bridge_name='br-int',has_traffic_filtering=True,id=2438ce69-6032-4ced-abea-84518ff89dfb,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2438ce69-60')
Nov 28 17:05:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjrXBYVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:05:25 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 17:05:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe26ab0-edf4-4e56-9dd1-5c2cb1cb2d44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:05:25 user nova-compute[75246]: No targets found.
Nov 28 17:05:25 user nova-compute[75246]: iSNS:
Nov 28 17:05:25 user nova-compute[75246]: No targets found.
Nov 28 17:05:25 user nova-compute[75246]: STATIC:
Nov 28 17:05:25 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4
Nov 28 17:05:25 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:05:25 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:05:25 user nova-compute[75246]: FIRMWARE:
Nov 28 17:05:25 user nova-compute[75246]: No targets found.
Nov 28 17:05:25 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:05:25 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:05:25 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd971fb-e062-4a2a-87a6-b90094c94c80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c8aee7-7b8b-4e4d-94e6-faf86bd966cd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:05:25 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:05:25 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d8159750>, {}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Disconnecting from: [] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] <== disconnect_volume: return (72ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:05:25 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Deleting instance files /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c_del
Nov 28 17:05:25 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Deletion of /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c_del complete
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:05:25 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000000f, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:25 user nova-compute[75246]: INFO nova.virt.block_device [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Booting with volume 80ff9554-4dcc-4603-8d71-cf41cf34fc2f at /dev/vdb
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG os_brick.utils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9167dd-74f8-413e-aa4d-c47554122476]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1187f1a4-9714-4ee6-bbaf-96a22586b4e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dad677-61ce-41f6-a7e5-eabfa56597f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[62583677-a70a-4579-b3cb-6aff334a07bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:05:26 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:05:26 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da9a4e0-0e01-4a14-aee3-ee35ec7335ea]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG os_brick.utils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Updating existing volume attachment record: 262a8cb9-d8d1-4898-841d-ebdf21a25807 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Port 3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 binding to destination host user is already ACTIVE {{(pid=75246) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquired lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:27 user nova-compute[75246]: DEBUG nova.network.neutron [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Updating instance_info_cache with network_info: [{"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:05:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Releasing lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:05:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Creating tmpfile /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/tmpt_v3bevp to verify with other compute node that the instance is on the same shared storage. {{(pid=75246) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 28 17:05:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.compute.manager [req-413c5f49-6e77-4407-a176-fb2dbf751f90 req-1eb7a648-7c1e-4e79-8347-450528821225 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received event network-vif-unplugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-413c5f49-6e77-4407-a176-fb2dbf751f90 req-1eb7a648-7c1e-4e79-8347-450528821225 service nova] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-413c5f49-6e77-4407-a176-fb2dbf751f90 req-1eb7a648-7c1e-4e79-8347-450528821225 service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-413c5f49-6e77-4407-a176-fb2dbf751f90 req-1eb7a648-7c1e-4e79-8347-450528821225 service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.compute.manager [req-413c5f49-6e77-4407-a176-fb2dbf751f90 req-1eb7a648-7c1e-4e79-8347-450528821225 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] No waiting events found dispatching network-vif-unplugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:28 user nova-compute[75246]: WARNING nova.compute.manager [req-413c5f49-6e77-4407-a176-fb2dbf751f90 req-1eb7a648-7c1e-4e79-8347-450528821225 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received unexpected event network-vif-unplugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 for instance with vm_state resized and task_state resize_reverting.
Nov 28 17:05:28 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:05:28 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=7466MB free_disk=25.506919860839844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:28 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Instance destroyed successfully.
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.objects.instance [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lazy-loading 'resources' on Instance uuid 4b650a57-5870-4f77-bca2-abe50d970b40 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-511980533',display_name='tempest-ServerActionsTestOtherB-server-511980533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-511980533',id=3,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeYN/HSLFqD4XGGEXJ9b8W5tTZ1Q+j1Wl9INcd9I7zBrxI2z/wVXkIvtrK7OKu4ZT8jqxkECEhWOY/LUm6Wr8yFYH+XfgjPLkBJ3Cg5yb8oaGQFI8Npp1mQPS7budj7Eg==',key_name='tempest-keypair-789293158',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:03:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3098a0e0fd3640d6b0c61303e10b9269',ramdisk_id='',reservation_id='r-ibzp3hny',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-779885367',owner_user_name='tempest-ServerActionsTestOtherB-779885367-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec11d8eaa57441e4b1178c39dfccd51f',uuid=4b650a57-5870-4f77-bca2-abe50d970b40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Converting VIF {"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_vif [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b26f892-a2, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6308e1b3-db2d-49d6-b3c1-ebbc8cb077cb) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:05:28 user nova-compute[75246]: INFO os_vif [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2')
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjtFMPWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:05:28 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db0cb0f-a19a-4c05-974f-d47bfb6bb7c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:05:28 user nova-compute[75246]: No targets found.
Nov 28 17:05:28 user nova-compute[75246]: iSNS:
Nov 28 17:05:28 user nova-compute[75246]: No targets found.
Nov 28 17:05:28 user nova-compute[75246]: STATIC:
Nov 28 17:05:28 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4
Nov 28 17:05:28 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:05:28 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:05:28 user nova-compute[75246]: FIRMWARE:
Nov 28 17:05:28 user nova-compute[75246]: No targets found.
Nov 28 17:05:28 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:05:28 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:05:28 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Applying migration context for instance 4b650a57-5870-4f77-bca2-abe50d970b40 as it has an incoming, in-progress migration 80be8226-a637-4d78-b2c5-26341b30b340. Migration status is reverting {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 17:05:28 user nova-compute[75246]: INFO nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Updating resource usage from migration 80be8226-a637-4d78-b2c5-26341b30b340
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb21865-3c06-48b3-b916-4af17c935d0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e383bfa-affe-4b38-a103-805c47818aed]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:05:28 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:05:28 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d81995a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4'): ({'sdb'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Removing single pathed devices sdb {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[89113d70-2c70-4ada-ba9b-694322a38aa2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd95e64-9d4e-4951-9687-6cbed7693321]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Flushing IO for device /dev/sdb {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ccee48-540d-472d-b1f1-5b38127e3918]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6a3caa-1edd-40bc-bedb-d574c006d0a0]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1246ae5e-35cc-48fc-ada4-562cb0f96ff5]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 25480185-8c9c-4aad-9c46-573cfbf65364 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e1266470-c182-4c0c-a575-4c5043f54745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 915bc61e-eaea-40c0-a5ed-4d2a677477f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 86142721-b9dd-44ab-b994-f81443b5383c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Migration 80be8226-a637-4d78-b2c5-26341b30b340 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 4b650a57-5870-4f77-bca2-abe50d970b40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c94900af-f484-47bf-8627-8aa863334b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 6579e6f5-93be-4b39-9c61-ca3dbc40b79f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 0d952de1-8c78-4bea-853d-21ac4f979845 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c21e74f-f7b7-4c87-96a7-972e308c06cd]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260]
Nov 28 17:05:28 user nova-compute[75246]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260] successful.
Nov 28 17:05:28 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c5cf88-828f-4051-b144-041824688dcd]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] <== disconnect_volume: return (341ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 69f05219-5034-4e88-879c-9c567e2c2fcd has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:05:28 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:05:29 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing inventories for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 17:05:29 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating ProviderTree inventory for provider 241ad926-9deb-44ba-a618-a49e4ac21089 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 17:05:29 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating inventory in ProviderTree for provider 241ad926-9deb-44ba-a618-a49e4ac21089 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 17:05:29 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing aggregate associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, aggregates: None {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 17:05:29 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing trait associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 17:05:29 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:05:29 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:05:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:05:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.011s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:29 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG nova.objects.instance [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lazy-loading 'migration_context' on Instance uuid 4b650a57-5870-4f77-bca2-abe50d970b40 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG nova.objects.base [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Object Instance<4b650a57-5870-4f77-bca2-abe50d970b40> lazy-loaded attributes: resources,migration_context {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-c0dfd746-33b8-4a23-b71f-e8a1c0eadc2e req-9b9f2be8-cadf-4e4b-af6d-0ff657d9b7bc service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received event network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c0dfd746-33b8-4a23-b71f-e8a1c0eadc2e req-9b9f2be8-cadf-4e4b-af6d-0ff657d9b7bc service nova] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c0dfd746-33b8-4a23-b71f-e8a1c0eadc2e req-9b9f2be8-cadf-4e4b-af6d-0ff657d9b7bc service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c0dfd746-33b8-4a23-b71f-e8a1c0eadc2e req-9b9f2be8-cadf-4e4b-af6d-0ff657d9b7bc service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-c0dfd746-33b8-4a23-b71f-e8a1c0eadc2e req-9b9f2be8-cadf-4e4b-af6d-0ff657d9b7bc service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] No waiting events found dispatching network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:30 user nova-compute[75246]: WARNING nova.compute.manager [req-c0dfd746-33b8-4a23-b71f-e8a1c0eadc2e req-9b9f2be8-cadf-4e4b-af6d-0ff657d9b7bc service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received unexpected event network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 for instance with vm_state resized and task_state resize_reverting.
Nov 28 17:05:30 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:05:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.614s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:30 user nova-compute[75246]: INFO nova.compute.manager [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Swapping old allocation on dict_keys(['241ad926-9deb-44ba-a618-a49e4ac21089']) held by migration 80be8226-a637-4d78-b2c5-26341b30b340 for instance
Nov 28 17:05:30 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Overwriting current allocation {'allocations': {'241ad926-9deb-44ba-a618-a49e4ac21089': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 24}}, 'project_id': '3098a0e0fd3640d6b0c61303e10b9269', 'user_id': 'ec11d8eaa57441e4b1178c39dfccd51f', 'consumer_generation': 1} on consumer 4b650a57-5870-4f77-bca2-abe50d970b40 {{(pid=75246) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 28 17:05:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:05:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquired lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:05:31 user nova-compute[75246]: DEBUG nova.network.neutron [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG nova.objects.instance [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lazy-loading 'pci_requests' on Instance uuid 69f05219-5034-4e88-879c-9c567e2c2fcd {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG nova.objects.instance [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lazy-loading 'numa_topology' on Instance uuid 69f05219-5034-4e88-879c-9c567e2c2fcd {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:05:32 user nova-compute[75246]: INFO nova.compute.claims [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Claim successful on node user
Nov 28 17:05:32 user nova-compute[75246]: DEBUG nova.network.neutron [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Updating instance_info_cache with network_info: [{"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Releasing lock "refresh_cache-4b650a57-5870-4f77-bca2-abe50d970b40" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG os_brick.utils [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b867e6-a634-4449-819f-ea095f439325]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[26284497-43c1-4f57-8ae9-0aef988dfd33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3345595a-378e-4706-b760-ebd423f01f8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d217975e-89ea-4a56-994f-2b91a87ca9c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:05:32 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:05:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f11f9da-6fa2-4272-a4b3-1bd80a8b23cc]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:05:32 user nova-compute[75246]: DEBUG os_brick.utils [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:05:33 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:05:33 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:05:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:33 user nova-compute[75246]: INFO nova.network.neutron [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Updating port 068da4fa-d42e-47e8-8e7e-81bda7521356 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 17:05:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquired lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.network.neutron [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-4c7d3811-a678-40bc-9bde-aa5f75adadb6 req-9533049c-1744-4df0-b21d-79b425f67740 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-changed-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-4c7d3811-a678-40bc-9bde-aa5f75adadb6 req-9533049c-1744-4df0-b21d-79b425f67740 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Refreshing instance network info cache due to event network-changed-068da4fa-d42e-47e8-8e7e-81bda7521356. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4c7d3811-a678-40bc-9bde-aa5f75adadb6 req-9533049c-1744-4df0-b21d-79b425f67740 service nova] Acquiring lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.network.neutron [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Updating instance_info_cache with network_info: [{"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Releasing lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:05:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Creating image(s)
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Did not create local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Ensure instance console log exists: /opt/stack/data/nova/instances/69f05219-5034-4e88-879c-9c567e2c2fcd/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Start _get_guest_xml network_info=[{"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'dbcc77a2-fc9d-4fae-85fc-3ce9174b7033', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJLxnbkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '69f05219-5034-4e88-879c-9c567e2c2fcd', 'attached_at': '', 'detached_at': '', 'volume_id': '73cc7ca3-6f29-46f6-9e6a-d6d526dc6353', 'serial': '73cc7ca3-6f29-46f6-9e6a-d6d526dc6353'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4c7d3811-a678-40bc-9bde-aa5f75adadb6 req-9533049c-1744-4df0-b21d-79b425f67740 service nova] Acquired lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.network.neutron [req-4c7d3811-a678-40bc-9bde-aa5f75adadb6 req-9533049c-1744-4df0-b21d-79b425f67740 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Refreshing network info cache for port 068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:05:34 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:05:34 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.objects.instance [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lazy-loading 'vcpu_model' on Instance uuid 69f05219-5034-4e88-879c-9c567e2c2fcd {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.objects.base [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Object Instance<69f05219-5034-4e88-879c-9c567e2c2fcd> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJLxnbkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:05:34 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:05:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:05:34 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:05:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:05:34 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[95df4fee-bb50-44fa-b452-a7f12f17b1a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:05:34 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8e8cc4-7b98-4526-89f3-1dbfc1d15a46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353] added
Nov 28 17:05:34 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f26acf-138c-42a2-b531-d68711add620]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69f3b62-d847-4f48-9a35-008bd17be81c]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJLxnbkd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJLxnbkd" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88fcc17-9125-4765-b8e2-e17489e6a124]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gJLxnbkd'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4a1764-b177-40d4-989f-82e7324f70de]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c896f6f-e3ec-4e52-981a-f4b1ce565251]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 17:05:34 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:05:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 17:05:34 user nova-compute[75246]:  {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:05:34 user nova-compute[75246]: WARNING os_brick.initiator.connectors.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 17:05:34 user nova-compute[75246]: 
Nov 28 17:05:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[52790666-f562-40f9-9f07-182a10dd60a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353, portal: 172.16.0.220,3260]
Nov 28 17:05:35 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353, portal: 172.16.0.220,3260] successful.
Nov 28 17:05:35 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a23aa98-d6c9-45a3-8f67-070b990c8a48]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dc4876-e15f-4bb6-bb0b-aa8ccbb6151a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:05:35 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:05:35 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78a3e4c-292f-4790-a0bf-9f0e2aa18b58]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJLxnbkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG nova.network.neutron [req-4c7d3811-a678-40bc-9bde-aa5f75adadb6 req-9533049c-1744-4df0-b21d-79b425f67740 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Updated VIF entry in instance network info cache for port 068da4fa-d42e-47e8-8e7e-81bda7521356. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG nova.network.neutron [req-4c7d3811-a678-40bc-9bde-aa5f75adadb6 req-9533049c-1744-4df0-b21d-79b425f67740 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Updating instance_info_cache with network_info: [{"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4c7d3811-a678-40bc-9bde-aa5f75adadb6 req-9533049c-1744-4df0-b21d-79b425f67740 service nova] Releasing lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:05:35 user nova-compute[75246]: INFO nova.compute.manager [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Rescuing
Nov 28 17:05:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "refresh_cache-c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquired lock "refresh_cache-c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG nova.network.neutron [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG nova.network.neutron [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Updating instance_info_cache with network_info: [{"id": "0a3da48f-457a-450f-8102-d758c18d2554", "address": "fa:16:3e:a5:be:9f", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a3da48f-45", "ovs_interfaceid": "0a3da48f-457a-450f-8102-d758c18d2554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:05:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Releasing lock "refresh_cache-c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23663623233316632', 'path': '/dev/sdb'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663623233316632', 'path': '/dev/sdb'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T17:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-261959295',display_name='tempest-TestShelveInstance-server-261959295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-261959295',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1911568956',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:01:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='572ea174564b4afdbf607e501e025fd8',ramdisk_id='',reservation_id='r-hodplmom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-640383248',owner_user_name='tempest-TestShelveInstance-640383248-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:05:24Z,user_data=None,user_id='58d26618e4064fedb1bd65d14920652d',uuid=69f05219-5034-4e88-879c-9c567e2c2fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Converting VIF {"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e6:81,bridge_name='br-int',has_traffic_filtering=True,id=068da4fa-d42e-47e8-8e7e-81bda7521356,network=Network(5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068da4fa-d4') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG nova.objects.instance [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lazy-loading 'pci_devices' on Instance uuid 69f05219-5034-4e88-879c-9c567e2c2fcd {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG nova.objects.base [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Object Instance<69f05219-5034-4e88-879c-9c567e2c2fcd> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:05:36 user nova-compute[75246]:   <uuid>69f05219-5034-4e88-879c-9c567e2c2fcd</uuid>
Nov 28 17:05:36 user nova-compute[75246]:   <name>instance-0000000d</name>
Nov 28 17:05:36 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:05:36 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:05:36 user nova-compute[75246]:   <metadata>
Nov 28 17:05:36 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:05:36 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:05:36 user nova-compute[75246]:       <nova:name>tempest-TestShelveInstance-server-261959295</nova:name>
Nov 28 17:05:36 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:05:34</nova:creationTime>
Nov 28 17:05:36 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:05:36 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:05:36 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:05:36 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:05:36 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:05:36 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:05:36 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:05:36 user nova-compute[75246]:       <nova:owner>
Nov 28 17:05:36 user nova-compute[75246]:         <nova:user uuid="58d26618e4064fedb1bd65d14920652d">tempest-TestShelveInstance-640383248-project-member</nova:user>
Nov 28 17:05:36 user nova-compute[75246]:         <nova:project uuid="572ea174564b4afdbf607e501e025fd8">tempest-TestShelveInstance-640383248</nova:project>
Nov 28 17:05:36 user nova-compute[75246]:       </nova:owner>
Nov 28 17:05:36 user nova-compute[75246]:       <nova:ports>
Nov 28 17:05:36 user nova-compute[75246]:         <nova:port uuid="068da4fa-d42e-47e8-8e7e-81bda7521356">
Nov 28 17:05:36 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 17:05:36 user nova-compute[75246]:         </nova:port>
Nov 28 17:05:36 user nova-compute[75246]:       </nova:ports>
Nov 28 17:05:36 user nova-compute[75246]:     </nova:instance>
Nov 28 17:05:36 user nova-compute[75246]:   </metadata>
Nov 28 17:05:36 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:05:36 user nova-compute[75246]:     <system>
Nov 28 17:05:36 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:05:36 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:05:36 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:05:36 user nova-compute[75246]:       <entry name="serial">69f05219-5034-4e88-879c-9c567e2c2fcd</entry>
Nov 28 17:05:36 user nova-compute[75246]:       <entry name="uuid">69f05219-5034-4e88-879c-9c567e2c2fcd</entry>
Nov 28 17:05:36 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:05:36 user nova-compute[75246]:     </system>
Nov 28 17:05:36 user nova-compute[75246]:   </sysinfo>
Nov 28 17:05:36 user nova-compute[75246]:   <os>
Nov 28 17:05:36 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:05:36 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:05:36 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:05:36 user nova-compute[75246]:   </os>
Nov 28 17:05:36 user nova-compute[75246]:   <features>
Nov 28 17:05:36 user nova-compute[75246]:     <acpi/>
Nov 28 17:05:36 user nova-compute[75246]:     <apic/>
Nov 28 17:05:36 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:05:36 user nova-compute[75246]:   </features>
Nov 28 17:05:36 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:05:36 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:05:36 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:05:36 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:05:36 user nova-compute[75246]:   </clock>
Nov 28 17:05:36 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:05:36 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:05:36 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:05:36 user nova-compute[75246]:   </cpu>
Nov 28 17:05:36 user nova-compute[75246]:   <devices>
Nov 28 17:05:36 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:05:36 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:05:36 user nova-compute[75246]:       <source dev="/dev/sdb"/>
Nov 28 17:05:36 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:05:36 user nova-compute[75246]:       <serial>73cc7ca3-6f29-46f6-9e6a-d6d526dc6353</serial>
Nov 28 17:05:36 user nova-compute[75246]:     </disk>
Nov 28 17:05:36 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:05:36 user nova-compute[75246]:       <mac address="fa:16:3e:bc:e6:81"/>
Nov 28 17:05:36 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:05:36 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:05:36 user nova-compute[75246]:       <target dev="tap068da4fa-d4"/>
Nov 28 17:05:36 user nova-compute[75246]:     </interface>
Nov 28 17:05:36 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:05:36 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/69f05219-5034-4e88-879c-9c567e2c2fcd/console.log" append="off"/>
Nov 28 17:05:36 user nova-compute[75246]:     </serial>
Nov 28 17:05:36 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:05:36 user nova-compute[75246]:     <video>
Nov 28 17:05:36 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:05:36 user nova-compute[75246]:     </video>
Nov 28 17:05:36 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:05:36 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:05:36 user nova-compute[75246]:     </rng>
Nov 28 17:05:36 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:05:36 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:05:36 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:05:36 user nova-compute[75246]:     </memballoon>
Nov 28 17:05:36 user nova-compute[75246]:   </devices>
Nov 28 17:05:36 user nova-compute[75246]: </domain>
Nov 28 17:05:36 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T17:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-261959295',display_name='tempest-TestShelveInstance-server-261959295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-261959295',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1911568956',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:01:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='572ea174564b4afdbf607e501e025fd8',ramdisk_id='',reservation_id='r-hodplmom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-640383248',owner_user_name='tempest-TestShelveInstance-640383248-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:05:24Z,user_data=None,user_id='58d26618e4064fedb1bd65d14920652d',uuid=69f05219-5034-4e88-879c-9c567e2c2fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Converting VIF {"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e6:81,bridge_name='br-int',has_traffic_filtering=True,id=068da4fa-d42e-47e8-8e7e-81bda7521356,network=Network(5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068da4fa-d4') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG os_vif [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e6:81,bridge_name='br-int',has_traffic_filtering=True,id=068da4fa-d42e-47e8-8e7e-81bda7521356,network=Network(5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068da4fa-d4') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b916b78-caa8-56a2-82cf-aa0777fb48ac', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap068da4fa-d4, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap068da4fa-d4, col_values=(('qos', UUID('3d07b903-7e89-4787-b8ad-bf9cc7e6f2d5')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap068da4fa-d4, col_values=(('external_ids', {'iface-id': '068da4fa-d42e-47e8-8e7e-81bda7521356', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:e6:81', 'vm-uuid': '69f05219-5034-4e88-879c-9c567e2c2fcd'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:36 user nova-compute[75246]: INFO os_vif [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e6:81,bridge_name='br-int',has_traffic_filtering=True,id=068da4fa-d42e-47e8-8e7e-81bda7521356,network=Network(5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068da4fa-d4')
Nov 28 17:05:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] No VIF found with MAC fa:16:3e:bc:e6:81, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-f7be24b6-cbec-42a4-acfd-21a2b20eccd6 req-67042f8c-a52b-4e82-a08a-3985742ccfdc service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Received event network-vif-unplugged-0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f7be24b6-cbec-42a4-acfd-21a2b20eccd6 req-67042f8c-a52b-4e82-a08a-3985742ccfdc service nova] Acquiring lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f7be24b6-cbec-42a4-acfd-21a2b20eccd6 req-67042f8c-a52b-4e82-a08a-3985742ccfdc service nova] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f7be24b6-cbec-42a4-acfd-21a2b20eccd6 req-67042f8c-a52b-4e82-a08a-3985742ccfdc service nova] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-f7be24b6-cbec-42a4-acfd-21a2b20eccd6 req-67042f8c-a52b-4e82-a08a-3985742ccfdc service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] No waiting events found dispatching network-vif-unplugged-0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:36 user nova-compute[75246]: WARNING nova.compute.manager [req-f7be24b6-cbec-42a4-acfd-21a2b20eccd6 req-67042f8c-a52b-4e82-a08a-3985742ccfdc service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Received unexpected event network-vif-unplugged-0a3da48f-457a-450f-8102-d758c18d2554 for instance with vm_state active and task_state rescuing.
Nov 28 17:05:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:37 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Instance destroyed successfully.
Nov 28 17:05:37 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Attempting rescue
Nov 28 17:05:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75246) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Instance directory exists: not creating {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 17:05:37 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Creating image(s)
Nov 28 17:05:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "/opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "/opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG nova.objects.instance [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'trusted_certs' on Instance uuid c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.215s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue" returned: 0 in 0.054s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG nova.objects.instance [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'migration_context' on Instance uuid c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG nova.objects.base [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Object Instance<c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Start _get_guest_xml network_info=[{"id": "0a3da48f-457a-450f-8102-d758c18d2554", "address": "fa:16:3e:a5:be:9f", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "vif_mac": "fa:16:3e:a5:be:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a3da48f-45", "ovs_interfaceid": "0a3da48f-457a-450f-8102-d758c18d2554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG nova.objects.instance [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'resources' on Instance uuid c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG nova.objects.base [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Object Instance<c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:05:37 user nova-compute[75246]: DEBUG nova.objects.instance [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'numa_topology' on Instance uuid c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:05:38 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Creating image(s)
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "/opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "/opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "/opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.objects.base [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Object Instance<c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:38 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:05:38 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.objects.instance [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'vcpu_model' on Instance uuid c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.objects.base [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Object Instance<c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:03:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-917092269',display_name='tempest-ServerRescueNegativeTestJSON-server-917092269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-917092269',id=17,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:03:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60768e53b1e3414cb05eaaf23d382493',ramdisk_id='',reservation_id='r-s8iqr3jc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-220335783',owner_user_name='tempest-ServerRescueNegativeTestJSON-220335783-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:03:54Z,user_data=None,user_id='b79c4440e4734a2f82b08de54ed61737',uuid=c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a3da48f-457a-450f-8102-d758c18d2554", "address": "fa:16:3e:a5:be:9f", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "vif_mac": "fa:16:3e:a5:be:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a3da48f-45", "ovs_interfaceid": "0a3da48f-457a-450f-8102-d758c18d2554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converting VIF {"id": "0a3da48f-457a-450f-8102-d758c18d2554", "address": "fa:16:3e:a5:be:9f", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "vif_mac": "fa:16:3e:a5:be:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a3da48f-45", "ovs_interfaceid": "0a3da48f-457a-450f-8102-d758c18d2554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:be:9f,bridge_name='br-int',has_traffic_filtering=True,id=0a3da48f-457a-450f-8102-d758c18d2554,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a3da48f-45') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.objects.instance [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'pci_devices' on Instance uuid c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-4dd662cf-450b-4460-b0ca-2407a271dd1f req-0cd92bf2-1bd8-4e2d-87f6-4cb89e966907 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4dd662cf-450b-4460-b0ca-2407a271dd1f req-0cd92bf2-1bd8-4e2d-87f6-4cb89e966907 service nova] Acquiring lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4dd662cf-450b-4460-b0ca-2407a271dd1f req-0cd92bf2-1bd8-4e2d-87f6-4cb89e966907 service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4dd662cf-450b-4460-b0ca-2407a271dd1f req-0cd92bf2-1bd8-4e2d-87f6-4cb89e966907 service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-4dd662cf-450b-4460-b0ca-2407a271dd1f req-0cd92bf2-1bd8-4e2d-87f6-4cb89e966907 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] No waiting events found dispatching network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:38 user nova-compute[75246]: WARNING nova.compute.manager [req-4dd662cf-450b-4460-b0ca-2407a271dd1f req-0cd92bf2-1bd8-4e2d-87f6-4cb89e966907 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received unexpected event network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.objects.base [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Object Instance<c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:05:38 user nova-compute[75246]:   <uuid>c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5</uuid>
Nov 28 17:05:38 user nova-compute[75246]:   <name>instance-00000011</name>
Nov 28 17:05:38 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:05:38 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:05:38 user nova-compute[75246]:   <metadata>
Nov 28 17:05:38 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:05:38 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:05:38 user nova-compute[75246]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-917092269</nova:name>
Nov 28 17:05:38 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:05:38</nova:creationTime>
Nov 28 17:05:38 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:05:38 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:05:38 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:05:38 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:05:38 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:05:38 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:05:38 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:05:38 user nova-compute[75246]:       <nova:owner>
Nov 28 17:05:38 user nova-compute[75246]:         <nova:user uuid="b79c4440e4734a2f82b08de54ed61737">tempest-ServerRescueNegativeTestJSON-220335783-project-member</nova:user>
Nov 28 17:05:38 user nova-compute[75246]:         <nova:project uuid="60768e53b1e3414cb05eaaf23d382493">tempest-ServerRescueNegativeTestJSON-220335783</nova:project>
Nov 28 17:05:38 user nova-compute[75246]:       </nova:owner>
Nov 28 17:05:38 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:05:38 user nova-compute[75246]:       <nova:ports>
Nov 28 17:05:38 user nova-compute[75246]:         <nova:port uuid="0a3da48f-457a-450f-8102-d758c18d2554">
Nov 28 17:05:38 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 17:05:38 user nova-compute[75246]:         </nova:port>
Nov 28 17:05:38 user nova-compute[75246]:       </nova:ports>
Nov 28 17:05:38 user nova-compute[75246]:     </nova:instance>
Nov 28 17:05:38 user nova-compute[75246]:   </metadata>
Nov 28 17:05:38 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:05:38 user nova-compute[75246]:     <system>
Nov 28 17:05:38 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:05:38 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:05:38 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:05:38 user nova-compute[75246]:       <entry name="serial">c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5</entry>
Nov 28 17:05:38 user nova-compute[75246]:       <entry name="uuid">c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5</entry>
Nov 28 17:05:38 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:05:38 user nova-compute[75246]:     </system>
Nov 28 17:05:38 user nova-compute[75246]:   </sysinfo>
Nov 28 17:05:38 user nova-compute[75246]:   <os>
Nov 28 17:05:38 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:05:38 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:05:38 user nova-compute[75246]:   </os>
Nov 28 17:05:38 user nova-compute[75246]:   <features>
Nov 28 17:05:38 user nova-compute[75246]:     <acpi/>
Nov 28 17:05:38 user nova-compute[75246]:     <apic/>
Nov 28 17:05:38 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:05:38 user nova-compute[75246]:   </features>
Nov 28 17:05:38 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:05:38 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:05:38 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:05:38 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:05:38 user nova-compute[75246]:   </clock>
Nov 28 17:05:38 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:05:38 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:05:38 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:05:38 user nova-compute[75246]:   </cpu>
Nov 28 17:05:38 user nova-compute[75246]:   <devices>
Nov 28 17:05:38 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:05:38 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:05:38 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue"/>
Nov 28 17:05:38 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:05:38 user nova-compute[75246]:     </disk>
Nov 28 17:05:38 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:05:38 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:05:38 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk"/>
Nov 28 17:05:38 user nova-compute[75246]:       <target dev="vdb" bus="virtio"/>
Nov 28 17:05:38 user nova-compute[75246]:     </disk>
Nov 28 17:05:38 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:05:38 user nova-compute[75246]:       <mac address="fa:16:3e:a5:be:9f"/>
Nov 28 17:05:38 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:05:38 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:05:38 user nova-compute[75246]:       <target dev="tap0a3da48f-45"/>
Nov 28 17:05:38 user nova-compute[75246]:     </interface>
Nov 28 17:05:38 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:05:38 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/console.log" append="off"/>
Nov 28 17:05:38 user nova-compute[75246]:     </serial>
Nov 28 17:05:38 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:05:38 user nova-compute[75246]:     <video>
Nov 28 17:05:38 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:05:38 user nova-compute[75246]:     </video>
Nov 28 17:05:38 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:05:38 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:05:38 user nova-compute[75246]:     </rng>
Nov 28 17:05:38 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:05:38 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:05:38 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:05:38 user nova-compute[75246]:     </memballoon>
Nov 28 17:05:38 user nova-compute[75246]:   </devices>
Nov 28 17:05:38 user nova-compute[75246]: </domain>
Nov 28 17:05:38 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:05:38 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Instance destroyed successfully.
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.285s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] No VIF found with MAC fa:16:3e:a5:be:9f, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.206s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk 1073741824" returned: 0 in 0.056s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-34b77633-c354-4838-8591-b8792a30982d req-2eaf323f-288a-46e7-8ad5-a07d7ea0015b service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Received event network-vif-plugged-0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-34b77633-c354-4838-8591-b8792a30982d req-2eaf323f-288a-46e7-8ad5-a07d7ea0015b service nova] Acquiring lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-34b77633-c354-4838-8591-b8792a30982d req-2eaf323f-288a-46e7-8ad5-a07d7ea0015b service nova] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-34b77633-c354-4838-8591-b8792a30982d req-2eaf323f-288a-46e7-8ad5-a07d7ea0015b service nova] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-34b77633-c354-4838-8591-b8792a30982d req-2eaf323f-288a-46e7-8ad5-a07d7ea0015b service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] No waiting events found dispatching network-vif-plugged-0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:38 user nova-compute[75246]: WARNING nova.compute.manager [req-34b77633-c354-4838-8591-b8792a30982d req-2eaf323f-288a-46e7-8ad5-a07d7ea0015b service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Received unexpected event network-vif-plugged-0a3da48f-457a-450f-8102-d758c18d2554 for instance with vm_state active and task_state rescuing.
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Cannot resize image /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Ensure instance console log exists: /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Start _get_guest_xml network_info=[{"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '262a8cb9-d8d1-4898-841d-ebdf21a25807', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjrXBYVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '86142721-b9dd-44ab-b994-f81443b5383c', 'attached_at': '', 'detached_at': '', 'volume_id': '80ff9554-4dcc-4603-8d71-cf41cf34fc2f', 'serial': '80ff9554-4dcc-4603-8d71-cf41cf34fc2f'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:05:39 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 17:05:39 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.objects.instance [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lazy-loading 'vcpu_model' on Instance uuid 86142721-b9dd-44ab-b994-f81443b5383c {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjrXBYVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:05:39 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:05:39 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:05:39 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c99d89d-75e4-4dd8-8550-9605b32fbc97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:05:39 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc978ca5-8011-4550-a3ed-95c2d536a086]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f] added
Nov 28 17:05:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff2fb7a-f330-4518-9630-616e3a81ca45]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[056ed31d-6c7d-4042-aff1-429b44b897ed]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjrXBYVb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjrXBYVb" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1d3e35-d2c8-4bcc-843d-e80342dd1598]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wjrXBYVb'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb3544a-1b5d-47a7-8f79-84fe46dff5d0]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[577c4454-888c-4f65-97b9-65eed5c0deea]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:05:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:05:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6eadd0b-8239-464f-850b-df2cf060ef0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f, portal: 172.16.0.220,3260]
Nov 28 17:05:39 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f, portal: 172.16.0.220,3260] successful.
Nov 28 17:05:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2509db5-7290-40b1-ab6f-9cd3dc947c2b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[00131b5c-9c47-479d-b653-66e5ae8d8d85]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:05:39 user nova-compute[75246]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:05:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:05:39 user nova-compute[75246]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:05:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaec5ec7-f470-496b-8f18-23c8bc28ddfe]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:05:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjrXBYVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-0aa013d3-50fd-4b13-b6b0-1a4ca2a3087e req-2a17ce12-ce3d-4978-9dfe-bc3bbbddb6db service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0aa013d3-50fd-4b13-b6b0-1a4ca2a3087e req-2a17ce12-ce3d-4978-9dfe-bc3bbbddb6db service nova] Acquiring lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0aa013d3-50fd-4b13-b6b0-1a4ca2a3087e req-2a17ce12-ce3d-4978-9dfe-bc3bbbddb6db service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0aa013d3-50fd-4b13-b6b0-1a4ca2a3087e req-2a17ce12-ce3d-4978-9dfe-bc3bbbddb6db service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-0aa013d3-50fd-4b13-b6b0-1a4ca2a3087e req-2a17ce12-ce3d-4978-9dfe-bc3bbbddb6db service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] No waiting events found dispatching network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:40 user nova-compute[75246]: WARNING nova.compute.manager [req-0aa013d3-50fd-4b13-b6b0-1a4ca2a3087e req-2a17ce12-ce3d-4978-9dfe-bc3bbbddb6db service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received unexpected event network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23361626265393765', 'path': '/dev/sdc'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361626265393765', 'path': '/dev/sdc'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.compute.manager [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:05:40 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Instance spawned successfully.
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.compute.manager [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T17:03:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-982853153',display_name='tempest-ServerActionsTestOtherA-server-1558896318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-982853153',id=15,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsIJC+q4Y4+55AC0y9HnA2vvt/v6RCSMYzioCDQ5Wqsi/6fMiuZzeuzQCkQ89dqnBC2m8g7FsGK4x+WMLFrWYG5HbTNoob2Sth9T+5kRFE/RvVS0LYqJNwESjTmUvS1xg==',key_name='tempest-keypair-2146767292',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:03:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='be06eee4e74a41b799f1df75ea55b955',ramdisk_id='',reservation_id='r-j7yi3b0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1554281978',owner_user_name='tempest-ServerActionsTestOtherA-1554281978-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:05:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39d2eb0837eb4c729fe9ca2964cbe789',uuid=86142721-b9dd-44ab-b994-f81443b5383c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converting VIF {"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:31:e2,bridge_name='br-int',has_traffic_filtering=True,id=2438ce69-6032-4ced-abea-84518ff89dfb,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2438ce69-60') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:05:40 user nova-compute[75246]:   <uuid>86142721-b9dd-44ab-b994-f81443b5383c</uuid>
Nov 28 17:05:40 user nova-compute[75246]:   <name>instance-0000000f</name>
Nov 28 17:05:40 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:05:40 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:05:40 user nova-compute[75246]:   <metadata>
Nov 28 17:05:40 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:05:40 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:05:40 user nova-compute[75246]:       <nova:name>tempest-ServerActionsTestOtherA-server-1558896318</nova:name>
Nov 28 17:05:40 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:05:39</nova:creationTime>
Nov 28 17:05:40 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:05:40 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:05:40 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:05:40 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:05:40 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:05:40 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:05:40 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:05:40 user nova-compute[75246]:       <nova:owner>
Nov 28 17:05:40 user nova-compute[75246]:         <nova:user uuid="39d2eb0837eb4c729fe9ca2964cbe789">tempest-ServerActionsTestOtherA-1554281978-project-member</nova:user>
Nov 28 17:05:40 user nova-compute[75246]:         <nova:project uuid="be06eee4e74a41b799f1df75ea55b955">tempest-ServerActionsTestOtherA-1554281978</nova:project>
Nov 28 17:05:40 user nova-compute[75246]:       </nova:owner>
Nov 28 17:05:40 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:05:40 user nova-compute[75246]:       <nova:ports>
Nov 28 17:05:40 user nova-compute[75246]:         <nova:port uuid="2438ce69-6032-4ced-abea-84518ff89dfb">
Nov 28 17:05:40 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 17:05:40 user nova-compute[75246]:         </nova:port>
Nov 28 17:05:40 user nova-compute[75246]:       </nova:ports>
Nov 28 17:05:40 user nova-compute[75246]:     </nova:instance>
Nov 28 17:05:40 user nova-compute[75246]:   </metadata>
Nov 28 17:05:40 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:05:40 user nova-compute[75246]:     <system>
Nov 28 17:05:40 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:05:40 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:05:40 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:05:40 user nova-compute[75246]:       <entry name="serial">86142721-b9dd-44ab-b994-f81443b5383c</entry>
Nov 28 17:05:40 user nova-compute[75246]:       <entry name="uuid">86142721-b9dd-44ab-b994-f81443b5383c</entry>
Nov 28 17:05:40 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:05:40 user nova-compute[75246]:     </system>
Nov 28 17:05:40 user nova-compute[75246]:   </sysinfo>
Nov 28 17:05:40 user nova-compute[75246]:   <os>
Nov 28 17:05:40 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:05:40 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:05:40 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:05:40 user nova-compute[75246]:   </os>
Nov 28 17:05:40 user nova-compute[75246]:   <features>
Nov 28 17:05:40 user nova-compute[75246]:     <acpi/>
Nov 28 17:05:40 user nova-compute[75246]:     <apic/>
Nov 28 17:05:40 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:05:40 user nova-compute[75246]:   </features>
Nov 28 17:05:40 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:05:40 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:05:40 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:05:40 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:05:40 user nova-compute[75246]:   </clock>
Nov 28 17:05:40 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:05:40 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:05:40 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:05:40 user nova-compute[75246]:   </cpu>
Nov 28 17:05:40 user nova-compute[75246]:   <devices>
Nov 28 17:05:40 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:05:40 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:05:40 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk"/>
Nov 28 17:05:40 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:05:40 user nova-compute[75246]:     </disk>
Nov 28 17:05:40 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:05:40 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:05:40 user nova-compute[75246]:       <source dev="/dev/sdc"/>
Nov 28 17:05:40 user nova-compute[75246]:       <target dev="vdb" bus="virtio"/>
Nov 28 17:05:40 user nova-compute[75246]:       <serial>80ff9554-4dcc-4603-8d71-cf41cf34fc2f</serial>
Nov 28 17:05:40 user nova-compute[75246]:     </disk>
Nov 28 17:05:40 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:05:40 user nova-compute[75246]:       <mac address="fa:16:3e:b8:31:e2"/>
Nov 28 17:05:40 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:05:40 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:05:40 user nova-compute[75246]:       <target dev="tap2438ce69-60"/>
Nov 28 17:05:40 user nova-compute[75246]:     </interface>
Nov 28 17:05:40 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:05:40 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/console.log" append="off"/>
Nov 28 17:05:40 user nova-compute[75246]:     </serial>
Nov 28 17:05:40 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:05:40 user nova-compute[75246]:     <video>
Nov 28 17:05:40 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:05:40 user nova-compute[75246]:     </video>
Nov 28 17:05:40 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:05:40 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:05:40 user nova-compute[75246]:     </rng>
Nov 28 17:05:40 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:05:40 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:05:40 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:05:40 user nova-compute[75246]:     </memballoon>
Nov 28 17:05:40 user nova-compute[75246]:   </devices>
Nov 28 17:05:40 user nova-compute[75246]: </domain>
Nov 28 17:05:40 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T17:03:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-982853153',display_name='tempest-ServerActionsTestOtherA-server-1558896318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-982853153',id=15,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsIJC+q4Y4+55AC0y9HnA2vvt/v6RCSMYzioCDQ5Wqsi/6fMiuZzeuzQCkQ89dqnBC2m8g7FsGK4x+WMLFrWYG5HbTNoob2Sth9T+5kRFE/RvVS0LYqJNwESjTmUvS1xg==',key_name='tempest-keypair-2146767292',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:03:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='be06eee4e74a41b799f1df75ea55b955',ramdisk_id='',reservation_id='r-j7yi3b0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1554281978',owner_user_name='tempest-ServerActionsTestOtherA-1554281978-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:05:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39d2eb0837eb4c729fe9ca2964cbe789',uuid=86142721-b9dd-44ab-b994-f81443b5383c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converting VIF {"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:31:e2,bridge_name='br-int',has_traffic_filtering=True,id=2438ce69-6032-4ced-abea-84518ff89dfb,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2438ce69-60') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG os_vif [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:31:e2,bridge_name='br-int',has_traffic_filtering=True,id=2438ce69-6032-4ced-abea-84518ff89dfb,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2438ce69-60') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04822151-fcb6-5cba-b726-88e781d36cf3', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2438ce69-60, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2438ce69-60, col_values=(('qos', UUID('853a26a8-85ad-423c-8e58-656dd9ffbe63')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2438ce69-60, col_values=(('external_ids', {'iface-id': '2438ce69-6032-4ced-abea-84518ff89dfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:31:e2', 'vm-uuid': '86142721-b9dd-44ab-b994-f81443b5383c'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:40 user nova-compute[75246]: INFO os_vif [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:31:e2,bridge_name='br-int',has_traffic_filtering=True,id=2438ce69-6032-4ced-abea-84518ff89dfb,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2438ce69-60')
Nov 28 17:05:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a5ed52ac-dfe9-4083-9706-1b1524cc7b53 tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.229s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] No VIF found with MAC fa:16:3e:b8:31:e2, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-e013cd6c-7e85-48aa-90d5-953ddb9fd1dd req-15558dd9-c2ea-4965-8870-85be9b55f1f5 service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Received event network-vif-plugged-0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e013cd6c-7e85-48aa-90d5-953ddb9fd1dd req-15558dd9-c2ea-4965-8870-85be9b55f1f5 service nova] Acquiring lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e013cd6c-7e85-48aa-90d5-953ddb9fd1dd req-15558dd9-c2ea-4965-8870-85be9b55f1f5 service nova] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e013cd6c-7e85-48aa-90d5-953ddb9fd1dd req-15558dd9-c2ea-4965-8870-85be9b55f1f5 service nova] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-e013cd6c-7e85-48aa-90d5-953ddb9fd1dd req-15558dd9-c2ea-4965-8870-85be9b55f1f5 service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] No waiting events found dispatching network-vif-plugged-0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:40 user nova-compute[75246]: WARNING nova.compute.manager [req-e013cd6c-7e85-48aa-90d5-953ddb9fd1dd req-15558dd9-c2ea-4965-8870-85be9b55f1f5 service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Received unexpected event network-vif-plugged-0a3da48f-457a-450f-8102-d758c18d2554 for instance with vm_state active and task_state rescuing.
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-e013cd6c-7e85-48aa-90d5-953ddb9fd1dd req-15558dd9-c2ea-4965-8870-85be9b55f1f5 service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Received event network-vif-plugged-0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e013cd6c-7e85-48aa-90d5-953ddb9fd1dd req-15558dd9-c2ea-4965-8870-85be9b55f1f5 service nova] Acquiring lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e013cd6c-7e85-48aa-90d5-953ddb9fd1dd req-15558dd9-c2ea-4965-8870-85be9b55f1f5 service nova] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e013cd6c-7e85-48aa-90d5-953ddb9fd1dd req-15558dd9-c2ea-4965-8870-85be9b55f1f5 service nova] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-e013cd6c-7e85-48aa-90d5-953ddb9fd1dd req-15558dd9-c2ea-4965-8870-85be9b55f1f5 service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] No waiting events found dispatching network-vif-plugged-0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:40 user nova-compute[75246]: WARNING nova.compute.manager [req-e013cd6c-7e85-48aa-90d5-953ddb9fd1dd req-15558dd9-c2ea-4965-8870-85be9b55f1f5 service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Received unexpected event network-vif-plugged-0a3da48f-457a-450f-8102-d758c18d2554 for instance with vm_state active and task_state rescuing.
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Starting finish_revert_migration {{(pid=75246) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Start _get_guest_xml network_info=[{"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': 'd8aeabcd-f2fe-49f3-be8a-f7047506f0fd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjtFMPWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4b650a57-5870-4f77-bca2-abe50d970b40', 'attached_at': '2023-11-28T17:05:41.000000', 'detached_at': '', 'volume_id': '3d2f58a0-30e0-4819-aae0-07657c5f32b4', 'serial': '3d2f58a0-30e0-4819-aae0-07657c5f32b4'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:05:40 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:05:40 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:05:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG nova.objects.instance [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4b650a57-5870-4f77-bca2-abe50d970b40 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjtFMPWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:05:41 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:05:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:05:41 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:05:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:05:41 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0d5bef-14e0-49cb-b4b5-c9eeecabc462]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:05:41 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[526748d2-ff8f-4694-b253-5d0d61f6f86e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4] added
Nov 28 17:05:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[757c1585-8dd9-47d9-add9-f34ebc5d889c]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b049bdc-020e-4866-af14-b7304934fa3a]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjtFMPWJ {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjtFMPWJ" returned: 0 in 0.080s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[760e9fdb-097d-49aa-a764-f6929106c865]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AjtFMPWJ'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.089s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9f9873-fb2a-42cc-b956-73bd718a49f2]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[180c9c42-cb66-432d-979f-f5839ddeef23]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:05:41 user nova-compute[75246]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:05:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:05:41 user nova-compute[75246]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:05:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:05:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --login" returned: 0 in 1.147s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b669f75-bdb3-4e23-a657-1384ca7d9035]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260]
Nov 28 17:05:42 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260] successful.
Nov 28 17:05:42 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f79b5f-660e-4195-a674-0e3b067b1c04]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG nova.compute.manager [req-a20f5aea-7fc6-4191-80af-0ad6054204a6 req-eab0455a-86e5-458e-aaa1-8b312155571d service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received event network-vif-plugged-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a20f5aea-7fc6-4191-80af-0ad6054204a6 req-eab0455a-86e5-458e-aaa1-8b312155571d service nova] Acquiring lock "86142721-b9dd-44ab-b994-f81443b5383c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a20f5aea-7fc6-4191-80af-0ad6054204a6 req-eab0455a-86e5-458e-aaa1-8b312155571d service nova] Lock "86142721-b9dd-44ab-b994-f81443b5383c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a20f5aea-7fc6-4191-80af-0ad6054204a6 req-eab0455a-86e5-458e-aaa1-8b312155571d service nova] Lock "86142721-b9dd-44ab-b994-f81443b5383c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG nova.compute.manager [req-a20f5aea-7fc6-4191-80af-0ad6054204a6 req-eab0455a-86e5-458e-aaa1-8b312155571d service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] No waiting events found dispatching network-vif-plugged-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:42 user nova-compute[75246]: WARNING nova.compute.manager [req-a20f5aea-7fc6-4191-80af-0ad6054204a6 req-eab0455a-86e5-458e-aaa1-8b312155571d service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received unexpected event network-vif-plugged-2438ce69-6032-4ced-abea-84518ff89dfb for instance with vm_state active and task_state rebuild_spawning.
Nov 28 17:05:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1472edeb-d138-4ec1-9a10-656e5880dbff]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:05:42 user nova-compute[75246]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:05:42 user nova-compute[75246]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:05:42 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:05:42 user nova-compute[75246]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:05:42 user nova-compute[75246]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:05:42 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.569s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20c7f93-1005-41c0-89d7-dd75e78723ad]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjtFMPWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:05:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG nova.compute.manager [None req-0fa01333-94d3-46c4-8311-79fb69c670a9 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.607s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] <== connect_volume: return (2609ms) {'type': 'block', 'scsi_wwn': '23562396665333164', 'path': '/dev/sdd'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562396665333164', 'path': '/dev/sdd'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-511980533',display_name='tempest-ServerActionsTestOtherB-server-511980533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-511980533',id=3,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeYN/HSLFqD4XGGEXJ9b8W5tTZ1Q+j1Wl9INcd9I7zBrxI2z/wVXkIvtrK7OKu4ZT8jqxkECEhWOY/LUm6Wr8yFYH+XfgjPLkBJ3Cg5yb8oaGQFI8Npp1mQPS7budj7Eg==',key_name='tempest-keypair-789293158',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:03:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3098a0e0fd3640d6b0c61303e10b9269',ramdisk_id='',reservation_id='r-ibzp3hny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-779885367',owner_user_name='tempest-ServerActionsTestOtherB-779885367-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:05:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec11d8eaa57441e4b1178c39dfccd51f',uuid=4b650a57-5870-4f77-bca2-abe50d970b40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Converting VIF {"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:05:43 user nova-compute[75246]:   <uuid>4b650a57-5870-4f77-bca2-abe50d970b40</uuid>
Nov 28 17:05:43 user nova-compute[75246]:   <name>instance-00000003</name>
Nov 28 17:05:43 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:05:43 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:05:43 user nova-compute[75246]:   <metadata>
Nov 28 17:05:43 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:05:43 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:05:43 user nova-compute[75246]:       <nova:name>tempest-ServerActionsTestOtherB-server-511980533</nova:name>
Nov 28 17:05:43 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:05:40</nova:creationTime>
Nov 28 17:05:43 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:05:43 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:05:43 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:05:43 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:05:43 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:05:43 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:05:43 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:05:43 user nova-compute[75246]:       <nova:owner>
Nov 28 17:05:43 user nova-compute[75246]:         <nova:user uuid="ec11d8eaa57441e4b1178c39dfccd51f">tempest-ServerActionsTestOtherB-779885367-project-member</nova:user>
Nov 28 17:05:43 user nova-compute[75246]:         <nova:project uuid="3098a0e0fd3640d6b0c61303e10b9269">tempest-ServerActionsTestOtherB-779885367</nova:project>
Nov 28 17:05:43 user nova-compute[75246]:       </nova:owner>
Nov 28 17:05:43 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:05:43 user nova-compute[75246]:       <nova:ports>
Nov 28 17:05:43 user nova-compute[75246]:         <nova:port uuid="3b26f892-a21c-4c9f-b4f2-627ed62fb2c0">
Nov 28 17:05:43 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 17:05:43 user nova-compute[75246]:         </nova:port>
Nov 28 17:05:43 user nova-compute[75246]:       </nova:ports>
Nov 28 17:05:43 user nova-compute[75246]:     </nova:instance>
Nov 28 17:05:43 user nova-compute[75246]:   </metadata>
Nov 28 17:05:43 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:05:43 user nova-compute[75246]:     <system>
Nov 28 17:05:43 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:05:43 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:05:43 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:05:43 user nova-compute[75246]:       <entry name="serial">4b650a57-5870-4f77-bca2-abe50d970b40</entry>
Nov 28 17:05:43 user nova-compute[75246]:       <entry name="uuid">4b650a57-5870-4f77-bca2-abe50d970b40</entry>
Nov 28 17:05:43 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:05:43 user nova-compute[75246]:     </system>
Nov 28 17:05:43 user nova-compute[75246]:   </sysinfo>
Nov 28 17:05:43 user nova-compute[75246]:   <os>
Nov 28 17:05:43 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:05:43 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:05:43 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:05:43 user nova-compute[75246]:   </os>
Nov 28 17:05:43 user nova-compute[75246]:   <features>
Nov 28 17:05:43 user nova-compute[75246]:     <acpi/>
Nov 28 17:05:43 user nova-compute[75246]:     <apic/>
Nov 28 17:05:43 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:05:43 user nova-compute[75246]:   </features>
Nov 28 17:05:43 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:05:43 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:05:43 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:05:43 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:05:43 user nova-compute[75246]:   </clock>
Nov 28 17:05:43 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:05:43 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:05:43 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:05:43 user nova-compute[75246]:   </cpu>
Nov 28 17:05:43 user nova-compute[75246]:   <devices>
Nov 28 17:05:43 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:05:43 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:05:43 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk"/>
Nov 28 17:05:43 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:05:43 user nova-compute[75246]:     </disk>
Nov 28 17:05:43 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:05:43 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:05:43 user nova-compute[75246]:       <source dev="/dev/sdd"/>
Nov 28 17:05:43 user nova-compute[75246]:       <target dev="vdb" bus="virtio"/>
Nov 28 17:05:43 user nova-compute[75246]:       <serial>3d2f58a0-30e0-4819-aae0-07657c5f32b4</serial>
Nov 28 17:05:43 user nova-compute[75246]:     </disk>
Nov 28 17:05:43 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:05:43 user nova-compute[75246]:       <mac address="fa:16:3e:d2:1a:3a"/>
Nov 28 17:05:43 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:05:43 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:05:43 user nova-compute[75246]:       <target dev="tap3b26f892-a2"/>
Nov 28 17:05:43 user nova-compute[75246]:     </interface>
Nov 28 17:05:43 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:05:43 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/console.log" append="off"/>
Nov 28 17:05:43 user nova-compute[75246]:     </serial>
Nov 28 17:05:43 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:05:43 user nova-compute[75246]:     <video>
Nov 28 17:05:43 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:05:43 user nova-compute[75246]:     </video>
Nov 28 17:05:43 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:05:43 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:05:43 user nova-compute[75246]:     </rng>
Nov 28 17:05:43 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:05:43 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:05:43 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:05:43 user nova-compute[75246]:     </memballoon>
Nov 28 17:05:43 user nova-compute[75246]:   </devices>
Nov 28 17:05:43 user nova-compute[75246]: </domain>
Nov 28 17:05:43 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-511980533',display_name='tempest-ServerActionsTestOtherB-server-511980533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-511980533',id=3,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeYN/HSLFqD4XGGEXJ9b8W5tTZ1Q+j1Wl9INcd9I7zBrxI2z/wVXkIvtrK7OKu4ZT8jqxkECEhWOY/LUm6Wr8yFYH+XfgjPLkBJ3Cg5yb8oaGQFI8Npp1mQPS7budj7Eg==',key_name='tempest-keypair-789293158',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:03:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3098a0e0fd3640d6b0c61303e10b9269',ramdisk_id='',reservation_id='r-ibzp3hny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-779885367',owner_user_name='tempest-ServerActionsTestOtherB-779885367-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:05:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec11d8eaa57441e4b1178c39dfccd51f',uuid=4b650a57-5870-4f77-bca2-abe50d970b40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Converting VIF {"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG os_vif [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab6fb5da-1db5-5550-9a5a-f117fb67053e', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b26f892-a2, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b26f892-a2, col_values=(('qos', UUID('3d8f5c69-02e5-4326-8d57-aa14ebcbe21f')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b26f892-a2, col_values=(('external_ids', {'iface-id': '3b26f892-a21c-4c9f-b4f2-627ed62fb2c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:1a:3a', 'vm-uuid': '4b650a57-5870-4f77-bca2-abe50d970b40'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:05:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:43 user nova-compute[75246]: INFO os_vif [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2')
Nov 28 17:05:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-8b010bfc-0ebe-4f73-9990-419e1121de6f req-8fe80896-d981-4268-b9d1-924fe2bea92d service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received event network-vif-plugged-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8b010bfc-0ebe-4f73-9990-419e1121de6f req-8fe80896-d981-4268-b9d1-924fe2bea92d service nova] Acquiring lock "86142721-b9dd-44ab-b994-f81443b5383c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8b010bfc-0ebe-4f73-9990-419e1121de6f req-8fe80896-d981-4268-b9d1-924fe2bea92d service nova] Lock "86142721-b9dd-44ab-b994-f81443b5383c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8b010bfc-0ebe-4f73-9990-419e1121de6f req-8fe80896-d981-4268-b9d1-924fe2bea92d service nova] Lock "86142721-b9dd-44ab-b994-f81443b5383c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-8b010bfc-0ebe-4f73-9990-419e1121de6f req-8fe80896-d981-4268-b9d1-924fe2bea92d service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] No waiting events found dispatching network-vif-plugged-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:44 user nova-compute[75246]: WARNING nova.compute.manager [req-8b010bfc-0ebe-4f73-9990-419e1121de6f req-8fe80896-d981-4268-b9d1-924fe2bea92d service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received unexpected event network-vif-plugged-2438ce69-6032-4ced-abea-84518ff89dfb for instance with vm_state active and task_state rebuild_spawning.
Nov 28 17:05:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:05:45 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Instance spawned successfully.
Nov 28 17:05:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-49288174-32c1-4861-b09a-2eacebea53d2 req-aedfd1d0-9279-43a7-a11e-e467e6cc1de9 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received event network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-49288174-32c1-4861-b09a-2eacebea53d2 req-aedfd1d0-9279-43a7-a11e-e467e6cc1de9 service nova] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-49288174-32c1-4861-b09a-2eacebea53d2 req-aedfd1d0-9279-43a7-a11e-e467e6cc1de9 service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-49288174-32c1-4861-b09a-2eacebea53d2 req-aedfd1d0-9279-43a7-a11e-e467e6cc1de9 service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-49288174-32c1-4861-b09a-2eacebea53d2 req-aedfd1d0-9279-43a7-a11e-e467e6cc1de9 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] No waiting events found dispatching network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:45 user nova-compute[75246]: WARNING nova.compute.manager [req-49288174-32c1-4861-b09a-2eacebea53d2 req-aedfd1d0-9279-43a7-a11e-e467e6cc1de9 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received unexpected event network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 for instance with vm_state resized and task_state resize_reverting.
Nov 28 17:05:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG nova.objects.instance [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75246) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 28 17:05:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ecff19b2-224c-4c68-9bf7-5f513dd9a6c0 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.132s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:47 user nova-compute[75246]: DEBUG nova.compute.manager [req-a72c3a39-a851-42a0-a7ea-ec7898bcd380 req-7293cb8f-8027-4d07-8e7d-e350f0b32c99 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received event network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a72c3a39-a851-42a0-a7ea-ec7898bcd380 req-7293cb8f-8027-4d07-8e7d-e350f0b32c99 service nova] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a72c3a39-a851-42a0-a7ea-ec7898bcd380 req-7293cb8f-8027-4d07-8e7d-e350f0b32c99 service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a72c3a39-a851-42a0-a7ea-ec7898bcd380 req-7293cb8f-8027-4d07-8e7d-e350f0b32c99 service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:47 user nova-compute[75246]: DEBUG nova.compute.manager [req-a72c3a39-a851-42a0-a7ea-ec7898bcd380 req-7293cb8f-8027-4d07-8e7d-e350f0b32c99 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] No waiting events found dispatching network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:47 user nova-compute[75246]: WARNING nova.compute.manager [req-a72c3a39-a851-42a0-a7ea-ec7898bcd380 req-7293cb8f-8027-4d07-8e7d-e350f0b32c99 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received unexpected event network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 for instance with vm_state resized and task_state resize_reverting.
Nov 28 17:05:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:47 user nova-compute[75246]: INFO nova.compute.manager [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Terminating instance
Nov 28 17:05:47 user nova-compute[75246]: DEBUG nova.compute.manager [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG nova.compute.manager [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:05:48 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Instance running successfully.
Nov 28 17:05:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] finish_revert_migration finished successfully. {{(pid=75246) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:48 user nova-compute[75246]: INFO nova.compute.manager [None req-19546b1c-bcd4-4100-b87f-fede779c9e62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Updating instance to original state: 'active'
Nov 28 17:05:48 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Instance destroyed successfully.
Nov 28 17:05:48 user nova-compute[75246]: DEBUG nova.objects.instance [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lazy-loading 'resources' on Instance uuid 915bc61e-eaea-40c0-a5ed-4d2a677477f8 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1751311461',display_name='tempest-VolumesAdminNegativeTest-server-1751311461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1751311461',id=4,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZKL+VkKY4OwVImc8Jb4XnsPg1fehSD9ODJlEpJcUUBLi46TMEK4jjhP2FRqo1gZUepmLvGKzsbq/6Fmek3gp7nNID5q2WoX+z5IwK9dtfbb7xje3Q4cpFCB0lex8vkvw==',key_name='tempest-keypair-13715404',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:00:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='559858a844e64c6c80e194efd0b71c9c',ramdisk_id='',reservation_id='r-j8wyt9sr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-996939064',owner_user_name='tempest-VolumesAdminNegativeTest-996939064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:00:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='136ea37d7d6a4cd1a2f4779f8e8c4cb7',uuid=915bc61e-eaea-40c0-a5ed-4d2a677477f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40798d97-9143-4283-90ba-2bf3f34c1f51", "address": "fa:16:3e:14:c6:95", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40798d97-91", "ovs_interfaceid": "40798d97-9143-4283-90ba-2bf3f34c1f51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Converting VIF {"id": "40798d97-9143-4283-90ba-2bf3f34c1f51", "address": "fa:16:3e:14:c6:95", "network": {"id": "7c4b4f14-738c-4741-a7d1-b831c7557206", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-916630163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "559858a844e64c6c80e194efd0b71c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40798d97-91", "ovs_interfaceid": "40798d97-9143-4283-90ba-2bf3f34c1f51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:c6:95,bridge_name='br-int',has_traffic_filtering=True,id=40798d97-9143-4283-90ba-2bf3f34c1f51,network=Network(7c4b4f14-738c-4741-a7d1-b831c7557206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40798d97-91') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG os_vif [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:c6:95,bridge_name='br-int',has_traffic_filtering=True,id=40798d97-9143-4283-90ba-2bf3f34c1f51,network=Network(7c4b4f14-738c-4741-a7d1-b831c7557206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40798d97-91') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40798d97-91, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da7e5e23-fe7f-466b-8989-c5b31ba75312) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:05:48 user nova-compute[75246]: INFO os_vif [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:c6:95,bridge_name='br-int',has_traffic_filtering=True,id=40798d97-9143-4283-90ba-2bf3f34c1f51,network=Network(7c4b4f14-738c-4741-a7d1-b831c7557206),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40798d97-91')
Nov 28 17:05:48 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Deleting instance files /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8_del
Nov 28 17:05:48 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Deletion of /opt/stack/data/nova/instances/915bc61e-eaea-40c0-a5ed-4d2a677477f8_del complete
Nov 28 17:05:48 user nova-compute[75246]: INFO nova.compute.manager [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 28 17:05:48 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:05:48 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:05:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-b25b99fc-96b8-4f7a-a991-b7967c580ee4 req-61351bb3-001f-4100-804e-4e07fac120a4 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Received event network-vif-unplugged-40798d97-9143-4283-90ba-2bf3f34c1f51 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b25b99fc-96b8-4f7a-a991-b7967c580ee4 req-61351bb3-001f-4100-804e-4e07fac120a4 service nova] Acquiring lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b25b99fc-96b8-4f7a-a991-b7967c580ee4 req-61351bb3-001f-4100-804e-4e07fac120a4 service nova] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b25b99fc-96b8-4f7a-a991-b7967c580ee4 req-61351bb3-001f-4100-804e-4e07fac120a4 service nova] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-b25b99fc-96b8-4f7a-a991-b7967c580ee4 req-61351bb3-001f-4100-804e-4e07fac120a4 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] No waiting events found dispatching network-vif-unplugged-40798d97-9143-4283-90ba-2bf3f34c1f51 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-b25b99fc-96b8-4f7a-a991-b7967c580ee4 req-61351bb3-001f-4100-804e-4e07fac120a4 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Received event network-vif-unplugged-40798d97-9143-4283-90ba-2bf3f34c1f51 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:05:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-b25b99fc-96b8-4f7a-a991-b7967c580ee4 req-61351bb3-001f-4100-804e-4e07fac120a4 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Received event network-vif-plugged-40798d97-9143-4283-90ba-2bf3f34c1f51 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b25b99fc-96b8-4f7a-a991-b7967c580ee4 req-61351bb3-001f-4100-804e-4e07fac120a4 service nova] Acquiring lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b25b99fc-96b8-4f7a-a991-b7967c580ee4 req-61351bb3-001f-4100-804e-4e07fac120a4 service nova] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b25b99fc-96b8-4f7a-a991-b7967c580ee4 req-61351bb3-001f-4100-804e-4e07fac120a4 service nova] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-b25b99fc-96b8-4f7a-a991-b7967c580ee4 req-61351bb3-001f-4100-804e-4e07fac120a4 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] No waiting events found dispatching network-vif-plugged-40798d97-9143-4283-90ba-2bf3f34c1f51 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:05:49 user nova-compute[75246]: WARNING nova.compute.manager [req-b25b99fc-96b8-4f7a-a991-b7967c580ee4 req-61351bb3-001f-4100-804e-4e07fac120a4 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Received unexpected event network-vif-plugged-40798d97-9143-4283-90ba-2bf3f34c1f51 for instance with vm_state active and task_state deleting.
Nov 28 17:05:50 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:05:50 user nova-compute[75246]: DEBUG nova.compute.manager [req-98cf04d9-0e01-403c-b5d8-76300168cada req-9af1de8d-8cee-45ef-a2e2-ff8ca28e06a7 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Received event network-vif-deleted-40798d97-9143-4283-90ba-2bf3f34c1f51 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:05:50 user nova-compute[75246]: INFO nova.compute.manager [req-98cf04d9-0e01-403c-b5d8-76300168cada req-9af1de8d-8cee-45ef-a2e2-ff8ca28e06a7 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Neutron deleted interface 40798d97-9143-4283-90ba-2bf3f34c1f51; detaching it from the instance and deleting it from the info cache
Nov 28 17:05:50 user nova-compute[75246]: DEBUG nova.network.neutron [req-98cf04d9-0e01-403c-b5d8-76300168cada req-9af1de8d-8cee-45ef-a2e2-ff8ca28e06a7 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:05:50 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Took 1.51 seconds to deallocate network for instance.
Nov 28 17:05:50 user nova-compute[75246]: DEBUG nova.compute.manager [req-98cf04d9-0e01-403c-b5d8-76300168cada req-9af1de8d-8cee-45ef-a2e2-ff8ca28e06a7 service nova] [instance: 915bc61e-eaea-40c0-a5ed-4d2a677477f8] Detach interface failed, port_id=40798d97-9143-4283-90ba-2bf3f34c1f51, reason: Instance 915bc61e-eaea-40c0-a5ed-4d2a677477f8 could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:05:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:50 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:05:51 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:05:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.599s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:51 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Deleted allocations for instance 915bc61e-eaea-40c0-a5ed-4d2a677477f8
Nov 28 17:05:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8ef8065b-e82d-4557-9068-fa33bca3c819 tempest-VolumesAdminNegativeTest-996939064 tempest-VolumesAdminNegativeTest-996939064-project-member] Lock "915bc61e-eaea-40c0-a5ed-4d2a677477f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.458s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:55 user nova-compute[75246]: DEBUG nova.objects.instance [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lazy-loading 'flavor' on Instance uuid 6579e6f5-93be-4b39-9c61-ca3dbc40b79f {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:05:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:05:56 user nova-compute[75246]: INFO nova.compute.manager [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Attaching volume 5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 to /dev/vdb
Nov 28 17:05:56 user nova-compute[75246]: DEBUG os_brick.utils [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7394b26c-c7d1-4a3c-9223-ad2e89a58077]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5911f9c-690e-4bae-84bd-3764d3f9ba76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[563f9701-8d27-4e8b-ade5-0edeaa03862b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[62461f95-d669-4c51-bd49-fbfe42f755f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:05:56 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:05:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71d3f17-e7dd-4f52-8156-7edaed76ac5c]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG os_brick.utils [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:05:56 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Updating existing volume attachment record: ac4d44b7-1e76-467c-ad68-0be2c650576c {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:05:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:05:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Acquiring lock "3d274f78-239a-4a85-b850-ba82025d554d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Lock "3d274f78-239a-4a85-b850-ba82025d554d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:01 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:06:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:06:01 user nova-compute[75246]: INFO nova.compute.claims [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Claim successful on node user
Nov 28 17:06:02 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG nova.network.neutron [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:06:02 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:06:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG nova.policy [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5133e03c773c4d528fbacb9206b62cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ef802d501c4f28be417cd3ab0f7eeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:06:02 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Creating image(s)
Nov 28 17:06:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Lock "/opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Lock "/opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.205s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/disk 1073741824" returned: 0 in 0.060s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.205s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG nova.network.neutron [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Successfully created port: dd0e86d3-277b-4e55-aca6-ffaca265c53c {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Cannot resize image /opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Ensure instance console log exists: /opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG nova.network.neutron [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Successfully updated port: dd0e86d3-277b-4e55-aca6-ffaca265c53c {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Acquiring lock "refresh_cache-3d274f78-239a-4a85-b850-ba82025d554d" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Acquired lock "refresh_cache-3d274f78-239a-4a85-b850-ba82025d554d" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG nova.network.neutron [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-f117b7f2-cb4f-4a18-9f42-27b6270b984c req-0e556403-fbfa-4a04-aa6a-fca836ed9731 service nova] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Received event network-changed-dd0e86d3-277b-4e55-aca6-ffaca265c53c {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-f117b7f2-cb4f-4a18-9f42-27b6270b984c req-0e556403-fbfa-4a04-aa6a-fca836ed9731 service nova] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Refreshing instance network info cache due to event network-changed-dd0e86d3-277b-4e55-aca6-ffaca265c53c. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:06:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f117b7f2-cb4f-4a18-9f42-27b6270b984c req-0e556403-fbfa-4a04-aa6a-fca836ed9731 service nova] Acquiring lock "refresh_cache-3d274f78-239a-4a85-b850-ba82025d554d" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.network.neutron [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.network.neutron [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Updating instance_info_cache with network_info: [{"id": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "address": "fa:16:3e:a3:64:8a", "network": {"id": "7c230aba-28f6-45fc-b38c-9a75813f71dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ef802d501c4f28be417cd3ab0f7eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd0e86d3-27", "ovs_interfaceid": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Releasing lock "refresh_cache-3d274f78-239a-4a85-b850-ba82025d554d" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Instance network_info: |[{"id": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "address": "fa:16:3e:a3:64:8a", "network": {"id": "7c230aba-28f6-45fc-b38c-9a75813f71dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ef802d501c4f28be417cd3ab0f7eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd0e86d3-27", "ovs_interfaceid": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f117b7f2-cb4f-4a18-9f42-27b6270b984c req-0e556403-fbfa-4a04-aa6a-fca836ed9731 service nova] Acquired lock "refresh_cache-3d274f78-239a-4a85-b850-ba82025d554d" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.network.neutron [req-f117b7f2-cb4f-4a18-9f42-27b6270b984c req-0e556403-fbfa-4a04-aa6a-fca836ed9731 service nova] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Refreshing network info cache for port dd0e86d3-277b-4e55-aca6-ffaca265c53c {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Start _get_guest_xml network_info=[{"id": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "address": "fa:16:3e:a3:64:8a", "network": {"id": "7c230aba-28f6-45fc-b38c-9a75813f71dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ef802d501c4f28be417cd3ab0f7eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd0e86d3-27", "ovs_interfaceid": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:06:04 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:06:04 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-537867883',display_name='tempest-VolumesActionsTest-instance-537867883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-537867883',id=20,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31ef802d501c4f28be417cd3ab0f7eeb',ramdisk_id='',reservation_id='r-b77xy656',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-931503126',owner_user_name='tempest-VolumesActionsTest-931503126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:06:02Z,user_data=None,user_id='5133e03c773c4d528fbacb9206b62cf7',uuid=3d274f78-239a-4a85-b850-ba82025d554d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "address": "fa:16:3e:a3:64:8a", "network": {"id": "7c230aba-28f6-45fc-b38c-9a75813f71dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ef802d501c4f28be417cd3ab0f7eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd0e86d3-27", "ovs_interfaceid": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Converting VIF {"id": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "address": "fa:16:3e:a3:64:8a", "network": {"id": "7c230aba-28f6-45fc-b38c-9a75813f71dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ef802d501c4f28be417cd3ab0f7eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd0e86d3-27", "ovs_interfaceid": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:64:8a,bridge_name='br-int',has_traffic_filtering=True,id=dd0e86d3-277b-4e55-aca6-ffaca265c53c,network=Network(7c230aba-28f6-45fc-b38c-9a75813f71dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd0e86d3-27') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.objects.instance [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d274f78-239a-4a85-b850-ba82025d554d {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:06:04 user nova-compute[75246]:   <uuid>3d274f78-239a-4a85-b850-ba82025d554d</uuid>
Nov 28 17:06:04 user nova-compute[75246]:   <name>instance-00000014</name>
Nov 28 17:06:04 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:06:04 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:06:04 user nova-compute[75246]:   <metadata>
Nov 28 17:06:04 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:06:04 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:06:04 user nova-compute[75246]:       <nova:name>tempest-VolumesActionsTest-instance-537867883</nova:name>
Nov 28 17:06:04 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:06:04</nova:creationTime>
Nov 28 17:06:04 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:06:04 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:06:04 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:06:04 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:06:04 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:06:04 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:06:04 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:06:04 user nova-compute[75246]:       <nova:owner>
Nov 28 17:06:04 user nova-compute[75246]:         <nova:user uuid="5133e03c773c4d528fbacb9206b62cf7">tempest-VolumesActionsTest-931503126-project-member</nova:user>
Nov 28 17:06:04 user nova-compute[75246]:         <nova:project uuid="31ef802d501c4f28be417cd3ab0f7eeb">tempest-VolumesActionsTest-931503126</nova:project>
Nov 28 17:06:04 user nova-compute[75246]:       </nova:owner>
Nov 28 17:06:04 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:06:04 user nova-compute[75246]:       <nova:ports>
Nov 28 17:06:04 user nova-compute[75246]:         <nova:port uuid="dd0e86d3-277b-4e55-aca6-ffaca265c53c">
Nov 28 17:06:04 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 17:06:04 user nova-compute[75246]:         </nova:port>
Nov 28 17:06:04 user nova-compute[75246]:       </nova:ports>
Nov 28 17:06:04 user nova-compute[75246]:     </nova:instance>
Nov 28 17:06:04 user nova-compute[75246]:   </metadata>
Nov 28 17:06:04 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:06:04 user nova-compute[75246]:     <system>
Nov 28 17:06:04 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:06:04 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:06:04 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:06:04 user nova-compute[75246]:       <entry name="serial">3d274f78-239a-4a85-b850-ba82025d554d</entry>
Nov 28 17:06:04 user nova-compute[75246]:       <entry name="uuid">3d274f78-239a-4a85-b850-ba82025d554d</entry>
Nov 28 17:06:04 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:06:04 user nova-compute[75246]:     </system>
Nov 28 17:06:04 user nova-compute[75246]:   </sysinfo>
Nov 28 17:06:04 user nova-compute[75246]:   <os>
Nov 28 17:06:04 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:06:04 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:06:04 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:06:04 user nova-compute[75246]:   </os>
Nov 28 17:06:04 user nova-compute[75246]:   <features>
Nov 28 17:06:04 user nova-compute[75246]:     <acpi/>
Nov 28 17:06:04 user nova-compute[75246]:     <apic/>
Nov 28 17:06:04 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:06:04 user nova-compute[75246]:   </features>
Nov 28 17:06:04 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:06:04 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:06:04 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:06:04 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:06:04 user nova-compute[75246]:   </clock>
Nov 28 17:06:04 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:06:04 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:06:04 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:06:04 user nova-compute[75246]:   </cpu>
Nov 28 17:06:04 user nova-compute[75246]:   <devices>
Nov 28 17:06:04 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:06:04 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:06:04 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/disk"/>
Nov 28 17:06:04 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:06:04 user nova-compute[75246]:     </disk>
Nov 28 17:06:04 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:06:04 user nova-compute[75246]:       <mac address="fa:16:3e:a3:64:8a"/>
Nov 28 17:06:04 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:06:04 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:06:04 user nova-compute[75246]:       <target dev="tapdd0e86d3-27"/>
Nov 28 17:06:04 user nova-compute[75246]:     </interface>
Nov 28 17:06:04 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:06:04 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/console.log" append="off"/>
Nov 28 17:06:04 user nova-compute[75246]:     </serial>
Nov 28 17:06:04 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:06:04 user nova-compute[75246]:     <video>
Nov 28 17:06:04 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:06:04 user nova-compute[75246]:     </video>
Nov 28 17:06:04 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:06:04 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:06:04 user nova-compute[75246]:     </rng>
Nov 28 17:06:04 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:06:04 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:06:04 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:06:04 user nova-compute[75246]:     </memballoon>
Nov 28 17:06:04 user nova-compute[75246]:   </devices>
Nov 28 17:06:04 user nova-compute[75246]: </domain>
Nov 28 17:06:04 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-537867883',display_name='tempest-VolumesActionsTest-instance-537867883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-537867883',id=20,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31ef802d501c4f28be417cd3ab0f7eeb',ramdisk_id='',reservation_id='r-b77xy656',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-931503126',owner_user_name='tempest-VolumesActionsTest-931503126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:06:02Z,user_data=None,user_id='5133e03c773c4d528fbacb9206b62cf7',uuid=3d274f78-239a-4a85-b850-ba82025d554d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "address": "fa:16:3e:a3:64:8a", "network": {"id": "7c230aba-28f6-45fc-b38c-9a75813f71dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ef802d501c4f28be417cd3ab0f7eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd0e86d3-27", "ovs_interfaceid": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Converting VIF {"id": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "address": "fa:16:3e:a3:64:8a", "network": {"id": "7c230aba-28f6-45fc-b38c-9a75813f71dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ef802d501c4f28be417cd3ab0f7eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd0e86d3-27", "ovs_interfaceid": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:64:8a,bridge_name='br-int',has_traffic_filtering=True,id=dd0e86d3-277b-4e55-aca6-ffaca265c53c,network=Network(7c230aba-28f6-45fc-b38c-9a75813f71dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd0e86d3-27') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG os_vif [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:64:8a,bridge_name='br-int',has_traffic_filtering=True,id=dd0e86d3-277b-4e55-aca6-ffaca265c53c,network=Network(7c230aba-28f6-45fc-b38c-9a75813f71dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd0e86d3-27') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0293f92-1549-57d3-a1ca-ba05e4d69584', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd0e86d3-27, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd0e86d3-27, col_values=(('qos', UUID('2542855c-1e09-41d7-a83d-680413e11ea8')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd0e86d3-27, col_values=(('external_ids', {'iface-id': 'dd0e86d3-277b-4e55-aca6-ffaca265c53c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:64:8a', 'vm-uuid': '3d274f78-239a-4a85-b850-ba82025d554d'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:04 user nova-compute[75246]: INFO os_vif [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:64:8a,bridge_name='br-int',has_traffic_filtering=True,id=dd0e86d3-277b-4e55-aca6-ffaca265c53c,network=Network(7c230aba-28f6-45fc-b38c-9a75813f71dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd0e86d3-27')
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] No VIF found with MAC fa:16:3e:a3:64:8a, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.network.neutron [req-f117b7f2-cb4f-4a18-9f42-27b6270b984c req-0e556403-fbfa-4a04-aa6a-fca836ed9731 service nova] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Updated VIF entry in instance network info cache for port dd0e86d3-277b-4e55-aca6-ffaca265c53c. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG nova.network.neutron [req-f117b7f2-cb4f-4a18-9f42-27b6270b984c req-0e556403-fbfa-4a04-aa6a-fca836ed9731 service nova] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Updating instance_info_cache with network_info: [{"id": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "address": "fa:16:3e:a3:64:8a", "network": {"id": "7c230aba-28f6-45fc-b38c-9a75813f71dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ef802d501c4f28be417cd3ab0f7eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd0e86d3-27", "ovs_interfaceid": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:06:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f117b7f2-cb4f-4a18-9f42-27b6270b984c req-0e556403-fbfa-4a04-aa6a-fca836ed9731 service nova] Releasing lock "refresh_cache-3d274f78-239a-4a85-b850-ba82025d554d" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:06:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-7aec0d98-da4b-4b11-aea7-1182c0c25dbb req-da86fcb5-f068-4dff-bd9e-6add288e610b service nova] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Received event network-vif-plugged-dd0e86d3-277b-4e55-aca6-ffaca265c53c {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:06:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7aec0d98-da4b-4b11-aea7-1182c0c25dbb req-da86fcb5-f068-4dff-bd9e-6add288e610b service nova] Acquiring lock "3d274f78-239a-4a85-b850-ba82025d554d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7aec0d98-da4b-4b11-aea7-1182c0c25dbb req-da86fcb5-f068-4dff-bd9e-6add288e610b service nova] Lock "3d274f78-239a-4a85-b850-ba82025d554d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7aec0d98-da4b-4b11-aea7-1182c0c25dbb req-da86fcb5-f068-4dff-bd9e-6add288e610b service nova] Lock "3d274f78-239a-4a85-b850-ba82025d554d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-7aec0d98-da4b-4b11-aea7-1182c0c25dbb req-da86fcb5-f068-4dff-bd9e-6add288e610b service nova] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] No waiting events found dispatching network-vif-plugged-dd0e86d3-277b-4e55-aca6-ffaca265c53c {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:06:06 user nova-compute[75246]: WARNING nova.compute.manager [req-7aec0d98-da4b-4b11-aea7-1182c0c25dbb req-da86fcb5-f068-4dff-bd9e-6add288e610b service nova] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Received unexpected event network-vif-plugged-dd0e86d3-277b-4e55-aca6-ffaca265c53c for instance with vm_state building and task_state spawning.
Nov 28 17:06:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:06:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:06:08 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Instance spawned successfully.
Nov 28 17:06:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:06:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:06:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:06:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:06:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:06:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:06:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:06:08 user nova-compute[75246]: INFO nova.compute.manager [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 28 17:06:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:06:08 user nova-compute[75246]: INFO nova.compute.manager [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Took 7.03 seconds to build instance.
Nov 28 17:06:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ee474caf-f31e-44a6-a52a-ee87a8bdfd9d tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Lock "3d274f78-239a-4a85-b850-ba82025d554d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.166s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:08 user nova-compute[75246]: DEBUG nova.compute.manager [req-b81779e4-7492-40fa-a074-63d597ba3e37 req-958c81bf-2b3f-4bc4-be96-c99ae9f47f6e service nova] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Received event network-vif-plugged-dd0e86d3-277b-4e55-aca6-ffaca265c53c {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:06:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b81779e4-7492-40fa-a074-63d597ba3e37 req-958c81bf-2b3f-4bc4-be96-c99ae9f47f6e service nova] Acquiring lock "3d274f78-239a-4a85-b850-ba82025d554d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b81779e4-7492-40fa-a074-63d597ba3e37 req-958c81bf-2b3f-4bc4-be96-c99ae9f47f6e service nova] Lock "3d274f78-239a-4a85-b850-ba82025d554d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b81779e4-7492-40fa-a074-63d597ba3e37 req-958c81bf-2b3f-4bc4-be96-c99ae9f47f6e service nova] Lock "3d274f78-239a-4a85-b850-ba82025d554d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:08 user nova-compute[75246]: DEBUG nova.compute.manager [req-b81779e4-7492-40fa-a074-63d597ba3e37 req-958c81bf-2b3f-4bc4-be96-c99ae9f47f6e service nova] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] No waiting events found dispatching network-vif-plugged-dd0e86d3-277b-4e55-aca6-ffaca265c53c {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:06:08 user nova-compute[75246]: WARNING nova.compute.manager [req-b81779e4-7492-40fa-a074-63d597ba3e37 req-958c81bf-2b3f-4bc4-be96-c99ae9f47f6e service nova] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Received unexpected event network-vif-plugged-dd0e86d3-277b-4e55-aca6-ffaca265c53c for instance with vm_state active and task_state None.
Nov 28 17:06:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmighUaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:06:10 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:06:10 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:06:10 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6402b672-0ee4-45c2-959e-c79ac6f91d6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:06:10 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[46218573-cb20-453c-9c0e-6eb9d1583243]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872] added
Nov 28 17:06:10 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[def45855-2670-4c5d-842e-5b3f0497a49f]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[58914f0d-9fba-47ab-b81e-c6e822c33f7f]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GmighUaA {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GmighUaA" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[adddf929-2182-408c-b9d9-5ed2ebf31e3a]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GmighUaA'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a50e15a-c54b-4751-b2a0-67487cd67860]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dba898-17bc-4e6d-9110-d68cce6b4e98]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:06:10 user nova-compute[75246]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:06:10 user nova-compute[75246]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:06:10 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:06:10 user nova-compute[75246]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:06:10 user nova-compute[75246]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:06:10 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3694db6c-f90c-4f7f-817b-5647cbdf647d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872, portal: 172.16.0.220,3260]
Nov 28 17:06:10 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872, portal: 172.16.0.220,3260] successful.
Nov 28 17:06:10 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5340e50-6bb5-4cf4-9fe7-7188e254ee16]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6560480-8a0c-494e-a165-c5d2eebaf6fa]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:06:10 user nova-compute[75246]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:06:10 user nova-compute[75246]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:06:10 user nova-compute[75246]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)
Nov 28 17:06:10 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:06:10 user nova-compute[75246]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:06:10 user nova-compute[75246]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:06:10 user nova-compute[75246]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)
Nov 28 17:06:10 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[037767ff-9a51-4963-a907-2db7c3b78494]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmighUaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:06:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:06:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23236303532353166', 'path': '/dev/sde'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:06:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236303532353166', 'path': '/dev/sde'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:06:11 user nova-compute[75246]: DEBUG nova.objects.instance [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lazy-loading 'flavor' on Instance uuid 6579e6f5-93be-4b39-9c61-ca3dbc40b79f {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:06:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:06:11 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:06:11 user nova-compute[75246]:   <source dev="/dev/sde"/>
Nov 28 17:06:11 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:06:11 user nova-compute[75246]:   <serial>5acc1a2e-a8b9-4914-a2c4-ee26f8a17872</serial>
Nov 28 17:06:11 user nova-compute[75246]: </disk>
Nov 28 17:06:11 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:06:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:06:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:06:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] No VIF found with MAC fa:16:3e:2c:21:7a, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:06:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-255d33fc-2619-44cb-8431-6cad5efb8425 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.078s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:19 user nova-compute[75246]: DEBUG nova.compute.manager [req-7a20a187-b8c5-4806-9eda-f2fe74b6ff23 req-adf48514-016e-41c6-b388-8371e219582b service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received event network-changed-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:06:19 user nova-compute[75246]: DEBUG nova.compute.manager [req-7a20a187-b8c5-4806-9eda-f2fe74b6ff23 req-adf48514-016e-41c6-b388-8371e219582b service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Refreshing instance network info cache due to event network-changed-8932d31b-ff61-4b52-9f2d-a646560d3777. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:06:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7a20a187-b8c5-4806-9eda-f2fe74b6ff23 req-adf48514-016e-41c6-b388-8371e219582b service nova] Acquiring lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:06:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7a20a187-b8c5-4806-9eda-f2fe74b6ff23 req-adf48514-016e-41c6-b388-8371e219582b service nova] Acquired lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:06:19 user nova-compute[75246]: DEBUG nova.network.neutron [req-7a20a187-b8c5-4806-9eda-f2fe74b6ff23 req-adf48514-016e-41c6-b388-8371e219582b service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Refreshing network info cache for port 8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:06:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:19 user nova-compute[75246]: DEBUG nova.network.neutron [req-7a20a187-b8c5-4806-9eda-f2fe74b6ff23 req-adf48514-016e-41c6-b388-8371e219582b service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Updated VIF entry in instance network info cache for port 8932d31b-ff61-4b52-9f2d-a646560d3777. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:06:19 user nova-compute[75246]: DEBUG nova.network.neutron [req-7a20a187-b8c5-4806-9eda-f2fe74b6ff23 req-adf48514-016e-41c6-b388-8371e219582b service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Updating instance_info_cache with network_info: [{"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:06:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7a20a187-b8c5-4806-9eda-f2fe74b6ff23 req-adf48514-016e-41c6-b388-8371e219582b service nova] Releasing lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:06:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:20 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 25480185-8c9c-4aad-9c46-573cfbf65364 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid e1266470-c182-4c0c-a575-4c5043f54745 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 4b650a57-5870-4f77-bca2-abe50d970b40 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 69f05219-5034-4e88-879c-9c567e2c2fcd {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 86142721-b9dd-44ab-b994-f81443b5383c {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid c94900af-f484-47bf-8627-8aa863334b63 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 6579e6f5-93be-4b39-9c61-ca3dbc40b79f {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 0d952de1-8c78-4bea-853d-21ac4f979845 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 3d274f78-239a-4a85-b850-ba82025d554d {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "25480185-8c9c-4aad-9c46-573cfbf65364" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "25480185-8c9c-4aad-9c46-573cfbf65364" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "e1266470-c182-4c0c-a575-4c5043f54745" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "e1266470-c182-4c0c-a575-4c5043f54745" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "4b650a57-5870-4f77-bca2-abe50d970b40" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "69f05219-5034-4e88-879c-9c567e2c2fcd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "86142721-b9dd-44ab-b994-f81443b5383c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "86142721-b9dd-44ab-b994-f81443b5383c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "c94900af-f484-47bf-8627-8aa863334b63" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "c94900af-f484-47bf-8627-8aa863334b63" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "0d952de1-8c78-4bea-853d-21ac4f979845" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "0d952de1-8c78-4bea-853d-21ac4f979845" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "3d274f78-239a-4a85-b850-ba82025d554d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "3d274f78-239a-4a85-b850-ba82025d554d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "4b650a57-5870-4f77-bca2-abe50d970b40" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "e1266470-c182-4c0c-a575-4c5043f54745" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "25480185-8c9c-4aad-9c46-573cfbf65364" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "86142721-b9dd-44ab-b994-f81443b5383c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "3d274f78-239a-4a85-b850-ba82025d554d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "c94900af-f484-47bf-8627-8aa863334b63" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.140s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "0d952de1-8c78-4bea-853d-21ac4f979845" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.151s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG nova.compute.manager [req-7c5720d3-b2b3-4172-b514-c9b28268a5fe req-340a827b-e741-44ca-b637-2be38f39e018 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received event network-changed-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG nova.compute.manager [req-7c5720d3-b2b3-4172-b514-c9b28268a5fe req-340a827b-e741-44ca-b637-2be38f39e018 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Refreshing instance network info cache due to event network-changed-8932d31b-ff61-4b52-9f2d-a646560d3777. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7c5720d3-b2b3-4172-b514-c9b28268a5fe req-340a827b-e741-44ca-b637-2be38f39e018 service nova] Acquiring lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7c5720d3-b2b3-4172-b514-c9b28268a5fe req-340a827b-e741-44ca-b637-2be38f39e018 service nova] Acquired lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:06:22 user nova-compute[75246]: DEBUG nova.network.neutron [req-7c5720d3-b2b3-4172-b514-c9b28268a5fe req-340a827b-e741-44ca-b637-2be38f39e018 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Refreshing network info cache for port 8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:06:23 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:06:23 user nova-compute[75246]: DEBUG nova.network.neutron [req-7c5720d3-b2b3-4172-b514-c9b28268a5fe req-340a827b-e741-44ca-b637-2be38f39e018 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Updated VIF entry in instance network info cache for port 8932d31b-ff61-4b52-9f2d-a646560d3777. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:06:23 user nova-compute[75246]: DEBUG nova.network.neutron [req-7c5720d3-b2b3-4172-b514-c9b28268a5fe req-340a827b-e741-44ca-b637-2be38f39e018 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Updating instance_info_cache with network_info: [{"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:06:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7c5720d3-b2b3-4172-b514-c9b28268a5fe req-340a827b-e741-44ca-b637-2be38f39e018 service nova] Releasing lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:06:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:24 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:06:24 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:06:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:25 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:06:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:26 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:06:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:27 user nova-compute[75246]: INFO nova.compute.manager [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Rebooting instance
Nov 28 17:06:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:06:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquired lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:06:27 user nova-compute[75246]: DEBUG nova.network.neutron [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:06:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:06:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG nova.network.neutron [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Updating instance_info_cache with network_info: [{"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Releasing lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG nova.compute.manager [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG nova.compute.manager [req-ed32d374-81d7-4430-b9be-d577c03cde84 req-d2bf8307-646f-488b-b565-022877eab54b service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received event network-vif-unplugged-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ed32d374-81d7-4430-b9be-d577c03cde84 req-d2bf8307-646f-488b-b565-022877eab54b service nova] Acquiring lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ed32d374-81d7-4430-b9be-d577c03cde84 req-d2bf8307-646f-488b-b565-022877eab54b service nova] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ed32d374-81d7-4430-b9be-d577c03cde84 req-d2bf8307-646f-488b-b565-022877eab54b service nova] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG nova.compute.manager [req-ed32d374-81d7-4430-b9be-d577c03cde84 req-d2bf8307-646f-488b-b565-022877eab54b service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] No waiting events found dispatching network-vif-unplugged-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:06:28 user nova-compute[75246]: WARNING nova.compute.manager [req-ed32d374-81d7-4430-b9be-d577c03cde84 req-d2bf8307-646f-488b-b565-022877eab54b service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received unexpected event network-vif-unplugged-8932d31b-ff61-4b52-9f2d-a646560d3777 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 17:06:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:29 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Instance destroyed successfully.
Nov 28 17:06:29 user nova-compute[75246]: DEBUG nova.objects.instance [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lazy-loading 'resources' on Instance uuid 6579e6f5-93be-4b39-9c61-ca3dbc40b79f {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:04:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1459152348',display_name='tempest-TestMinimumBasicScenario-server-1459152348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1459152348',id=18,image_ref='314c5acf-fabe-491c-8951-2240751d2dd2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV+cCKVKkKjippHw8fvg8ZUQ588Q45fV8SzYDVWZENrWtuGg6Vh8hnO4mjpQRK6qsK31ree66V8juizOkiDArzejhbRH/K2TpIsEaUaC5icEpgo6owAmBBXtqppX4HiNQ==',key_name='tempest-TestMinimumBasicScenario-700258823',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:04:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d01a3eaa26b4fc790abe7761fb2bb8a',ramdisk_id='',reservation_id='r-5f8m3x0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='314c5acf-fabe-491c-8951-2240751d2dd2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-433831737',owner_user_name='tempest-TestMinimumBasicScenario-433831737-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:06:28Z,user_data=None,user_id='194df496b87a48d68835cb7aa0802560',uuid=6579e6f5-93be-4b39-9c61-ca3dbc40b79f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Converting VIF {"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:21:7a,bridge_name='br-int',has_traffic_filtering=True,id=8932d31b-ff61-4b52-9f2d-a646560d3777,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8932d31b-ff') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG os_vif [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:21:7a,bridge_name='br-int',has_traffic_filtering=True,id=8932d31b-ff61-4b52-9f2d-a646560d3777,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8932d31b-ff') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8932d31b-ff, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1928304c-d7c7-4ebc-aacf-437bfcc46476) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:06:29 user nova-compute[75246]: INFO os_vif [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:21:7a,bridge_name='br-int',has_traffic_filtering=True,id=8932d31b-ff61-4b52-9f2d-a646560d3777,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8932d31b-ff')
Nov 28 17:06:29 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmighUaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:06:29 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:06:29 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcea6284-db95-4b6d-a42e-dcb067e576ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:06:29 user nova-compute[75246]: No targets found.
Nov 28 17:06:29 user nova-compute[75246]: iSNS:
Nov 28 17:06:29 user nova-compute[75246]: No targets found.
Nov 28 17:06:29 user nova-compute[75246]: STATIC:
Nov 28 17:06:29 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f
Nov 28 17:06:29 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:06:29 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:06:29 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353
Nov 28 17:06:29 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:06:29 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:06:29 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872
Nov 28 17:06:29 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:06:29 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:06:29 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4
Nov 28 17:06:29 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:06:29 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:06:29 user nova-compute[75246]: FIRMWARE:
Nov 28 17:06:29 user nova-compute[75246]: No targets found.
Nov 28 17:06:29 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:06:29 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:06:29 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a7a21c-3787-434c-82a5-ffc8c8d66134]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b45c03-b1e4-4b56-ac5f-4ccda3271f7d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:06:29 user nova-compute[75246]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:06:29 user nova-compute[75246]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:06:29 user nova-compute[75246]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)
Nov 28 17:06:29 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:06:29 user nova-compute[75246]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:06:29 user nova-compute[75246]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:06:29 user nova-compute[75246]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)
Nov 28 17:06:29 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d8159a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872'): ({'sde'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Removing single pathed devices sde {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bb6026-0d81-4faf-b7ba-ade4cfe1d3c3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd906aa-4157-4f1e-ab14-3e4004d054fc]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Flushing IO for device /dev/sde {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[468d68e0-9b2e-4f99-b90c-af8b207482bb]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31c1f96-8fde-4ec8-b5d1-dda23bf2459b]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] SCSI volumes sde have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[510135c0-1a41-4864-834e-699a09d286c6]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d17c96-ead5-4249-b1df-f5303db1570f]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872, portal: 172.16.0.220,3260]
Nov 28 17:06:30 user nova-compute[75246]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872, portal: 172.16.0.220,3260] successful.
Nov 28 17:06:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:30 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:06:30 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=7257MB free_disk=25.500537872314453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4690d5e-53ba-489f-9fdf-d2fd9891c268]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.874s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] <== disconnect_volume: return (877ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Start _get_guest_xml network_info=[{"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=314c5acf-fabe-491c-8951-2240751d2dd2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '314c5acf-fabe-491c-8951-2240751d2dd2'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': 'ac4d44b7-1e76-467c-ad68-0be2c650576c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmighUaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '6579e6f5-93be-4b39-9c61-ca3dbc40b79f', 'attached_at': '', 'detached_at': '', 'volume_id': '5acc1a2e-a8b9-4914-a2c4-ee26f8a17872', 'serial': '5acc1a2e-a8b9-4914-a2c4-ee26f8a17872'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 25480185-8c9c-4aad-9c46-573cfbf65364 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e1266470-c182-4c0c-a575-4c5043f54745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 86142721-b9dd-44ab-b994-f81443b5383c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 4b650a57-5870-4f77-bca2-abe50d970b40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c94900af-f484-47bf-8627-8aa863334b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 6579e6f5-93be-4b39-9c61-ca3dbc40b79f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 0d952de1-8c78-4bea-853d-21ac4f979845 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 69f05219-5034-4e88-879c-9c567e2c2fcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 3d274f78-239a-4a85-b850-ba82025d554d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:06:30 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:06:30 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=314c5acf-fabe-491c-8951-2240751d2dd2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.objects.instance [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6579e6f5-93be-4b39-9c61-ca3dbc40b79f {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.objects.base [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Object Instance<6579e6f5-93be-4b39-9c61-ca3dbc40b79f> lazy-loaded attributes: resources,vcpu_model {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmighUaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:06:30 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:06:30 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:06:30 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c7bb52-f833-4438-aa5c-690ecb29251e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:06:30 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8906c608-c9ce-4202-b85e-eb2b241bff05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872] added
Nov 28 17:06:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6715f718-e6f0-4145-9690-a5bd9dfcdfe5]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[72932d26-eb47-49cb-a2f7-1a5aadb7b3d0]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GmighUaA {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GmighUaA" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf93e6f-58ed-447f-ba39-1a8d5a33f284]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GmighUaA'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5f6961-3392-467f-9e37-46854ae352dc]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b175a547-9d3d-4b17-a2ed-99bd94491f42]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:06:30 user nova-compute[75246]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:06:30 user nova-compute[75246]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:06:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:06:30 user nova-compute[75246]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:06:30 user nova-compute[75246]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:06:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-da03e7b8-b611-400e-bd9b-27db7e35ff19 req-4338fcfc-01d3-48d0-8437-26a6b9bd0f54 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received event network-vif-plugged-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-da03e7b8-b611-400e-bd9b-27db7e35ff19 req-4338fcfc-01d3-48d0-8437-26a6b9bd0f54 service nova] Acquiring lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-da03e7b8-b611-400e-bd9b-27db7e35ff19 req-4338fcfc-01d3-48d0-8437-26a6b9bd0f54 service nova] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-da03e7b8-b611-400e-bd9b-27db7e35ff19 req-4338fcfc-01d3-48d0-8437-26a6b9bd0f54 service nova] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-da03e7b8-b611-400e-bd9b-27db7e35ff19 req-4338fcfc-01d3-48d0-8437-26a6b9bd0f54 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] No waiting events found dispatching network-vif-plugged-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:06:30 user nova-compute[75246]: WARNING nova.compute.manager [req-da03e7b8-b611-400e-bd9b-27db7e35ff19 req-4338fcfc-01d3-48d0-8437-26a6b9bd0f54 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received unexpected event network-vif-plugged-8932d31b-ff61-4b52-9f2d-a646560d3777 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae772d0-3df7-4088-bfaa-820d61ae7ed1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872, portal: 172.16.0.220,3260]
Nov 28 17:06:30 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872, portal: 172.16.0.220,3260] successful.
Nov 28 17:06:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4e5f99-a351-48f8-abd9-09c7f84437d1]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0d28c0-8cfc-4e10-a423-382633fdd7dc]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:06:30 user nova-compute[75246]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:06:30 user nova-compute[75246]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:06:30 user nova-compute[75246]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)
Nov 28 17:06:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:06:30 user nova-compute[75246]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:06:30 user nova-compute[75246]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:06:30 user nova-compute[75246]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)
Nov 28 17:06:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9c6415-0e8c-458c-9023-5b599c3e43e9]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:06:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmighUaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:06:31 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:06:31 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:06:31 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:06:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:06:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23236303532353166', 'path': '/dev/sde'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:06:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236303532353166', 'path': '/dev/sde'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:04:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1459152348',display_name='tempest-TestMinimumBasicScenario-server-1459152348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1459152348',id=18,image_ref='314c5acf-fabe-491c-8951-2240751d2dd2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV+cCKVKkKjippHw8fvg8ZUQ588Q45fV8SzYDVWZENrWtuGg6Vh8hnO4mjpQRK6qsK31ree66V8juizOkiDArzejhbRH/K2TpIsEaUaC5icEpgo6owAmBBXtqppX4HiNQ==',key_name='tempest-TestMinimumBasicScenario-700258823',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:04:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d01a3eaa26b4fc790abe7761fb2bb8a',ramdisk_id='',reservation_id='r-5f8m3x0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='314c5acf-fabe-491c-8951-2240751d2dd2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-433831737',owner_user_name='tempest-TestMinimumBasicScenario-433831737-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:06:28Z,user_data=None,user_id='194df496b87a48d68835cb7aa0802560',uuid=6579e6f5-93be-4b39-9c61-ca3dbc40b79f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Converting VIF {"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:21:7a,bridge_name='br-int',has_traffic_filtering=True,id=8932d31b-ff61-4b52-9f2d-a646560d3777,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8932d31b-ff') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG nova.objects.instance [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lazy-loading 'pci_devices' on Instance uuid 6579e6f5-93be-4b39-9c61-ca3dbc40b79f {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG nova.objects.base [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Object Instance<6579e6f5-93be-4b39-9c61-ca3dbc40b79f> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:06:32 user nova-compute[75246]:   <uuid>6579e6f5-93be-4b39-9c61-ca3dbc40b79f</uuid>
Nov 28 17:06:32 user nova-compute[75246]:   <name>instance-00000012</name>
Nov 28 17:06:32 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:06:32 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:06:32 user nova-compute[75246]:   <metadata>
Nov 28 17:06:32 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:06:32 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:06:32 user nova-compute[75246]:       <nova:name>tempest-TestMinimumBasicScenario-server-1459152348</nova:name>
Nov 28 17:06:32 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:06:30</nova:creationTime>
Nov 28 17:06:32 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:06:32 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:06:32 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:06:32 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:06:32 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:06:32 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:06:32 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:06:32 user nova-compute[75246]:       <nova:owner>
Nov 28 17:06:32 user nova-compute[75246]:         <nova:user uuid="194df496b87a48d68835cb7aa0802560">tempest-TestMinimumBasicScenario-433831737-project-member</nova:user>
Nov 28 17:06:32 user nova-compute[75246]:         <nova:project uuid="2d01a3eaa26b4fc790abe7761fb2bb8a">tempest-TestMinimumBasicScenario-433831737</nova:project>
Nov 28 17:06:32 user nova-compute[75246]:       </nova:owner>
Nov 28 17:06:32 user nova-compute[75246]:       <nova:root type="image" uuid="314c5acf-fabe-491c-8951-2240751d2dd2"/>
Nov 28 17:06:32 user nova-compute[75246]:       <nova:ports>
Nov 28 17:06:32 user nova-compute[75246]:         <nova:port uuid="8932d31b-ff61-4b52-9f2d-a646560d3777">
Nov 28 17:06:32 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 17:06:32 user nova-compute[75246]:         </nova:port>
Nov 28 17:06:32 user nova-compute[75246]:       </nova:ports>
Nov 28 17:06:32 user nova-compute[75246]:     </nova:instance>
Nov 28 17:06:32 user nova-compute[75246]:   </metadata>
Nov 28 17:06:32 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:06:32 user nova-compute[75246]:     <system>
Nov 28 17:06:32 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:06:32 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:06:32 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:06:32 user nova-compute[75246]:       <entry name="serial">6579e6f5-93be-4b39-9c61-ca3dbc40b79f</entry>
Nov 28 17:06:32 user nova-compute[75246]:       <entry name="uuid">6579e6f5-93be-4b39-9c61-ca3dbc40b79f</entry>
Nov 28 17:06:32 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:06:32 user nova-compute[75246]:     </system>
Nov 28 17:06:32 user nova-compute[75246]:   </sysinfo>
Nov 28 17:06:32 user nova-compute[75246]:   <os>
Nov 28 17:06:32 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:06:32 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:06:32 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:06:32 user nova-compute[75246]:   </os>
Nov 28 17:06:32 user nova-compute[75246]:   <features>
Nov 28 17:06:32 user nova-compute[75246]:     <acpi/>
Nov 28 17:06:32 user nova-compute[75246]:     <apic/>
Nov 28 17:06:32 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:06:32 user nova-compute[75246]:   </features>
Nov 28 17:06:32 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:06:32 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:06:32 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:06:32 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:06:32 user nova-compute[75246]:   </clock>
Nov 28 17:06:32 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:06:32 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:06:32 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:06:32 user nova-compute[75246]:   </cpu>
Nov 28 17:06:32 user nova-compute[75246]:   <devices>
Nov 28 17:06:32 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:06:32 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:06:32 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk"/>
Nov 28 17:06:32 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:06:32 user nova-compute[75246]:     </disk>
Nov 28 17:06:32 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:06:32 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:06:32 user nova-compute[75246]:       <source dev="/dev/sde"/>
Nov 28 17:06:32 user nova-compute[75246]:       <target dev="vdb" bus="virtio"/>
Nov 28 17:06:32 user nova-compute[75246]:       <serial>5acc1a2e-a8b9-4914-a2c4-ee26f8a17872</serial>
Nov 28 17:06:32 user nova-compute[75246]:     </disk>
Nov 28 17:06:32 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:06:32 user nova-compute[75246]:       <mac address="fa:16:3e:2c:21:7a"/>
Nov 28 17:06:32 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:06:32 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:06:32 user nova-compute[75246]:       <target dev="tap8932d31b-ff"/>
Nov 28 17:06:32 user nova-compute[75246]:     </interface>
Nov 28 17:06:32 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:06:32 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/console.log" append="off"/>
Nov 28 17:06:32 user nova-compute[75246]:     </serial>
Nov 28 17:06:32 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:06:32 user nova-compute[75246]:     <video>
Nov 28 17:06:32 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:06:32 user nova-compute[75246]:     </video>
Nov 28 17:06:32 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:06:32 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:06:32 user nova-compute[75246]:     </rng>
Nov 28 17:06:32 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:06:32 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:06:32 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:06:32 user nova-compute[75246]:     </memballoon>
Nov 28 17:06:32 user nova-compute[75246]:   </devices>
Nov 28 17:06:32 user nova-compute[75246]: </domain>
Nov 28 17:06:32 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-25480185-8c9c-4aad-9c46-573cfbf65364" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-25480185-8c9c-4aad-9c46-573cfbf65364" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lazy-loading 'info_cache' on Instance uuid 25480185-8c9c-4aad-9c46-573cfbf65364 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG nova.objects.instance [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6579e6f5-93be-4b39-9c61-ca3dbc40b79f {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG nova.objects.base [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Object Instance<6579e6f5-93be-4b39-9c61-ca3dbc40b79f> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Updating instance_info_cache with network_info: [{"id": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "address": "fa:16:3e:85:27:7b", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c6bdcd-7c", "ovs_interfaceid": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-25480185-8c9c-4aad-9c46-573cfbf65364" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904 --force-share --output=json" returned: 0 in 0.209s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:06:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Cannot resize image /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG nova.objects.instance [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lazy-loading 'migration_context' on Instance uuid 6579e6f5-93be-4b39-9c61-ca3dbc40b79f {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG nova.objects.base [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Object Instance<6579e6f5-93be-4b39-9c61-ca3dbc40b79f> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:04:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1459152348',display_name='tempest-TestMinimumBasicScenario-server-1459152348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1459152348',id=18,image_ref='314c5acf-fabe-491c-8951-2240751d2dd2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV+cCKVKkKjippHw8fvg8ZUQ588Q45fV8SzYDVWZENrWtuGg6Vh8hnO4mjpQRK6qsK31ree66V8juizOkiDArzejhbRH/K2TpIsEaUaC5icEpgo6owAmBBXtqppX4HiNQ==',key_name='tempest-TestMinimumBasicScenario-700258823',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:04:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='2d01a3eaa26b4fc790abe7761fb2bb8a',ramdisk_id='',reservation_id='r-5f8m3x0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='314c5acf-fabe-491c-8951-2240751d2dd2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-433831737',owner_user_name='tempest-TestMinimumBasicScenario-433831737-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:06:28Z,user_data=None,user_id='194df496b87a48d68835cb7aa0802560',uuid=6579e6f5-93be-4b39-9c61-ca3dbc40b79f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Converting VIF {"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:21:7a,bridge_name='br-int',has_traffic_filtering=True,id=8932d31b-ff61-4b52-9f2d-a646560d3777,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8932d31b-ff') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG os_vif [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:21:7a,bridge_name='br-int',has_traffic_filtering=True,id=8932d31b-ff61-4b52-9f2d-a646560d3777,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8932d31b-ff') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd78c8b5a-a79a-5f18-9d8e-5242ea5db70e', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8932d31b-ff, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8932d31b-ff, col_values=(('qos', UUID('b243ec5e-95a1-4f07-b636-39493dfb7c95')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8932d31b-ff, col_values=(('external_ids', {'iface-id': '8932d31b-ff61-4b52-9f2d-a646560d3777', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:21:7a', 'vm-uuid': '6579e6f5-93be-4b39-9c61-ca3dbc40b79f'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:06:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:33 user nova-compute[75246]: INFO os_vif [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:21:7a,bridge_name='br-int',has_traffic_filtering=True,id=8932d31b-ff61-4b52-9f2d-a646560d3777,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8932d31b-ff')
Nov 28 17:06:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-2c09d090-3e5d-46c9-9373-169dad529143 req-a45b5490-270a-429b-a3eb-7292a06009d4 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received event network-vif-plugged-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:06:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2c09d090-3e5d-46c9-9373-169dad529143 req-a45b5490-270a-429b-a3eb-7292a06009d4 service nova] Acquiring lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2c09d090-3e5d-46c9-9373-169dad529143 req-a45b5490-270a-429b-a3eb-7292a06009d4 service nova] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2c09d090-3e5d-46c9-9373-169dad529143 req-a45b5490-270a-429b-a3eb-7292a06009d4 service nova] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-2c09d090-3e5d-46c9-9373-169dad529143 req-a45b5490-270a-429b-a3eb-7292a06009d4 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] No waiting events found dispatching network-vif-plugged-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:06:34 user nova-compute[75246]: WARNING nova.compute.manager [req-2c09d090-3e5d-46c9-9373-169dad529143 req-a45b5490-270a-429b-a3eb-7292a06009d4 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received unexpected event network-vif-plugged-8932d31b-ff61-4b52-9f2d-a646560d3777 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 17:06:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:06:36 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Instance rebooted successfully.
Nov 28 17:06:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:06:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-5b3b40c6-70f3-4cd3-8640-b50f2bb6bf38 req-40faa947-3acf-4807-9f3c-ba67a092a25d service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received event network-vif-plugged-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:06:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5b3b40c6-70f3-4cd3-8640-b50f2bb6bf38 req-40faa947-3acf-4807-9f3c-ba67a092a25d service nova] Acquiring lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5b3b40c6-70f3-4cd3-8640-b50f2bb6bf38 req-40faa947-3acf-4807-9f3c-ba67a092a25d service nova] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5b3b40c6-70f3-4cd3-8640-b50f2bb6bf38 req-40faa947-3acf-4807-9f3c-ba67a092a25d service nova] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-5b3b40c6-70f3-4cd3-8640-b50f2bb6bf38 req-40faa947-3acf-4807-9f3c-ba67a092a25d service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] No waiting events found dispatching network-vif-plugged-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:06:36 user nova-compute[75246]: WARNING nova.compute.manager [req-5b3b40c6-70f3-4cd3-8640-b50f2bb6bf38 req-40faa947-3acf-4807-9f3c-ba67a092a25d service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received unexpected event network-vif-plugged-8932d31b-ff61-4b52-9f2d-a646560d3777 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 17:06:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5c9d2d99-1dd8-43d8-9673-efc14f7df6af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.641s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-0d91af8e-9442-4837-bc87-a977ec9a0a75 req-299d0b6e-939f-40ff-9e7c-5cc45fd5ec12 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received event network-changed-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:06:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-0d91af8e-9442-4837-bc87-a977ec9a0a75 req-299d0b6e-939f-40ff-9e7c-5cc45fd5ec12 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Refreshing instance network info cache due to event network-changed-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:06:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0d91af8e-9442-4837-bc87-a977ec9a0a75 req-299d0b6e-939f-40ff-9e7c-5cc45fd5ec12 service nova] Acquiring lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:06:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0d91af8e-9442-4837-bc87-a977ec9a0a75 req-299d0b6e-939f-40ff-9e7c-5cc45fd5ec12 service nova] Acquired lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:06:45 user nova-compute[75246]: DEBUG nova.network.neutron [req-0d91af8e-9442-4837-bc87-a977ec9a0a75 req-299d0b6e-939f-40ff-9e7c-5cc45fd5ec12 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Refreshing network info cache for port ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:06:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-0d91af8e-9442-4837-bc87-a977ec9a0a75 req-299d0b6e-939f-40ff-9e7c-5cc45fd5ec12 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Updated VIF entry in instance network info cache for port ebb7a52b-f2f1-43e8-bea2-02a136b62aa1. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:06:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-0d91af8e-9442-4837-bc87-a977ec9a0a75 req-299d0b6e-939f-40ff-9e7c-5cc45fd5ec12 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Updating instance_info_cache with network_info: [{"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:06:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0d91af8e-9442-4837-bc87-a977ec9a0a75 req-299d0b6e-939f-40ff-9e7c-5cc45fd5ec12 service nova] Releasing lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:06:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "0d952de1-8c78-4bea-853d-21ac4f979845" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "0d952de1-8c78-4bea-853d-21ac4f979845" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:49 user nova-compute[75246]: INFO nova.compute.manager [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Shelving
Nov 28 17:06:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:50 user nova-compute[75246]: DEBUG nova.compute.manager [req-3da7a4cb-7ba5-48be-8b36-865c379e56fd req-0deeca27-30b5-42d7-a7e5-bec6dc936993 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received event network-vif-unplugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:06:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3da7a4cb-7ba5-48be-8b36-865c379e56fd req-0deeca27-30b5-42d7-a7e5-bec6dc936993 service nova] Acquiring lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3da7a4cb-7ba5-48be-8b36-865c379e56fd req-0deeca27-30b5-42d7-a7e5-bec6dc936993 service nova] Lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3da7a4cb-7ba5-48be-8b36-865c379e56fd req-0deeca27-30b5-42d7-a7e5-bec6dc936993 service nova] Lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:50 user nova-compute[75246]: DEBUG nova.compute.manager [req-3da7a4cb-7ba5-48be-8b36-865c379e56fd req-0deeca27-30b5-42d7-a7e5-bec6dc936993 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] No waiting events found dispatching network-vif-unplugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:06:50 user nova-compute[75246]: WARNING nova.compute.manager [req-3da7a4cb-7ba5-48be-8b36-865c379e56fd req-0deeca27-30b5-42d7-a7e5-bec6dc936993 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received unexpected event network-vif-unplugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 for instance with vm_state active and task_state shelving.
Nov 28 17:06:50 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Instance destroyed successfully.
Nov 28 17:06:50 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Beginning cold snapshot process
Nov 28 17:06:50 user nova-compute[75246]: DEBUG nova.privsep.utils [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75246) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 17:06:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk /opt/stack/data/nova/instances/snapshots/tmpizbz3xqy/0b4faac4773247d885387f1bd2ef868e {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:51 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk /opt/stack/data/nova/instances/snapshots/tmpizbz3xqy/0b4faac4773247d885387f1bd2ef868e" returned: 0 in 1.313s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:51 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Snapshot extracted, beginning image upload
Nov 28 17:06:52 user nova-compute[75246]: DEBUG nova.compute.manager [req-5e065c74-cf4d-452e-8fbf-807f8c6ddda6 req-53db8be9-03ff-4e2b-a236-161a163a9cbe service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received event network-vif-plugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:06:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5e065c74-cf4d-452e-8fbf-807f8c6ddda6 req-53db8be9-03ff-4e2b-a236-161a163a9cbe service nova] Acquiring lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5e065c74-cf4d-452e-8fbf-807f8c6ddda6 req-53db8be9-03ff-4e2b-a236-161a163a9cbe service nova] Lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5e065c74-cf4d-452e-8fbf-807f8c6ddda6 req-53db8be9-03ff-4e2b-a236-161a163a9cbe service nova] Lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:52 user nova-compute[75246]: DEBUG nova.compute.manager [req-5e065c74-cf4d-452e-8fbf-807f8c6ddda6 req-53db8be9-03ff-4e2b-a236-161a163a9cbe service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] No waiting events found dispatching network-vif-plugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:06:52 user nova-compute[75246]: WARNING nova.compute.manager [req-5e065c74-cf4d-452e-8fbf-807f8c6ddda6 req-53db8be9-03ff-4e2b-a236-161a163a9cbe service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received unexpected event network-vif-plugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 17:06:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:54 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Snapshot image upload complete
Nov 28 17:06:54 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:06:54 user nova-compute[75246]: INFO nova.compute.manager [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Shelve offloading
Nov 28 17:06:54 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Instance destroyed successfully.
Nov 28 17:06:54 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:06:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:06:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquired lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:06:54 user nova-compute[75246]: DEBUG nova.network.neutron [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:06:55 user nova-compute[75246]: DEBUG nova.network.neutron [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Updating instance_info_cache with network_info: [{"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:06:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Releasing lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:06:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:56 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Instance destroyed successfully.
Nov 28 17:06:56 user nova-compute[75246]: DEBUG nova.objects.instance [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'resources' on Instance uuid 0d952de1-8c78-4bea-853d-21ac4f979845 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-278996386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-278996386',id=19,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/npncOA40T5UkpCTyoa9FE5URXN0CYEj19/p021hTQeiVdLEH7PgJXMG03aUYxg6AGun6gVIWPfrOtmZUotLJEBPXKB78yX8pcTgDSssDMf4QF1Q6mL0Cbl/SHy8/Bng==',key_name='tempest-keypair-1103265416',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:05:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cd94665acd9a4448a1ad1350d71d8f72',ramdisk_id='',reservation_id='r-eelgg57i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726606277',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726606277-project-member',shelved_at='2023-11-28T17:06:54.713346',shelved_host='user',shelved_image_id='7930335a-9c24-4815-9763-7044275f3f1b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ed095223674edebcee82e4183c8ea0',uuid=0d952de1-8c78-4bea-853d-21ac4f979845,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converting VIF {"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:37:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebb7a52b-f2f1-43e8-bea2-02a136b62aa1,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb7a52b-f2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG os_vif [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:37:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebb7a52b-f2f1-43e8-bea2-02a136b62aa1,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb7a52b-f2') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebb7a52b-f2, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbdd079e-f7ea-40a5-bb81-4731c70b54fa) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:06:56 user nova-compute[75246]: INFO os_vif [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:37:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebb7a52b-f2f1-43e8-bea2-02a136b62aa1,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb7a52b-f2')
Nov 28 17:06:56 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Deleting instance files /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845_del
Nov 28 17:06:56 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Deletion of /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845_del complete
Nov 28 17:06:56 user nova-compute[75246]: DEBUG nova.compute.manager [req-c5a91308-1264-4455-ba64-0608a1ca2d69 req-d396c809-3285-4e05-8fa8-ee57c59b4e12 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received event network-changed-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG nova.compute.manager [req-c5a91308-1264-4455-ba64-0608a1ca2d69 req-d396c809-3285-4e05-8fa8-ee57c59b4e12 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Refreshing instance network info cache due to event network-changed-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c5a91308-1264-4455-ba64-0608a1ca2d69 req-d396c809-3285-4e05-8fa8-ee57c59b4e12 service nova] Acquiring lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c5a91308-1264-4455-ba64-0608a1ca2d69 req-d396c809-3285-4e05-8fa8-ee57c59b4e12 service nova] Acquired lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG nova.network.neutron [req-c5a91308-1264-4455-ba64-0608a1ca2d69 req-d396c809-3285-4e05-8fa8-ee57c59b4e12 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Refreshing network info cache for port ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:06:56 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Deleted allocations for instance 0d952de1-8c78-4bea-853d-21ac4f979845
Nov 28 17:06:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG nova.objects.instance [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'numa_topology' on Instance uuid 0d952de1-8c78-4bea-853d-21ac4f979845 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG nova.objects.base [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Object Instance<0d952de1-8c78-4bea-853d-21ac4f979845> lazy-loaded attributes: resources,numa_topology {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:06:56 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:06:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2d582c24-7a0f-41f3-9957-abf85f4f77a0 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "0d952de1-8c78-4bea-853d-21ac4f979845" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.400s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:57 user nova-compute[75246]: DEBUG nova.network.neutron [req-c5a91308-1264-4455-ba64-0608a1ca2d69 req-d396c809-3285-4e05-8fa8-ee57c59b4e12 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Updated VIF entry in instance network info cache for port ebb7a52b-f2f1-43e8-bea2-02a136b62aa1. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:06:57 user nova-compute[75246]: DEBUG nova.network.neutron [req-c5a91308-1264-4455-ba64-0608a1ca2d69 req-d396c809-3285-4e05-8fa8-ee57c59b4e12 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Updating instance_info_cache with network_info: [{"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:06:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c5a91308-1264-4455-ba64-0608a1ca2d69 req-d396c809-3285-4e05-8fa8-ee57c59b4e12 service nova] Releasing lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:06:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Acquiring lock "38451776-a726-4569-84c2-10874b488951" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "38451776-a726-4569-84c2-10874b488951" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:58 user nova-compute[75246]: DEBUG nova.compute.manager [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:06:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:06:58 user nova-compute[75246]: INFO nova.compute.claims [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Claim successful on node user
Nov 28 17:06:59 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:06:59 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:06:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.632s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:59 user nova-compute[75246]: DEBUG nova.compute.manager [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:06:59 user nova-compute[75246]: DEBUG nova.compute.manager [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:06:59 user nova-compute[75246]: DEBUG nova.network.neutron [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:06:59 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:06:59 user nova-compute[75246]: DEBUG nova.compute.manager [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:06:59 user nova-compute[75246]: DEBUG nova.policy [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc4a3d8c43d346e6be22348e0de295fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60190867db3f422fa01488fa7d82312d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:06:59 user nova-compute[75246]: DEBUG nova.compute.manager [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:06:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:06:59 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Creating image(s)
Nov 28 17:06:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Acquiring lock "/opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "/opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "/opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:06:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:06:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:06:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:06:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.167s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:06:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/disk 1073741824" returned: 0 in 0.107s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG nova.network.neutron [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Successfully created port: 1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Cannot resize image /opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Ensure instance console log exists: /opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG nova.network.neutron [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Successfully updated port: 1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Acquiring lock "refresh_cache-38451776-a726-4569-84c2-10874b488951" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Acquired lock "refresh_cache-38451776-a726-4569-84c2-10874b488951" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG nova.network.neutron [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-8e9ea70a-203e-4386-9ca1-0937dcefc108 req-63960a84-9478-4185-a589-55b615b8c023 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Received event network-changed-1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-8e9ea70a-203e-4386-9ca1-0937dcefc108 req-63960a84-9478-4185-a589-55b615b8c023 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Refreshing instance network info cache due to event network-changed-1ea4c6c1-ca0a-41b6-a71c-092df222da26. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8e9ea70a-203e-4386-9ca1-0937dcefc108 req-63960a84-9478-4185-a589-55b615b8c023 service nova] Acquiring lock "refresh_cache-38451776-a726-4569-84c2-10874b488951" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:07:00 user nova-compute[75246]: DEBUG nova.network.neutron [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.network.neutron [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Updating instance_info_cache with network_info: [{"id": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "address": "fa:16:3e:07:11:a4", "network": {"id": "b61eb188-49c5-416d-85f3-59eff43477be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-19142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60190867db3f422fa01488fa7d82312d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea4c6c1-ca", "ovs_interfaceid": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Releasing lock "refresh_cache-38451776-a726-4569-84c2-10874b488951" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.compute.manager [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Instance network_info: |[{"id": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "address": "fa:16:3e:07:11:a4", "network": {"id": "b61eb188-49c5-416d-85f3-59eff43477be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-19142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60190867db3f422fa01488fa7d82312d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea4c6c1-ca", "ovs_interfaceid": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8e9ea70a-203e-4386-9ca1-0937dcefc108 req-63960a84-9478-4185-a589-55b615b8c023 service nova] Acquired lock "refresh_cache-38451776-a726-4569-84c2-10874b488951" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.network.neutron [req-8e9ea70a-203e-4386-9ca1-0937dcefc108 req-63960a84-9478-4185-a589-55b615b8c023 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Refreshing network info cache for port 1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Start _get_guest_xml network_info=[{"id": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "address": "fa:16:3e:07:11:a4", "network": {"id": "b61eb188-49c5-416d-85f3-59eff43477be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-19142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60190867db3f422fa01488fa7d82312d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea4c6c1-ca", "ovs_interfaceid": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:07:01 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:07:01 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2095782534',display_name='tempest-DeleteServersTestJSON-server-2095782534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2095782534',id=21,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60190867db3f422fa01488fa7d82312d',ramdisk_id='',reservation_id='r-82h84glh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1079323567',owner_user_name='tempest-DeleteServersTestJSON-1079323567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:06:59Z,user_data=None,user_id='fc4a3d8c43d346e6be22348e0de295fa',uuid=38451776-a726-4569-84c2-10874b488951,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "address": "fa:16:3e:07:11:a4", "network": {"id": "b61eb188-49c5-416d-85f3-59eff43477be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-19142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60190867db3f422fa01488fa7d82312d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea4c6c1-ca", "ovs_interfaceid": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Converting VIF {"id": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "address": "fa:16:3e:07:11:a4", "network": {"id": "b61eb188-49c5-416d-85f3-59eff43477be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-19142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60190867db3f422fa01488fa7d82312d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea4c6c1-ca", "ovs_interfaceid": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:11:a4,bridge_name='br-int',has_traffic_filtering=True,id=1ea4c6c1-ca0a-41b6-a71c-092df222da26,network=Network(b61eb188-49c5-416d-85f3-59eff43477be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ea4c6c1-ca') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.objects.instance [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lazy-loading 'pci_devices' on Instance uuid 38451776-a726-4569-84c2-10874b488951 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:07:01 user nova-compute[75246]:   <uuid>38451776-a726-4569-84c2-10874b488951</uuid>
Nov 28 17:07:01 user nova-compute[75246]:   <name>instance-00000015</name>
Nov 28 17:07:01 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:07:01 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:07:01 user nova-compute[75246]:   <metadata>
Nov 28 17:07:01 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:07:01 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:07:01 user nova-compute[75246]:       <nova:name>tempest-DeleteServersTestJSON-server-2095782534</nova:name>
Nov 28 17:07:01 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:07:01</nova:creationTime>
Nov 28 17:07:01 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:07:01 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:07:01 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:07:01 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:07:01 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:07:01 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:07:01 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:07:01 user nova-compute[75246]:       <nova:owner>
Nov 28 17:07:01 user nova-compute[75246]:         <nova:user uuid="fc4a3d8c43d346e6be22348e0de295fa">tempest-DeleteServersTestJSON-1079323567-project-member</nova:user>
Nov 28 17:07:01 user nova-compute[75246]:         <nova:project uuid="60190867db3f422fa01488fa7d82312d">tempest-DeleteServersTestJSON-1079323567</nova:project>
Nov 28 17:07:01 user nova-compute[75246]:       </nova:owner>
Nov 28 17:07:01 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:07:01 user nova-compute[75246]:       <nova:ports>
Nov 28 17:07:01 user nova-compute[75246]:         <nova:port uuid="1ea4c6c1-ca0a-41b6-a71c-092df222da26">
Nov 28 17:07:01 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 17:07:01 user nova-compute[75246]:         </nova:port>
Nov 28 17:07:01 user nova-compute[75246]:       </nova:ports>
Nov 28 17:07:01 user nova-compute[75246]:     </nova:instance>
Nov 28 17:07:01 user nova-compute[75246]:   </metadata>
Nov 28 17:07:01 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:07:01 user nova-compute[75246]:     <system>
Nov 28 17:07:01 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:07:01 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:07:01 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:07:01 user nova-compute[75246]:       <entry name="serial">38451776-a726-4569-84c2-10874b488951</entry>
Nov 28 17:07:01 user nova-compute[75246]:       <entry name="uuid">38451776-a726-4569-84c2-10874b488951</entry>
Nov 28 17:07:01 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:07:01 user nova-compute[75246]:     </system>
Nov 28 17:07:01 user nova-compute[75246]:   </sysinfo>
Nov 28 17:07:01 user nova-compute[75246]:   <os>
Nov 28 17:07:01 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:07:01 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:07:01 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:07:01 user nova-compute[75246]:   </os>
Nov 28 17:07:01 user nova-compute[75246]:   <features>
Nov 28 17:07:01 user nova-compute[75246]:     <acpi/>
Nov 28 17:07:01 user nova-compute[75246]:     <apic/>
Nov 28 17:07:01 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:07:01 user nova-compute[75246]:   </features>
Nov 28 17:07:01 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:07:01 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:07:01 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:07:01 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:07:01 user nova-compute[75246]:   </clock>
Nov 28 17:07:01 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:07:01 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:07:01 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:07:01 user nova-compute[75246]:   </cpu>
Nov 28 17:07:01 user nova-compute[75246]:   <devices>
Nov 28 17:07:01 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:07:01 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:07:01 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/disk"/>
Nov 28 17:07:01 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:07:01 user nova-compute[75246]:     </disk>
Nov 28 17:07:01 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:07:01 user nova-compute[75246]:       <mac address="fa:16:3e:07:11:a4"/>
Nov 28 17:07:01 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:07:01 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:07:01 user nova-compute[75246]:       <target dev="tap1ea4c6c1-ca"/>
Nov 28 17:07:01 user nova-compute[75246]:     </interface>
Nov 28 17:07:01 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:07:01 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/console.log" append="off"/>
Nov 28 17:07:01 user nova-compute[75246]:     </serial>
Nov 28 17:07:01 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:07:01 user nova-compute[75246]:     <video>
Nov 28 17:07:01 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:07:01 user nova-compute[75246]:     </video>
Nov 28 17:07:01 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:07:01 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:07:01 user nova-compute[75246]:     </rng>
Nov 28 17:07:01 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:07:01 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:07:01 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:07:01 user nova-compute[75246]:     </memballoon>
Nov 28 17:07:01 user nova-compute[75246]:   </devices>
Nov 28 17:07:01 user nova-compute[75246]: </domain>
Nov 28 17:07:01 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2095782534',display_name='tempest-DeleteServersTestJSON-server-2095782534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2095782534',id=21,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60190867db3f422fa01488fa7d82312d',ramdisk_id='',reservation_id='r-82h84glh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1079323567',owner_user_name='tempest-DeleteServersTestJSON-1079323567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:06:59Z,user_data=None,user_id='fc4a3d8c43d346e6be22348e0de295fa',uuid=38451776-a726-4569-84c2-10874b488951,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "address": "fa:16:3e:07:11:a4", "network": {"id": "b61eb188-49c5-416d-85f3-59eff43477be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-19142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60190867db3f422fa01488fa7d82312d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea4c6c1-ca", "ovs_interfaceid": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Converting VIF {"id": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "address": "fa:16:3e:07:11:a4", "network": {"id": "b61eb188-49c5-416d-85f3-59eff43477be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-19142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60190867db3f422fa01488fa7d82312d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea4c6c1-ca", "ovs_interfaceid": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:11:a4,bridge_name='br-int',has_traffic_filtering=True,id=1ea4c6c1-ca0a-41b6-a71c-092df222da26,network=Network(b61eb188-49c5-416d-85f3-59eff43477be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ea4c6c1-ca') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG os_vif [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:11:a4,bridge_name='br-int',has_traffic_filtering=True,id=1ea4c6c1-ca0a-41b6-a71c-092df222da26,network=Network(b61eb188-49c5-416d-85f3-59eff43477be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ea4c6c1-ca') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '518faa18-3264-5aa2-ac1e-83bf4b683918', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ea4c6c1-ca, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ea4c6c1-ca, col_values=(('qos', UUID('57de51e7-3642-4b46-966b-0832801e70be')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ea4c6c1-ca, col_values=(('external_ids', {'iface-id': '1ea4c6c1-ca0a-41b6-a71c-092df222da26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:11:a4', 'vm-uuid': '38451776-a726-4569-84c2-10874b488951'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:01 user nova-compute[75246]: INFO os_vif [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:11:a4,bridge_name='br-int',has_traffic_filtering=True,id=1ea4c6c1-ca0a-41b6-a71c-092df222da26,network=Network(b61eb188-49c5-416d-85f3-59eff43477be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ea4c6c1-ca')
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] No VIF found with MAC fa:16:3e:07:11:a4, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.network.neutron [req-8e9ea70a-203e-4386-9ca1-0937dcefc108 req-63960a84-9478-4185-a589-55b615b8c023 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Updated VIF entry in instance network info cache for port 1ea4c6c1-ca0a-41b6-a71c-092df222da26. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG nova.network.neutron [req-8e9ea70a-203e-4386-9ca1-0937dcefc108 req-63960a84-9478-4185-a589-55b615b8c023 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Updating instance_info_cache with network_info: [{"id": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "address": "fa:16:3e:07:11:a4", "network": {"id": "b61eb188-49c5-416d-85f3-59eff43477be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-19142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60190867db3f422fa01488fa7d82312d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea4c6c1-ca", "ovs_interfaceid": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:07:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8e9ea70a-203e-4386-9ca1-0937dcefc108 req-63960a84-9478-4185-a589-55b615b8c023 service nova] Releasing lock "refresh_cache-38451776-a726-4569-84c2-10874b488951" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:07:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-fa2aa6c9-40c2-449f-830d-6476702ced31 req-76b94ba4-e238-440c-b849-3d5f79e0e400 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Received event network-vif-plugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:07:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fa2aa6c9-40c2-449f-830d-6476702ced31 req-76b94ba4-e238-440c-b849-3d5f79e0e400 service nova] Acquiring lock "38451776-a726-4569-84c2-10874b488951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fa2aa6c9-40c2-449f-830d-6476702ced31 req-76b94ba4-e238-440c-b849-3d5f79e0e400 service nova] Lock "38451776-a726-4569-84c2-10874b488951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fa2aa6c9-40c2-449f-830d-6476702ced31 req-76b94ba4-e238-440c-b849-3d5f79e0e400 service nova] Lock "38451776-a726-4569-84c2-10874b488951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-fa2aa6c9-40c2-449f-830d-6476702ced31 req-76b94ba4-e238-440c-b849-3d5f79e0e400 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] No waiting events found dispatching network-vif-plugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:07:03 user nova-compute[75246]: WARNING nova.compute.manager [req-fa2aa6c9-40c2-449f-830d-6476702ced31 req-76b94ba4-e238-440c-b849-3d5f79e0e400 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Received unexpected event network-vif-plugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 for instance with vm_state building and task_state spawning.
Nov 28 17:07:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-e4d00027-13d2-42c0-a3ad-0546c427a6b0 req-02e0d356-8c50-43e7-810b-bb6f7c809854 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Received event network-vif-plugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:07:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e4d00027-13d2-42c0-a3ad-0546c427a6b0 req-02e0d356-8c50-43e7-810b-bb6f7c809854 service nova] Acquiring lock "38451776-a726-4569-84c2-10874b488951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e4d00027-13d2-42c0-a3ad-0546c427a6b0 req-02e0d356-8c50-43e7-810b-bb6f7c809854 service nova] Lock "38451776-a726-4569-84c2-10874b488951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e4d00027-13d2-42c0-a3ad-0546c427a6b0 req-02e0d356-8c50-43e7-810b-bb6f7c809854 service nova] Lock "38451776-a726-4569-84c2-10874b488951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-e4d00027-13d2-42c0-a3ad-0546c427a6b0 req-02e0d356-8c50-43e7-810b-bb6f7c809854 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] No waiting events found dispatching network-vif-plugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:07:05 user nova-compute[75246]: WARNING nova.compute.manager [req-e4d00027-13d2-42c0-a3ad-0546c427a6b0 req-02e0d356-8c50-43e7-810b-bb6f7c809854 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Received unexpected event network-vif-plugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 for instance with vm_state building and task_state spawning.
Nov 28 17:07:05 user nova-compute[75246]: DEBUG nova.compute.manager [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:07:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:07:05 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 38451776-a726-4569-84c2-10874b488951] Instance spawned successfully.
Nov 28 17:07:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:07:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:07:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:07:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:07:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:07:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:07:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:07:05 user nova-compute[75246]: INFO nova.compute.manager [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 28 17:07:05 user nova-compute[75246]: DEBUG nova.compute.manager [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:07:05 user nova-compute[75246]: INFO nova.compute.manager [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Took 6.76 seconds to build instance.
Nov 28 17:07:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-caf11c93-639f-4c6b-a490-61bfb48f6fc9 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "38451776-a726-4569-84c2-10874b488951" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.857s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-77f0a6b6-a622-4287-80e3-71c6d3e5cf05 req-ec505ad4-2ef8-44a4-8f21-8e207ef6fb43 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-changed-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-77f0a6b6-a622-4287-80e3-71c6d3e5cf05 req-ec505ad4-2ef8-44a4-8f21-8e207ef6fb43 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Refreshing instance network info cache due to event network-changed-068da4fa-d42e-47e8-8e7e-81bda7521356. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-77f0a6b6-a622-4287-80e3-71c6d3e5cf05 req-ec505ad4-2ef8-44a4-8f21-8e207ef6fb43 service nova] Acquiring lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-77f0a6b6-a622-4287-80e3-71c6d3e5cf05 req-ec505ad4-2ef8-44a4-8f21-8e207ef6fb43 service nova] Acquired lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG nova.network.neutron [req-77f0a6b6-a622-4287-80e3-71c6d3e5cf05 req-ec505ad4-2ef8-44a4-8f21-8e207ef6fb43 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Refreshing network info cache for port 068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "69f05219-5034-4e88-879c-9c567e2c2fcd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:14 user nova-compute[75246]: INFO nova.compute.manager [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Terminating instance
Nov 28 17:07:14 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-727074e9-dd9b-4725-90ca-0d108ac7f336 req-9472a8f0-226d-458a-98a7-6698815d7295 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-vif-unplugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-727074e9-dd9b-4725-90ca-0d108ac7f336 req-9472a8f0-226d-458a-98a7-6698815d7295 service nova] Acquiring lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-727074e9-dd9b-4725-90ca-0d108ac7f336 req-9472a8f0-226d-458a-98a7-6698815d7295 service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-727074e9-dd9b-4725-90ca-0d108ac7f336 req-9472a8f0-226d-458a-98a7-6698815d7295 service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-727074e9-dd9b-4725-90ca-0d108ac7f336 req-9472a8f0-226d-458a-98a7-6698815d7295 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] No waiting events found dispatching network-vif-unplugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-727074e9-dd9b-4725-90ca-0d108ac7f336 req-9472a8f0-226d-458a-98a7-6698815d7295 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-vif-unplugged-068da4fa-d42e-47e8-8e7e-81bda7521356 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG nova.network.neutron [req-77f0a6b6-a622-4287-80e3-71c6d3e5cf05 req-ec505ad4-2ef8-44a4-8f21-8e207ef6fb43 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Updated VIF entry in instance network info cache for port 068da4fa-d42e-47e8-8e7e-81bda7521356. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG nova.network.neutron [req-77f0a6b6-a622-4287-80e3-71c6d3e5cf05 req-ec505ad4-2ef8-44a4-8f21-8e207ef6fb43 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Updating instance_info_cache with network_info: [{"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-77f0a6b6-a622-4287-80e3-71c6d3e5cf05 req-ec505ad4-2ef8-44a4-8f21-8e207ef6fb43 service nova] Releasing lock "refresh_cache-69f05219-5034-4e88-879c-9c567e2c2fcd" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:15 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Instance destroyed successfully.
Nov 28 17:07:15 user nova-compute[75246]: DEBUG nova.objects.instance [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lazy-loading 'resources' on Instance uuid 69f05219-5034-4e88-879c-9c567e2c2fcd {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T17:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-261959295',display_name='tempest-TestShelveInstance-server-261959295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-261959295',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSXhLKm+++wgAM7YsUZWQNI57Qq/Uvo2sGpCIC0eWLA3a2G9dj59rvWwSkvl7YMi6fzuXFku8/GYlW1BRbrTLvl4ZqaNoDq5vRDvO38j64HIwGgl9GxlRYNZCFpgggI0Q==',key_name='tempest-TestShelveInstance-1911568956',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:05:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='572ea174564b4afdbf607e501e025fd8',ramdisk_id='',reservation_id='r-hodplmom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-640383248',owner_user_name='tempest-TestShelveInstance-640383248-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:05:41Z,user_data=None,user_id='58d26618e4064fedb1bd65d14920652d',uuid=69f05219-5034-4e88-879c-9c567e2c2fcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Converting VIF {"id": "068da4fa-d42e-47e8-8e7e-81bda7521356", "address": "fa:16:3e:bc:e6:81", "network": {"id": "5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-1402894848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572ea174564b4afdbf607e501e025fd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068da4fa-d4", "ovs_interfaceid": "068da4fa-d42e-47e8-8e7e-81bda7521356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e6:81,bridge_name='br-int',has_traffic_filtering=True,id=068da4fa-d42e-47e8-8e7e-81bda7521356,network=Network(5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068da4fa-d4') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_vif [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e6:81,bridge_name='br-int',has_traffic_filtering=True,id=068da4fa-d42e-47e8-8e7e-81bda7521356,network=Network(5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068da4fa-d4') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap068da4fa-d4, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d07b903-7e89-4787-b8ad-bf9cc7e6f2d5) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:15 user nova-compute[75246]: INFO os_vif [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e6:81,bridge_name='br-int',has_traffic_filtering=True,id=068da4fa-d42e-47e8-8e7e-81bda7521356,network=Network(5402f257-16a7-4e6c-b2a3-6c60cd3ae6d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068da4fa-d4')
Nov 28 17:07:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJLxnbkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:07:15 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[038fa9ff-fad7-4b5d-81b9-678d2ed877c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:07:15 user nova-compute[75246]: No targets found.
Nov 28 17:07:15 user nova-compute[75246]: iSNS:
Nov 28 17:07:15 user nova-compute[75246]: No targets found.
Nov 28 17:07:15 user nova-compute[75246]: STATIC:
Nov 28 17:07:15 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f
Nov 28 17:07:15 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:07:15 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:07:15 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353
Nov 28 17:07:15 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:07:15 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:07:15 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872
Nov 28 17:07:15 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:07:15 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:07:15 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4
Nov 28 17:07:15 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:07:15 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:07:15 user nova-compute[75246]: FIRMWARE:
Nov 28 17:07:15 user nova-compute[75246]: No targets found.
Nov 28 17:07:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:07:15 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:07:15 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6f801a-af5c-442c-9189-52f77b71b4e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a8812f-5dc6-41dc-a683-0c2e86870f35]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:07:15 user nova-compute[75246]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:07:15 user nova-compute[75246]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:07:15 user nova-compute[75246]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)
Nov 28 17:07:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 (non-flash)
Nov 28 17:07:15 user nova-compute[75246]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:07:15 user nova-compute[75246]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:07:15 user nova-compute[75246]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)
Nov 28 17:07:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f8cf3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353'): ({'sdb'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Removing single pathed devices sdb {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a668db-0fc8-41f5-b48b-02b624edb1c5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c6b60e-4cb2-4b2d-9d72-df79104a0cba]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Flushing IO for device /dev/sdb {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2e8015-484d-4cbf-86cf-91ea0f552f46]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed446ca-dac8-4cca-b1fe-f05aa6bd22e4]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3916fc-b18d-4de7-bcc5-af91acd4ded9]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[01468b74-9ed9-4a3e-b2d0-51e15661e2f9]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353, portal: 172.16.0.220,3260]
Nov 28 17:07:15 user nova-compute[75246]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353, portal: 172.16.0.220,3260] successful.
Nov 28 17:07:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c19619d-66f3-460c-bc79-0a5f3b019156]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] <== disconnect_volume: return (320ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:07:15 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Deleting instance files /opt/stack/data/nova/instances/69f05219-5034-4e88-879c-9c567e2c2fcd_del
Nov 28 17:07:15 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Deletion of /opt/stack/data/nova/instances/69f05219-5034-4e88-879c-9c567e2c2fcd_del complete
Nov 28 17:07:15 user nova-compute[75246]: INFO nova.compute.manager [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 28 17:07:15 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:15 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:07:16 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Took 0.58 seconds to deallocate network for instance.
Nov 28 17:07:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-ceb3722c-deb0-4e3b-a144-b4d7f6b97f63 req-a97bc4ab-4f2b-4f42-add1-1d941f69b415 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:07:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ceb3722c-deb0-4e3b-a144-b4d7f6b97f63 req-a97bc4ab-4f2b-4f42-add1-1d941f69b415 service nova] Acquiring lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ceb3722c-deb0-4e3b-a144-b4d7f6b97f63 req-a97bc4ab-4f2b-4f42-add1-1d941f69b415 service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ceb3722c-deb0-4e3b-a144-b4d7f6b97f63 req-a97bc4ab-4f2b-4f42-add1-1d941f69b415 service nova] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-ceb3722c-deb0-4e3b-a144-b4d7f6b97f63 req-a97bc4ab-4f2b-4f42-add1-1d941f69b415 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] No waiting events found dispatching network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:07:16 user nova-compute[75246]: WARNING nova.compute.manager [req-ceb3722c-deb0-4e3b-a144-b4d7f6b97f63 req-a97bc4ab-4f2b-4f42-add1-1d941f69b415 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received unexpected event network-vif-plugged-068da4fa-d42e-47e8-8e7e-81bda7521356 for instance with vm_state active and task_state deleting.
Nov 28 17:07:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-ceb3722c-deb0-4e3b-a144-b4d7f6b97f63 req-a97bc4ab-4f2b-4f42-add1-1d941f69b415 service nova] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Received event network-vif-deleted-068da4fa-d42e-47e8-8e7e-81bda7521356 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:07:16 user nova-compute[75246]: INFO nova.compute.manager [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Took 0.95 seconds to detach 1 volumes for instance.
Nov 28 17:07:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] [instance: 69f05219-5034-4e88-879c-9c567e2c2fcd] Deleting volume: 73cc7ca3-6f29-46f6-9e6a-d6d526dc6353 {{(pid=75246) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 17:07:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:17 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:07:17 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:07:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:17 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Deleted allocations for instance 69f05219-5034-4e88-879c-9c567e2c2fcd
Nov 28 17:07:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ab2b1e94-79d7-47d4-b828-12cc4afeb72e tempest-TestShelveInstance-640383248 tempest-TestShelveInstance-640383248-project-member] Lock "69f05219-5034-4e88-879c-9c567e2c2fcd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.493s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:21 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:07:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:24 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:07:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:25 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:07:25 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:07:25 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:07:25 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:07:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:26 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:07:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:07:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:28 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:07:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:29 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:07:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:30 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:07:30 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:07:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=7485MB free_disk=25.43694305419922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 25480185-8c9c-4aad-9c46-573cfbf65364 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e1266470-c182-4c0c-a575-4c5043f54745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 86142721-b9dd-44ab-b994-f81443b5383c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 4b650a57-5870-4f77-bca2-abe50d970b40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c94900af-f484-47bf-8627-8aa863334b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 6579e6f5-93be-4b39-9c61-ca3dbc40b79f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 3d274f78-239a-4a85-b850-ba82025d554d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 38451776-a726-4569-84c2-10874b488951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:07:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Acquiring lock "201f0afe-8508-4357-8786-f62b70866aae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "201f0afe-8508-4357-8786-f62b70866aae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:31 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:07:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:31 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:07:31 user nova-compute[75246]: INFO nova.compute.claims [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Claim successful on node user
Nov 28 17:07:31 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:07:31 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:07:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:31 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:07:31 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:07:31 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:07:31 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:07:31 user nova-compute[75246]: DEBUG nova.network.neutron [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:07:31 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:07:31 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG nova.policy [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52fa83aab7634d1296bdc99455ab2a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2faaf456953448b8b999ce71bfae9478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:07:32 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Creating image(s)
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Acquiring lock "/opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "/opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "/opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.199s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk 1073741824" returned: 0 in 0.055s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.185s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Checking if we can resize image /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Updating instance_info_cache with network_info: [{"id": "459bf491-d464-42b1-be6c-282af882a38d", "address": "fa:16:3e:4f:20:c2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459bf491-d4", "ovs_interfaceid": "459bf491-d464-42b1-be6c-282af882a38d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG nova.network.neutron [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Successfully created port: c3201b44-4689-4e0e-8fcd-1e9bd2de0279 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Cannot resize image /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Ensure instance console log exists: /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.network.neutron [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Successfully updated port: c3201b44-4689-4e0e-8fcd-1e9bd2de0279 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Acquiring lock "refresh_cache-201f0afe-8508-4357-8786-f62b70866aae" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Acquired lock "refresh_cache-201f0afe-8508-4357-8786-f62b70866aae" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.network.neutron [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.compute.manager [req-c52a9c21-880f-4eb9-8ad4-1e1760f52aac req-252d70c6-f179-48c7-ba3e-271d62019fd0 service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Received event network-changed-c3201b44-4689-4e0e-8fcd-1e9bd2de0279 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.compute.manager [req-c52a9c21-880f-4eb9-8ad4-1e1760f52aac req-252d70c6-f179-48c7-ba3e-271d62019fd0 service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Refreshing instance network info cache due to event network-changed-c3201b44-4689-4e0e-8fcd-1e9bd2de0279. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c52a9c21-880f-4eb9-8ad4-1e1760f52aac req-252d70c6-f179-48c7-ba3e-271d62019fd0 service nova] Acquiring lock "refresh_cache-201f0afe-8508-4357-8786-f62b70866aae" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.network.neutron [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.network.neutron [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Updating instance_info_cache with network_info: [{"id": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "address": "fa:16:3e:21:36:22", "network": {"id": "2780db75-33d3-4c1b-9f6b-ebf1527a1675", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-198988837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2faaf456953448b8b999ce71bfae9478", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3201b44-46", "ovs_interfaceid": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Releasing lock "refresh_cache-201f0afe-8508-4357-8786-f62b70866aae" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Instance network_info: |[{"id": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "address": "fa:16:3e:21:36:22", "network": {"id": "2780db75-33d3-4c1b-9f6b-ebf1527a1675", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-198988837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2faaf456953448b8b999ce71bfae9478", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3201b44-46", "ovs_interfaceid": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c52a9c21-880f-4eb9-8ad4-1e1760f52aac req-252d70c6-f179-48c7-ba3e-271d62019fd0 service nova] Acquired lock "refresh_cache-201f0afe-8508-4357-8786-f62b70866aae" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.network.neutron [req-c52a9c21-880f-4eb9-8ad4-1e1760f52aac req-252d70c6-f179-48c7-ba3e-271d62019fd0 service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Refreshing network info cache for port c3201b44-4689-4e0e-8fcd-1e9bd2de0279 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Start _get_guest_xml network_info=[{"id": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "address": "fa:16:3e:21:36:22", "network": {"id": "2780db75-33d3-4c1b-9f6b-ebf1527a1675", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-198988837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2faaf456953448b8b999ce71bfae9478", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3201b44-46", "ovs_interfaceid": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:07:33 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:07:33 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-302873916',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-302873916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3028739',id=22,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1LstQ0G7Ovfino2jtuzxl7WBjtK15U0MqnBvG2f6G/WU5SB8DOKPSyS95PYWqsQ+I9AZjy6N/qH8DBnRBZ/gnv3JBhlukuWn8QRxfRsrwwHj2AFj7O6yFUBpNH0Q52DQ==',key_name='tempest-keypair-2145950247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2faaf456953448b8b999ce71bfae9478',ramdisk_id='',reservation_id='r-5w09351z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-880583918',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52fa83aab7634d1296bdc99455ab2a82',uuid=201f0afe-8508-4357-8786-f62b70866aae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "address": "fa:16:3e:21:36:22", "network": {"id": "2780db75-33d3-4c1b-9f6b-ebf1527a1675", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-198988837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2faaf456953448b8b999ce71bfae9478", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3201b44-46", "ovs_interfaceid": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Converting VIF {"id": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "address": "fa:16:3e:21:36:22", "network": {"id": "2780db75-33d3-4c1b-9f6b-ebf1527a1675", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-198988837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2faaf456953448b8b999ce71bfae9478", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3201b44-46", "ovs_interfaceid": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:36:22,bridge_name='br-int',has_traffic_filtering=True,id=c3201b44-4689-4e0e-8fcd-1e9bd2de0279,network=Network(2780db75-33d3-4c1b-9f6b-ebf1527a1675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3201b44-46') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.objects.instance [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lazy-loading 'pci_devices' on Instance uuid 201f0afe-8508-4357-8786-f62b70866aae {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:07:33 user nova-compute[75246]:   <uuid>201f0afe-8508-4357-8786-f62b70866aae</uuid>
Nov 28 17:07:33 user nova-compute[75246]:   <name>instance-00000016</name>
Nov 28 17:07:33 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:07:33 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:07:33 user nova-compute[75246]:   <metadata>
Nov 28 17:07:33 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:07:33 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:07:33 user nova-compute[75246]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-302873916</nova:name>
Nov 28 17:07:33 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:07:33</nova:creationTime>
Nov 28 17:07:33 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:07:33 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:07:33 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:07:33 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:07:33 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:07:33 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:07:33 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:07:33 user nova-compute[75246]:       <nova:owner>
Nov 28 17:07:33 user nova-compute[75246]:         <nova:user uuid="52fa83aab7634d1296bdc99455ab2a82">tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member</nova:user>
Nov 28 17:07:33 user nova-compute[75246]:         <nova:project uuid="2faaf456953448b8b999ce71bfae9478">tempest-TestServerVolumeAttachScenarioOldVersion-880583918</nova:project>
Nov 28 17:07:33 user nova-compute[75246]:       </nova:owner>
Nov 28 17:07:33 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:07:33 user nova-compute[75246]:       <nova:ports>
Nov 28 17:07:33 user nova-compute[75246]:         <nova:port uuid="c3201b44-4689-4e0e-8fcd-1e9bd2de0279">
Nov 28 17:07:33 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 17:07:33 user nova-compute[75246]:         </nova:port>
Nov 28 17:07:33 user nova-compute[75246]:       </nova:ports>
Nov 28 17:07:33 user nova-compute[75246]:     </nova:instance>
Nov 28 17:07:33 user nova-compute[75246]:   </metadata>
Nov 28 17:07:33 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:07:33 user nova-compute[75246]:     <system>
Nov 28 17:07:33 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:07:33 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:07:33 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:07:33 user nova-compute[75246]:       <entry name="serial">201f0afe-8508-4357-8786-f62b70866aae</entry>
Nov 28 17:07:33 user nova-compute[75246]:       <entry name="uuid">201f0afe-8508-4357-8786-f62b70866aae</entry>
Nov 28 17:07:33 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:07:33 user nova-compute[75246]:     </system>
Nov 28 17:07:33 user nova-compute[75246]:   </sysinfo>
Nov 28 17:07:33 user nova-compute[75246]:   <os>
Nov 28 17:07:33 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:07:33 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:07:33 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:07:33 user nova-compute[75246]:   </os>
Nov 28 17:07:33 user nova-compute[75246]:   <features>
Nov 28 17:07:33 user nova-compute[75246]:     <acpi/>
Nov 28 17:07:33 user nova-compute[75246]:     <apic/>
Nov 28 17:07:33 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:07:33 user nova-compute[75246]:   </features>
Nov 28 17:07:33 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:07:33 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:07:33 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:07:33 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:07:33 user nova-compute[75246]:   </clock>
Nov 28 17:07:33 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:07:33 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:07:33 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:07:33 user nova-compute[75246]:   </cpu>
Nov 28 17:07:33 user nova-compute[75246]:   <devices>
Nov 28 17:07:33 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:07:33 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:07:33 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk"/>
Nov 28 17:07:33 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:07:33 user nova-compute[75246]:     </disk>
Nov 28 17:07:33 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:07:33 user nova-compute[75246]:       <mac address="fa:16:3e:21:36:22"/>
Nov 28 17:07:33 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:07:33 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:07:33 user nova-compute[75246]:       <target dev="tapc3201b44-46"/>
Nov 28 17:07:33 user nova-compute[75246]:     </interface>
Nov 28 17:07:33 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:07:33 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/console.log" append="off"/>
Nov 28 17:07:33 user nova-compute[75246]:     </serial>
Nov 28 17:07:33 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:07:33 user nova-compute[75246]:     <video>
Nov 28 17:07:33 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:07:33 user nova-compute[75246]:     </video>
Nov 28 17:07:33 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:07:33 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:07:33 user nova-compute[75246]:     </rng>
Nov 28 17:07:33 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:07:33 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:07:33 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:07:33 user nova-compute[75246]:     </memballoon>
Nov 28 17:07:33 user nova-compute[75246]:   </devices>
Nov 28 17:07:33 user nova-compute[75246]: </domain>
Nov 28 17:07:33 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-302873916',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-302873916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3028739',id=22,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1LstQ0G7Ovfino2jtuzxl7WBjtK15U0MqnBvG2f6G/WU5SB8DOKPSyS95PYWqsQ+I9AZjy6N/qH8DBnRBZ/gnv3JBhlukuWn8QRxfRsrwwHj2AFj7O6yFUBpNH0Q52DQ==',key_name='tempest-keypair-2145950247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2faaf456953448b8b999ce71bfae9478',ramdisk_id='',reservation_id='r-5w09351z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-880583918',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52fa83aab7634d1296bdc99455ab2a82',uuid=201f0afe-8508-4357-8786-f62b70866aae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "address": "fa:16:3e:21:36:22", "network": {"id": "2780db75-33d3-4c1b-9f6b-ebf1527a1675", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-198988837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2faaf456953448b8b999ce71bfae9478", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3201b44-46", "ovs_interfaceid": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Converting VIF {"id": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "address": "fa:16:3e:21:36:22", "network": {"id": "2780db75-33d3-4c1b-9f6b-ebf1527a1675", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-198988837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2faaf456953448b8b999ce71bfae9478", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3201b44-46", "ovs_interfaceid": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:36:22,bridge_name='br-int',has_traffic_filtering=True,id=c3201b44-4689-4e0e-8fcd-1e9bd2de0279,network=Network(2780db75-33d3-4c1b-9f6b-ebf1527a1675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3201b44-46') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG os_vif [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:36:22,bridge_name='br-int',has_traffic_filtering=True,id=c3201b44-4689-4e0e-8fcd-1e9bd2de0279,network=Network(2780db75-33d3-4c1b-9f6b-ebf1527a1675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3201b44-46') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59491fc2-8cc6-5729-8e1b-5692185834b8', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3201b44-46, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3201b44-46, col_values=(('qos', UUID('5b7dcab9-5848-4159-a1c8-7ae32c05f49c')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3201b44-46, col_values=(('external_ids', {'iface-id': 'c3201b44-4689-4e0e-8fcd-1e9bd2de0279', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:36:22', 'vm-uuid': '201f0afe-8508-4357-8786-f62b70866aae'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:33 user nova-compute[75246]: INFO os_vif [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:36:22,bridge_name='br-int',has_traffic_filtering=True,id=c3201b44-4689-4e0e-8fcd-1e9bd2de0279,network=Network(2780db75-33d3-4c1b-9f6b-ebf1527a1675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3201b44-46')
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:07:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] No VIF found with MAC fa:16:3e:21:36:22, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:07:34 user nova-compute[75246]: DEBUG nova.network.neutron [req-c52a9c21-880f-4eb9-8ad4-1e1760f52aac req-252d70c6-f179-48c7-ba3e-271d62019fd0 service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Updated VIF entry in instance network info cache for port c3201b44-4689-4e0e-8fcd-1e9bd2de0279. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:07:34 user nova-compute[75246]: DEBUG nova.network.neutron [req-c52a9c21-880f-4eb9-8ad4-1e1760f52aac req-252d70c6-f179-48c7-ba3e-271d62019fd0 service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Updating instance_info_cache with network_info: [{"id": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "address": "fa:16:3e:21:36:22", "network": {"id": "2780db75-33d3-4c1b-9f6b-ebf1527a1675", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-198988837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2faaf456953448b8b999ce71bfae9478", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3201b44-46", "ovs_interfaceid": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:07:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c52a9c21-880f-4eb9-8ad4-1e1760f52aac req-252d70c6-f179-48c7-ba3e-271d62019fd0 service nova] Releasing lock "refresh_cache-201f0afe-8508-4357-8786-f62b70866aae" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:07:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:35 user nova-compute[75246]: DEBUG nova.compute.manager [req-f9ee22f1-8a45-4d47-8602-2d00b9527bb0 req-b4667e9b-da72-4c0e-afec-f0b5957b383e service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Received event network-vif-plugged-c3201b44-4689-4e0e-8fcd-1e9bd2de0279 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:07:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f9ee22f1-8a45-4d47-8602-2d00b9527bb0 req-b4667e9b-da72-4c0e-afec-f0b5957b383e service nova] Acquiring lock "201f0afe-8508-4357-8786-f62b70866aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f9ee22f1-8a45-4d47-8602-2d00b9527bb0 req-b4667e9b-da72-4c0e-afec-f0b5957b383e service nova] Lock "201f0afe-8508-4357-8786-f62b70866aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f9ee22f1-8a45-4d47-8602-2d00b9527bb0 req-b4667e9b-da72-4c0e-afec-f0b5957b383e service nova] Lock "201f0afe-8508-4357-8786-f62b70866aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:35 user nova-compute[75246]: DEBUG nova.compute.manager [req-f9ee22f1-8a45-4d47-8602-2d00b9527bb0 req-b4667e9b-da72-4c0e-afec-f0b5957b383e service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] No waiting events found dispatching network-vif-plugged-c3201b44-4689-4e0e-8fcd-1e9bd2de0279 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:07:35 user nova-compute[75246]: WARNING nova.compute.manager [req-f9ee22f1-8a45-4d47-8602-2d00b9527bb0 req-b4667e9b-da72-4c0e-afec-f0b5957b383e service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Received unexpected event network-vif-plugged-c3201b44-4689-4e0e-8fcd-1e9bd2de0279 for instance with vm_state building and task_state spawning.
Nov 28 17:07:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:37 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:07:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:07:37 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Instance spawned successfully.
Nov 28 17:07:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:07:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:07:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:07:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:07:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:07:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:07:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:07:37 user nova-compute[75246]: INFO nova.compute.manager [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 28 17:07:37 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:07:37 user nova-compute[75246]: DEBUG nova.compute.manager [req-4618e260-a904-4239-b85d-ef7711259952 req-38fc73e1-2883-45d2-a8f6-5d3a2877c86e service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Received event network-vif-plugged-c3201b44-4689-4e0e-8fcd-1e9bd2de0279 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:07:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4618e260-a904-4239-b85d-ef7711259952 req-38fc73e1-2883-45d2-a8f6-5d3a2877c86e service nova] Acquiring lock "201f0afe-8508-4357-8786-f62b70866aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4618e260-a904-4239-b85d-ef7711259952 req-38fc73e1-2883-45d2-a8f6-5d3a2877c86e service nova] Lock "201f0afe-8508-4357-8786-f62b70866aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4618e260-a904-4239-b85d-ef7711259952 req-38fc73e1-2883-45d2-a8f6-5d3a2877c86e service nova] Lock "201f0afe-8508-4357-8786-f62b70866aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:37 user nova-compute[75246]: DEBUG nova.compute.manager [req-4618e260-a904-4239-b85d-ef7711259952 req-38fc73e1-2883-45d2-a8f6-5d3a2877c86e service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] No waiting events found dispatching network-vif-plugged-c3201b44-4689-4e0e-8fcd-1e9bd2de0279 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:07:37 user nova-compute[75246]: WARNING nova.compute.manager [req-4618e260-a904-4239-b85d-ef7711259952 req-38fc73e1-2883-45d2-a8f6-5d3a2877c86e service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Received unexpected event network-vif-plugged-c3201b44-4689-4e0e-8fcd-1e9bd2de0279 for instance with vm_state building and task_state spawning.
Nov 28 17:07:37 user nova-compute[75246]: INFO nova.compute.manager [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Took 6.21 seconds to build instance.
Nov 28 17:07:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2e05a1d5-82bf-4f30-b037-b3733b9735f9 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "201f0afe-8508-4357-8786-f62b70866aae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.350s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Acquiring lock "3d274f78-239a-4a85-b850-ba82025d554d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Lock "3d274f78-239a-4a85-b850-ba82025d554d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Acquiring lock "3d274f78-239a-4a85-b850-ba82025d554d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Lock "3d274f78-239a-4a85-b850-ba82025d554d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Lock "3d274f78-239a-4a85-b850-ba82025d554d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:58 user nova-compute[75246]: INFO nova.compute.manager [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Terminating instance
Nov 28 17:07:58 user nova-compute[75246]: DEBUG nova.compute.manager [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:07:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:58 user nova-compute[75246]: DEBUG nova.compute.manager [req-baa4d4bc-cd5e-46b4-a49c-b480ecdcb020 req-c954858a-9e19-478c-a038-14eb11908f39 service nova] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Received event network-vif-unplugged-dd0e86d3-277b-4e55-aca6-ffaca265c53c {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:07:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-baa4d4bc-cd5e-46b4-a49c-b480ecdcb020 req-c954858a-9e19-478c-a038-14eb11908f39 service nova] Acquiring lock "3d274f78-239a-4a85-b850-ba82025d554d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-baa4d4bc-cd5e-46b4-a49c-b480ecdcb020 req-c954858a-9e19-478c-a038-14eb11908f39 service nova] Lock "3d274f78-239a-4a85-b850-ba82025d554d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:07:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-baa4d4bc-cd5e-46b4-a49c-b480ecdcb020 req-c954858a-9e19-478c-a038-14eb11908f39 service nova] Lock "3d274f78-239a-4a85-b850-ba82025d554d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:07:58 user nova-compute[75246]: DEBUG nova.compute.manager [req-baa4d4bc-cd5e-46b4-a49c-b480ecdcb020 req-c954858a-9e19-478c-a038-14eb11908f39 service nova] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] No waiting events found dispatching network-vif-unplugged-dd0e86d3-277b-4e55-aca6-ffaca265c53c {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:07:58 user nova-compute[75246]: DEBUG nova.compute.manager [req-baa4d4bc-cd5e-46b4-a49c-b480ecdcb020 req-c954858a-9e19-478c-a038-14eb11908f39 service nova] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Received event network-vif-unplugged-dd0e86d3-277b-4e55-aca6-ffaca265c53c for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:07:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:59 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Instance destroyed successfully.
Nov 28 17:07:59 user nova-compute[75246]: DEBUG nova.objects.instance [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Lazy-loading 'resources' on Instance uuid 3d274f78-239a-4a85-b850-ba82025d554d {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:07:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-537867883',display_name='tempest-VolumesActionsTest-instance-537867883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-537867883',id=20,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31ef802d501c4f28be417cd3ab0f7eeb',ramdisk_id='',reservation_id='r-b77xy656',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-931503126',owner_user_name='tempest-VolumesActionsTest-931503126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:06:09Z,user_data=None,user_id='5133e03c773c4d528fbacb9206b62cf7',uuid=3d274f78-239a-4a85-b850-ba82025d554d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "address": "fa:16:3e:a3:64:8a", "network": {"id": "7c230aba-28f6-45fc-b38c-9a75813f71dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ef802d501c4f28be417cd3ab0f7eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd0e86d3-27", "ovs_interfaceid": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:07:59 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Converting VIF {"id": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "address": "fa:16:3e:a3:64:8a", "network": {"id": "7c230aba-28f6-45fc-b38c-9a75813f71dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31ef802d501c4f28be417cd3ab0f7eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd0e86d3-27", "ovs_interfaceid": "dd0e86d3-277b-4e55-aca6-ffaca265c53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:07:59 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:64:8a,bridge_name='br-int',has_traffic_filtering=True,id=dd0e86d3-277b-4e55-aca6-ffaca265c53c,network=Network(7c230aba-28f6-45fc-b38c-9a75813f71dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd0e86d3-27') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:07:59 user nova-compute[75246]: DEBUG os_vif [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:64:8a,bridge_name='br-int',has_traffic_filtering=True,id=dd0e86d3-277b-4e55-aca6-ffaca265c53c,network=Network(7c230aba-28f6-45fc-b38c-9a75813f71dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd0e86d3-27') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:07:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd0e86d3-27, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:07:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2542855c-1e09-41d7-a83d-680413e11ea8) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:07:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:07:59 user nova-compute[75246]: INFO os_vif [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:64:8a,bridge_name='br-int',has_traffic_filtering=True,id=dd0e86d3-277b-4e55-aca6-ffaca265c53c,network=Network(7c230aba-28f6-45fc-b38c-9a75813f71dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd0e86d3-27')
Nov 28 17:07:59 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Deleting instance files /opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d_del
Nov 28 17:07:59 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Deletion of /opt/stack/data/nova/instances/3d274f78-239a-4a85-b850-ba82025d554d_del complete
Nov 28 17:07:59 user nova-compute[75246]: INFO nova.compute.manager [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 28 17:07:59 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:07:59 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:07:59 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:07:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:07:59 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:07:59 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Took 0.55 seconds to deallocate network for instance.
Nov 28 17:07:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:07:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:00 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:08:00 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:08:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:00 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Deleted allocations for instance 3d274f78-239a-4a85-b850-ba82025d554d
Nov 28 17:08:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-08db4387-ca21-4ab9-a038-f5c3578cab33 tempest-VolumesActionsTest-931503126 tempest-VolumesActionsTest-931503126-project-member] Lock "3d274f78-239a-4a85-b850-ba82025d554d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.856s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-92023229-1dcb-4bf7-bbb4-ccb8daf8301f req-56161ef8-7402-499f-962a-d9bce28e60cf service nova] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Received event network-vif-plugged-dd0e86d3-277b-4e55-aca6-ffaca265c53c {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-92023229-1dcb-4bf7-bbb4-ccb8daf8301f req-56161ef8-7402-499f-962a-d9bce28e60cf service nova] Acquiring lock "3d274f78-239a-4a85-b850-ba82025d554d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-92023229-1dcb-4bf7-bbb4-ccb8daf8301f req-56161ef8-7402-499f-962a-d9bce28e60cf service nova] Lock "3d274f78-239a-4a85-b850-ba82025d554d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-92023229-1dcb-4bf7-bbb4-ccb8daf8301f req-56161ef8-7402-499f-962a-d9bce28e60cf service nova] Lock "3d274f78-239a-4a85-b850-ba82025d554d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-92023229-1dcb-4bf7-bbb4-ccb8daf8301f req-56161ef8-7402-499f-962a-d9bce28e60cf service nova] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] No waiting events found dispatching network-vif-plugged-dd0e86d3-277b-4e55-aca6-ffaca265c53c {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:08:01 user nova-compute[75246]: WARNING nova.compute.manager [req-92023229-1dcb-4bf7-bbb4-ccb8daf8301f req-56161ef8-7402-499f-962a-d9bce28e60cf service nova] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Received unexpected event network-vif-plugged-dd0e86d3-277b-4e55-aca6-ffaca265c53c for instance with vm_state deleted and task_state None.
Nov 28 17:08:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-92023229-1dcb-4bf7-bbb4-ccb8daf8301f req-56161ef8-7402-499f-962a-d9bce28e60cf service nova] [instance: 3d274f78-239a-4a85-b850-ba82025d554d] Received event network-vif-deleted-dd0e86d3-277b-4e55-aca6-ffaca265c53c {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "25480185-8c9c-4aad-9c46-573cfbf65364" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "25480185-8c9c-4aad-9c46-573cfbf65364" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:13 user nova-compute[75246]: INFO nova.compute.manager [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Terminating instance
Nov 28 17:08:13 user nova-compute[75246]: DEBUG nova.compute.manager [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-57eb3c8e-7e53-4f0e-ac10-09bce2887f0f req-8bb3560f-426c-499c-ac2b-fcd7bfa8d4a7 service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Received event network-vif-unplugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-57eb3c8e-7e53-4f0e-ac10-09bce2887f0f req-8bb3560f-426c-499c-ac2b-fcd7bfa8d4a7 service nova] Acquiring lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-57eb3c8e-7e53-4f0e-ac10-09bce2887f0f req-8bb3560f-426c-499c-ac2b-fcd7bfa8d4a7 service nova] Lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-57eb3c8e-7e53-4f0e-ac10-09bce2887f0f req-8bb3560f-426c-499c-ac2b-fcd7bfa8d4a7 service nova] Lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-57eb3c8e-7e53-4f0e-ac10-09bce2887f0f req-8bb3560f-426c-499c-ac2b-fcd7bfa8d4a7 service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] No waiting events found dispatching network-vif-unplugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-57eb3c8e-7e53-4f0e-ac10-09bce2887f0f req-8bb3560f-426c-499c-ac2b-fcd7bfa8d4a7 service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Received event network-vif-unplugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:13 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Instance destroyed successfully.
Nov 28 17:08:13 user nova-compute[75246]: DEBUG nova.objects.instance [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lazy-loading 'resources' on Instance uuid 25480185-8c9c-4aad-9c46-573cfbf65364 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:08:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1442756255',display_name='tempest-ServersNegativeTestJSON-server-1442756255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1442756255',id=1,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:59:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbde1b5b56914297ab276a983b4dd56b',ramdisk_id='',reservation_id='r-xhi8yg0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-368898789',owner_user_name='tempest-ServersNegativeTestJSON-368898789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T16:59:43Z,user_data=None,user_id='ed5bb6d3f84b4c90990c68ed1d55b1c0',uuid=25480185-8c9c-4aad-9c46-573cfbf65364,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "address": "fa:16:3e:85:27:7b", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c6bdcd-7c", "ovs_interfaceid": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Converting VIF {"id": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "address": "fa:16:3e:85:27:7b", "network": {"id": "75d646d7-52d6-4455-8014-0381aa33c56e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-723682816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbde1b5b56914297ab276a983b4dd56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3c6bdcd-7c", "ovs_interfaceid": "c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8,network=Network(75d646d7-52d6-4455-8014-0381aa33c56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c6bdcd-7c') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG os_vif [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8,network=Network(75d646d7-52d6-4455-8014-0381aa33c56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c6bdcd-7c') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3c6bdcd-7c, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfe44ef7-19b2-44f3-b1ef-719fa3e39324) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:14 user nova-compute[75246]: INFO os_vif [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8,network=Network(75d646d7-52d6-4455-8014-0381aa33c56e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3c6bdcd-7c')
Nov 28 17:08:14 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Deleting instance files /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364_del
Nov 28 17:08:14 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Deletion of /opt/stack/data/nova/instances/25480185-8c9c-4aad-9c46-573cfbf65364_del complete
Nov 28 17:08:14 user nova-compute[75246]: INFO nova.compute.manager [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 28 17:08:14 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "86142721-b9dd-44ab-b994-f81443b5383c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "86142721-b9dd-44ab-b994-f81443b5383c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-977a5c60-badb-4d21-b82b-7925d4f1eedc req-b5a60e6b-7cb8-4e3c-a514-64c398d90f45 service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Received event network-vif-deleted-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:14 user nova-compute[75246]: INFO nova.compute.manager [req-977a5c60-badb-4d21-b82b-7925d4f1eedc req-b5a60e6b-7cb8-4e3c-a514-64c398d90f45 service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Neutron deleted interface c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8; detaching it from the instance and deleting it from the info cache
Nov 28 17:08:14 user nova-compute[75246]: DEBUG nova.network.neutron [req-977a5c60-badb-4d21-b82b-7925d4f1eedc req-b5a60e6b-7cb8-4e3c-a514-64c398d90f45 service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:08:14 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Took 0.54 seconds to deallocate network for instance.
Nov 28 17:08:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:14 user nova-compute[75246]: INFO nova.compute.manager [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Detaching volume 80ff9554-4dcc-4603-8d71-cf41cf34fc2f
Nov 28 17:08:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-977a5c60-badb-4d21-b82b-7925d4f1eedc req-b5a60e6b-7cb8-4e3c-a514-64c398d90f45 service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Detach interface failed, port_id=c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8, reason: Instance 25480185-8c9c-4aad-9c46-573cfbf65364 could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:14 user nova-compute[75246]: INFO nova.virt.block_device [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Attempting to driver detach volume 80ff9554-4dcc-4603-8d71-cf41cf34fc2f from mountpoint /dev/vdb
Nov 28 17:08:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Attempting to detach device vdb from instance 86142721-b9dd-44ab-b994-f81443b5383c from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:08:14 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:08:14 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:08:14 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:08:14 user nova-compute[75246]:   <serial>80ff9554-4dcc-4603-8d71-cf41cf34fc2f</serial>
Nov 28 17:08:14 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 17:08:14 user nova-compute[75246]: </disk>
Nov 28 17:08:14 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:08:14 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Successfully detached device vdb from instance 86142721-b9dd-44ab-b994-f81443b5383c from the persistent domain config.
Nov 28 17:08:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86142721-b9dd-44ab-b994-f81443b5383c from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:08:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:08:14 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:08:14 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:08:14 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:08:14 user nova-compute[75246]:   <serial>80ff9554-4dcc-4603-8d71-cf41cf34fc2f</serial>
Nov 28 17:08:14 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 17:08:14 user nova-compute[75246]: </disk>
Nov 28 17:08:14 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:15 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Deleted allocations for instance 25480185-8c9c-4aad-9c46-573cfbf65364
Nov 28 17:08:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-d1bc4808-fc1b-46f4-91c4-943920f7b255 tempest-ServersNegativeTestJSON-368898789 tempest-ServersNegativeTestJSON-368898789-project-member] Lock "25480185-8c9c-4aad-9c46-573cfbf65364" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.032s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86142721-b9dd-44ab-b994-f81443b5383c {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Received event network-vif-plugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] Acquiring lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] Lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] Lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] No waiting events found dispatching network-vif-plugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:08:15 user nova-compute[75246]: WARNING nova.compute.manager [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Received unexpected event network-vif-plugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 for instance with vm_state deleted and task_state None.
Nov 28 17:08:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Received event network-vif-plugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] Acquiring lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] Lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] Lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] No waiting events found dispatching network-vif-plugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:08:15 user nova-compute[75246]: WARNING nova.compute.manager [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Received unexpected event network-vif-plugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 for instance with vm_state deleted and task_state None.
Nov 28 17:08:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Received event network-vif-plugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] Acquiring lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] Lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] Lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] No waiting events found dispatching network-vif-plugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:08:15 user nova-compute[75246]: WARNING nova.compute.manager [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Received unexpected event network-vif-plugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 for instance with vm_state deleted and task_state None.
Nov 28 17:08:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Received event network-vif-unplugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] Acquiring lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] Lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] Lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] No waiting events found dispatching network-vif-unplugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:08:15 user nova-compute[75246]: WARNING nova.compute.manager [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Received unexpected event network-vif-unplugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 for instance with vm_state deleted and task_state None.
Nov 28 17:08:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Received event network-vif-plugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] Acquiring lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] Lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] Lock "25480185-8c9c-4aad-9c46-573cfbf65364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] No waiting events found dispatching network-vif-plugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:08:15 user nova-compute[75246]: WARNING nova.compute.manager [req-5c039753-dce5-4cc5-a971-6010b81aeabf req-f11dae62-722a-4aad-be17-a09a61d6e4dc service nova] [instance: 25480185-8c9c-4aad-9c46-573cfbf65364] Received unexpected event network-vif-plugged-c3c6bdcd-7cbc-4ef7-896a-3b7b771805b8 for instance with vm_state deleted and task_state None.
Nov 28 17:08:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "4b650a57-5870-4f77-bca2-abe50d970b40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:17 user nova-compute[75246]: INFO nova.compute.manager [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Terminating instance
Nov 28 17:08:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:08:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-507dd988-20ab-4f5c-8700-daeb7f9b8b5c req-38847e62-b381-4412-8fff-2ccac1b3c793 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received event network-vif-unplugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-507dd988-20ab-4f5c-8700-daeb7f9b8b5c req-38847e62-b381-4412-8fff-2ccac1b3c793 service nova] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-507dd988-20ab-4f5c-8700-daeb7f9b8b5c req-38847e62-b381-4412-8fff-2ccac1b3c793 service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-507dd988-20ab-4f5c-8700-daeb7f9b8b5c req-38847e62-b381-4412-8fff-2ccac1b3c793 service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-507dd988-20ab-4f5c-8700-daeb7f9b8b5c req-38847e62-b381-4412-8fff-2ccac1b3c793 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] No waiting events found dispatching network-vif-unplugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-507dd988-20ab-4f5c-8700-daeb7f9b8b5c req-38847e62-b381-4412-8fff-2ccac1b3c793 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received event network-vif-unplugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:08:18 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Instance destroyed successfully.
Nov 28 17:08:18 user nova-compute[75246]: DEBUG nova.objects.instance [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lazy-loading 'resources' on Instance uuid 4b650a57-5870-4f77-bca2-abe50d970b40 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-511980533',display_name='tempest-ServerActionsTestOtherB-server-511980533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-511980533',id=3,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeYN/HSLFqD4XGGEXJ9b8W5tTZ1Q+j1Wl9INcd9I7zBrxI2z/wVXkIvtrK7OKu4ZT8jqxkECEhWOY/LUm6Wr8yFYH+XfgjPLkBJ3Cg5yb8oaGQFI8Npp1mQPS7budj7Eg==',key_name='tempest-keypair-789293158',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:05:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3098a0e0fd3640d6b0c61303e10b9269',ramdisk_id='',reservation_id='r-ibzp3hny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-779885367',owner_user_name='tempest-ServerActionsTestOtherB-779885367-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:05:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec11d8eaa57441e4b1178c39dfccd51f',uuid=4b650a57-5870-4f77-bca2-abe50d970b40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Converting VIF {"id": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "address": "fa:16:3e:d2:1a:3a", "network": {"id": "6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-320898042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3098a0e0fd3640d6b0c61303e10b9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b26f892-a2", "ovs_interfaceid": "3b26f892-a21c-4c9f-b4f2-627ed62fb2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_vif [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b26f892-a2, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d8f5c69-02e5-4326-8d57-aa14ebcbe21f) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:18 user nova-compute[75246]: INFO os_vif [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:1a:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0,network=Network(6fd7b3f6-2bf3-4694-8de6-0aa3cdf21314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b26f892-a2')
Nov 28 17:08:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjtFMPWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:08:18 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2333f2-a84b-4fc2-8344-98e0afc2f952]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:08:18 user nova-compute[75246]: No targets found.
Nov 28 17:08:18 user nova-compute[75246]: iSNS:
Nov 28 17:08:18 user nova-compute[75246]: No targets found.
Nov 28 17:08:18 user nova-compute[75246]: STATIC:
Nov 28 17:08:18 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f
Nov 28 17:08:18 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:08:18 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:08:18 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872
Nov 28 17:08:18 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:08:18 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:08:18 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4
Nov 28 17:08:18 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:08:18 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:08:18 user nova-compute[75246]: FIRMWARE:
Nov 28 17:08:18 user nova-compute[75246]: No targets found.
Nov 28 17:08:18 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:08:18 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:08:18 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5770c7-c1a4-4b71-a266-9327461f2952]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b906e67d-6632-4aff-aae6-ce23b84368a6]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:08:18 user nova-compute[75246]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:08:18 user nova-compute[75246]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)
Nov 28 17:08:18 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:08:18 user nova-compute[75246]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 (non-flash)
Nov 28 17:08:18 user nova-compute[75246]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)
Nov 28 17:08:18 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d819b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4'): ({'sdd'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Removing single pathed devices sdd {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[95452e25-41a7-40ff-af15-40c44ad34844]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ad0c04-e30d-435e-9c78-1389f952f09c]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Flushing IO for device /dev/sdd {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.011s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19de0d6-dcc3-4743-87d7-eae09bfee3a7]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[43218b33-697d-46bc-9219-6fba06be6707]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3975fca2-20f1-485b-b36f-cf8eab9d0dad]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[806e19ce-fde3-4be1-a68d-79f5e6a19b29]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260]
Nov 28 17:08:18 user nova-compute[75246]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4, portal: 172.16.0.220,3260] successful.
Nov 28 17:08:18 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d2f58a0-30e0-4819-aae0-07657c5f32b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebbbc51-0d91-49ef-a79d-15282e8ed73b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] <== disconnect_volume: return (295ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:08:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:08:18 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Deleting instance files /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40_del
Nov 28 17:08:18 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Deletion of /opt/stack/data/nova/instances/4b650a57-5870-4f77-bca2-abe50d970b40_del complete
Nov 28 17:08:19 user nova-compute[75246]: INFO nova.compute.manager [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 28 17:08:19 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:08:19 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:08:19 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:08:19 user nova-compute[75246]: DEBUG nova.compute.manager [req-ab37b2db-b3a5-4779-866c-253715972ac9 req-a35f693d-4d59-489f-b8a2-e3ee51efa74f service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received event network-changed-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:19 user nova-compute[75246]: DEBUG nova.compute.manager [req-ab37b2db-b3a5-4779-866c-253715972ac9 req-a35f693d-4d59-489f-b8a2-e3ee51efa74f service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Refreshing instance network info cache due to event network-changed-8932d31b-ff61-4b52-9f2d-a646560d3777. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:08:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ab37b2db-b3a5-4779-866c-253715972ac9 req-a35f693d-4d59-489f-b8a2-e3ee51efa74f service nova] Acquiring lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:08:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ab37b2db-b3a5-4779-866c-253715972ac9 req-a35f693d-4d59-489f-b8a2-e3ee51efa74f service nova] Acquired lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:08:19 user nova-compute[75246]: DEBUG nova.network.neutron [req-ab37b2db-b3a5-4779-866c-253715972ac9 req-a35f693d-4d59-489f-b8a2-e3ee51efa74f service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Refreshing network info cache for port 8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:08:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-1285d8f8-78b3-4bba-b654-d23ee5e4cb4c req-d4c7bab0-00d1-408d-8971-d7f4463f1816 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received event network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1285d8f8-78b3-4bba-b654-d23ee5e4cb4c req-d4c7bab0-00d1-408d-8971-d7f4463f1816 service nova] Acquiring lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1285d8f8-78b3-4bba-b654-d23ee5e4cb4c req-d4c7bab0-00d1-408d-8971-d7f4463f1816 service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1285d8f8-78b3-4bba-b654-d23ee5e4cb4c req-d4c7bab0-00d1-408d-8971-d7f4463f1816 service nova] Lock "4b650a57-5870-4f77-bca2-abe50d970b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-1285d8f8-78b3-4bba-b654-d23ee5e4cb4c req-d4c7bab0-00d1-408d-8971-d7f4463f1816 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] No waiting events found dispatching network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:08:20 user nova-compute[75246]: WARNING nova.compute.manager [req-1285d8f8-78b3-4bba-b654-d23ee5e4cb4c req-d4c7bab0-00d1-408d-8971-d7f4463f1816 service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received unexpected event network-vif-plugged-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 for instance with vm_state active and task_state deleting.
Nov 28 17:08:20 user nova-compute[75246]: DEBUG nova.network.neutron [req-ab37b2db-b3a5-4779-866c-253715972ac9 req-a35f693d-4d59-489f-b8a2-e3ee51efa74f service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Updated VIF entry in instance network info cache for port 8932d31b-ff61-4b52-9f2d-a646560d3777. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:08:20 user nova-compute[75246]: DEBUG nova.network.neutron [req-ab37b2db-b3a5-4779-866c-253715972ac9 req-a35f693d-4d59-489f-b8a2-e3ee51efa74f service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Updating instance_info_cache with network_info: [{"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:08:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ab37b2db-b3a5-4779-866c-253715972ac9 req-a35f693d-4d59-489f-b8a2-e3ee51efa74f service nova] Releasing lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:08:20 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:08:20 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Took 1.37 seconds to deallocate network for instance.
Nov 28 17:08:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-69682f9d-c0f7-4358-b458-5be6a4833651 req-78c6f2ee-8ae2-4584-adeb-f88e7a3c700a service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Received event network-vif-deleted-3b26f892-a21c-4c9f-b4f2-627ed62fb2c0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:20 user nova-compute[75246]: INFO nova.compute.manager [req-69682f9d-c0f7-4358-b458-5be6a4833651 req-78c6f2ee-8ae2-4584-adeb-f88e7a3c700a service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Neutron deleted interface 3b26f892-a21c-4c9f-b4f2-627ed62fb2c0; detaching it from the instance and deleting it from the info cache
Nov 28 17:08:20 user nova-compute[75246]: DEBUG nova.network.neutron [req-69682f9d-c0f7-4358-b458-5be6a4833651 req-78c6f2ee-8ae2-4584-adeb-f88e7a3c700a service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:08:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-69682f9d-c0f7-4358-b458-5be6a4833651 req-78c6f2ee-8ae2-4584-adeb-f88e7a3c700a service nova] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Detach interface failed, port_id=3b26f892-a21c-4c9f-b4f2-627ed62fb2c0, reason: Instance 4b650a57-5870-4f77-bca2-abe50d970b40 could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:08:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:21 user nova-compute[75246]: INFO nova.compute.manager [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Detaching volume 5acc1a2e-a8b9-4914-a2c4-ee26f8a17872
Nov 28 17:08:21 user nova-compute[75246]: INFO nova.virt.block_device [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Attempting to driver detach volume 5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 from mountpoint /dev/vdb
Nov 28 17:08:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Attempting to detach device vdb from instance 6579e6f5-93be-4b39-9c61-ca3dbc40b79f from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:08:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:08:21 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:08:21 user nova-compute[75246]:   <source dev="/dev/sde"/>
Nov 28 17:08:21 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:08:21 user nova-compute[75246]:   <serial>5acc1a2e-a8b9-4914-a2c4-ee26f8a17872</serial>
Nov 28 17:08:21 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 17:08:21 user nova-compute[75246]: </disk>
Nov 28 17:08:21 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:08:21 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Successfully detached device vdb from instance 6579e6f5-93be-4b39-9c61-ca3dbc40b79f from the persistent domain config.
Nov 28 17:08:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6579e6f5-93be-4b39-9c61-ca3dbc40b79f from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:08:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:08:21 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:08:21 user nova-compute[75246]:   <source dev="/dev/sde"/>
Nov 28 17:08:21 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:08:21 user nova-compute[75246]:   <serial>5acc1a2e-a8b9-4914-a2c4-ee26f8a17872</serial>
Nov 28 17:08:21 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 17:08:21 user nova-compute[75246]: </disk>
Nov 28 17:08:21 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:08:21 user nova-compute[75246]: INFO nova.compute.manager [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] [instance: 4b650a57-5870-4f77-bca2-abe50d970b40] Took 0.80 seconds to detach 1 volumes for instance.
Nov 28 17:08:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:21 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:08:21 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:08:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6579e6f5-93be-4b39-9c61-ca3dbc40b79f {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:08:21 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Deleted allocations for instance 4b650a57-5870-4f77-bca2-abe50d970b40
Nov 28 17:08:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-78895a24-e2bf-439b-9599-de1836db0a62 tempest-ServerActionsTestOtherB-779885367 tempest-ServerActionsTestOtherB-779885367-project-member] Lock "4b650a57-5870-4f77-bca2-abe50d970b40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.784s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:21 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:08:22 user nova-compute[75246]: DEBUG nova.compute.manager [req-29513369-daff-4c85-a213-f201fcd27c8c req-2a373355-db6b-40e4-9d1e-1dc7bf1bb65d service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received event network-changed-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:22 user nova-compute[75246]: DEBUG nova.compute.manager [req-29513369-daff-4c85-a213-f201fcd27c8c req-2a373355-db6b-40e4-9d1e-1dc7bf1bb65d service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Refreshing instance network info cache due to event network-changed-8932d31b-ff61-4b52-9f2d-a646560d3777. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:08:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-29513369-daff-4c85-a213-f201fcd27c8c req-2a373355-db6b-40e4-9d1e-1dc7bf1bb65d service nova] Acquiring lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:08:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-29513369-daff-4c85-a213-f201fcd27c8c req-2a373355-db6b-40e4-9d1e-1dc7bf1bb65d service nova] Acquired lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:08:22 user nova-compute[75246]: DEBUG nova.network.neutron [req-29513369-daff-4c85-a213-f201fcd27c8c req-2a373355-db6b-40e4-9d1e-1dc7bf1bb65d service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Refreshing network info cache for port 8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:08:22 user nova-compute[75246]: DEBUG nova.network.neutron [req-29513369-daff-4c85-a213-f201fcd27c8c req-2a373355-db6b-40e4-9d1e-1dc7bf1bb65d service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Updated VIF entry in instance network info cache for port 8932d31b-ff61-4b52-9f2d-a646560d3777. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:08:22 user nova-compute[75246]: DEBUG nova.network.neutron [req-29513369-daff-4c85-a213-f201fcd27c8c req-2a373355-db6b-40e4-9d1e-1dc7bf1bb65d service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Updating instance_info_cache with network_info: [{"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:08:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-29513369-daff-4c85-a213-f201fcd27c8c req-2a373355-db6b-40e4-9d1e-1dc7bf1bb65d service nova] Releasing lock "refresh_cache-6579e6f5-93be-4b39-9c61-ca3dbc40b79f" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:08:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:25 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:08:26 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:08:26 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:08:26 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:08:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-86142721-b9dd-44ab-b994-f81443b5383c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:08:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-86142721-b9dd-44ab-b994-f81443b5383c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:08:27 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:08:27 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Updating instance_info_cache with network_info: [{"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:08:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-86142721-b9dd-44ab-b994-f81443b5383c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:08:27 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:08:27 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:08:27 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:08:27 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:08:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:28 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:08:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:08:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:29 user nova-compute[75246]: INFO nova.compute.manager [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Rescuing
Nov 28 17:08:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:08:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquired lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:08:29 user nova-compute[75246]: DEBUG nova.network.neutron [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:08:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:29 user nova-compute[75246]: DEBUG nova.network.neutron [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Updating instance_info_cache with network_info: [{"id": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "address": "fa:16:3e:e3:8a:cb", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dca6bfe-f1", "ovs_interfaceid": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:08:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Releasing lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:08:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-fab523b4-8268-425a-a915-73fefde7eb19 req-3a4c0608-b869-4246-b888-f56dbc642a6f service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received event network-vif-unplugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fab523b4-8268-425a-a915-73fefde7eb19 req-3a4c0608-b869-4246-b888-f56dbc642a6f service nova] Acquiring lock "c94900af-f484-47bf-8627-8aa863334b63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fab523b4-8268-425a-a915-73fefde7eb19 req-3a4c0608-b869-4246-b888-f56dbc642a6f service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fab523b4-8268-425a-a915-73fefde7eb19 req-3a4c0608-b869-4246-b888-f56dbc642a6f service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-fab523b4-8268-425a-a915-73fefde7eb19 req-3a4c0608-b869-4246-b888-f56dbc642a6f service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] No waiting events found dispatching network-vif-unplugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:08:30 user nova-compute[75246]: WARNING nova.compute.manager [req-fab523b4-8268-425a-a915-73fefde7eb19 req-3a4c0608-b869-4246-b888-f56dbc642a6f service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received unexpected event network-vif-unplugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 for instance with vm_state active and task_state rescuing.
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:30 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: c94900af-f484-47bf-8627-8aa863334b63] Instance destroyed successfully.
Nov 28 17:08:30 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Attempting rescue
Nov 28 17:08:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75246) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Instance directory exists: not creating {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 17:08:30 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Creating image(s)
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "/opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "/opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "/opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG nova.objects.instance [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'trusted_certs' on Instance uuid c94900af-f484-47bf-8627-8aa863334b63 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.200s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk.rescue {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk.rescue" returned: 0 in 0.047s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.objects.instance [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'migration_context' on Instance uuid c94900af-f484-47bf-8627-8aa863334b63 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.objects.base [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Object Instance<c94900af-f484-47bf-8627-8aa863334b63> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Start _get_guest_xml network_info=[{"id": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "address": "fa:16:3e:e3:8a:cb", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "vif_mac": "fa:16:3e:e3:8a:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dca6bfe-f1", "ovs_interfaceid": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.objects.instance [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'resources' on Instance uuid c94900af-f484-47bf-8627-8aa863334b63 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.objects.base [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Object Instance<c94900af-f484-47bf-8627-8aa863334b63> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.objects.instance [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'numa_topology' on Instance uuid c94900af-f484-47bf-8627-8aa863334b63 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.objects.base [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Object Instance<c94900af-f484-47bf-8627-8aa863334b63> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:08:31 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:08:31 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.objects.instance [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'vcpu_model' on Instance uuid c94900af-f484-47bf-8627-8aa863334b63 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.objects.base [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Object Instance<c94900af-f484-47bf-8627-8aa863334b63> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2005498461',display_name='tempest-ServerRescueNegativeTestJSON-server-2005498461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2005498461',id=16,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:03:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60768e53b1e3414cb05eaaf23d382493',ramdisk_id='',reservation_id='r-14jvvyem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-220335783',owner_user_name='tempest-ServerRescueNegativeTestJSON-220335783-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:03:54Z,user_data=None,user_id='b79c4440e4734a2f82b08de54ed61737',uuid=c94900af-f484-47bf-8627-8aa863334b63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "address": "fa:16:3e:e3:8a:cb", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "vif_mac": "fa:16:3e:e3:8a:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dca6bfe-f1", "ovs_interfaceid": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converting VIF {"id": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "address": "fa:16:3e:e3:8a:cb", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "vif_mac": "fa:16:3e:e3:8a:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dca6bfe-f1", "ovs_interfaceid": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:8a:cb,bridge_name='br-int',has_traffic_filtering=True,id=2dca6bfe-f162-4bdd-af7f-af991de90b52,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dca6bfe-f1') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.objects.instance [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'pci_devices' on Instance uuid c94900af-f484-47bf-8627-8aa863334b63 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.objects.base [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Object Instance<c94900af-f484-47bf-8627-8aa863334b63> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:08:31 user nova-compute[75246]:   <uuid>c94900af-f484-47bf-8627-8aa863334b63</uuid>
Nov 28 17:08:31 user nova-compute[75246]:   <name>instance-00000010</name>
Nov 28 17:08:31 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:08:31 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:08:31 user nova-compute[75246]:   <metadata>
Nov 28 17:08:31 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:08:31 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:08:31 user nova-compute[75246]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2005498461</nova:name>
Nov 28 17:08:31 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:08:31</nova:creationTime>
Nov 28 17:08:31 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:08:31 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:08:31 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:08:31 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:08:31 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:08:31 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:08:31 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:08:31 user nova-compute[75246]:       <nova:owner>
Nov 28 17:08:31 user nova-compute[75246]:         <nova:user uuid="b79c4440e4734a2f82b08de54ed61737">tempest-ServerRescueNegativeTestJSON-220335783-project-member</nova:user>
Nov 28 17:08:31 user nova-compute[75246]:         <nova:project uuid="60768e53b1e3414cb05eaaf23d382493">tempest-ServerRescueNegativeTestJSON-220335783</nova:project>
Nov 28 17:08:31 user nova-compute[75246]:       </nova:owner>
Nov 28 17:08:31 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:08:31 user nova-compute[75246]:       <nova:ports>
Nov 28 17:08:31 user nova-compute[75246]:         <nova:port uuid="2dca6bfe-f162-4bdd-af7f-af991de90b52">
Nov 28 17:08:31 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 17:08:31 user nova-compute[75246]:         </nova:port>
Nov 28 17:08:31 user nova-compute[75246]:       </nova:ports>
Nov 28 17:08:31 user nova-compute[75246]:     </nova:instance>
Nov 28 17:08:31 user nova-compute[75246]:   </metadata>
Nov 28 17:08:31 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:08:31 user nova-compute[75246]:     <system>
Nov 28 17:08:31 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:08:31 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:08:31 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:08:31 user nova-compute[75246]:       <entry name="serial">c94900af-f484-47bf-8627-8aa863334b63</entry>
Nov 28 17:08:31 user nova-compute[75246]:       <entry name="uuid">c94900af-f484-47bf-8627-8aa863334b63</entry>
Nov 28 17:08:31 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:08:31 user nova-compute[75246]:     </system>
Nov 28 17:08:31 user nova-compute[75246]:   </sysinfo>
Nov 28 17:08:31 user nova-compute[75246]:   <os>
Nov 28 17:08:31 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:08:31 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:08:31 user nova-compute[75246]:   </os>
Nov 28 17:08:31 user nova-compute[75246]:   <features>
Nov 28 17:08:31 user nova-compute[75246]:     <acpi/>
Nov 28 17:08:31 user nova-compute[75246]:     <apic/>
Nov 28 17:08:31 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:08:31 user nova-compute[75246]:   </features>
Nov 28 17:08:31 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:08:31 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:08:31 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:08:31 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:08:31 user nova-compute[75246]:   </clock>
Nov 28 17:08:31 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:08:31 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:08:31 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:08:31 user nova-compute[75246]:   </cpu>
Nov 28 17:08:31 user nova-compute[75246]:   <devices>
Nov 28 17:08:31 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:08:31 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:08:31 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk.rescue"/>
Nov 28 17:08:31 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:08:31 user nova-compute[75246]:     </disk>
Nov 28 17:08:31 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:08:31 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:08:31 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk"/>
Nov 28 17:08:31 user nova-compute[75246]:       <target dev="vdb" bus="virtio"/>
Nov 28 17:08:31 user nova-compute[75246]:     </disk>
Nov 28 17:08:31 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:08:31 user nova-compute[75246]:       <mac address="fa:16:3e:e3:8a:cb"/>
Nov 28 17:08:31 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:08:31 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:08:31 user nova-compute[75246]:       <target dev="tap2dca6bfe-f1"/>
Nov 28 17:08:31 user nova-compute[75246]:     </interface>
Nov 28 17:08:31 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:08:31 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/console.log" append="off"/>
Nov 28 17:08:31 user nova-compute[75246]:     </serial>
Nov 28 17:08:31 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:08:31 user nova-compute[75246]:     <video>
Nov 28 17:08:31 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:08:31 user nova-compute[75246]:     </video>
Nov 28 17:08:31 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:08:31 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:08:31 user nova-compute[75246]:     </rng>
Nov 28 17:08:31 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:08:31 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:08:31 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:08:31 user nova-compute[75246]:     </memballoon>
Nov 28 17:08:31 user nova-compute[75246]:   </devices>
Nov 28 17:08:31 user nova-compute[75246]: </domain>
Nov 28 17:08:31 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:08:31 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:08:31 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=7884MB free_disk=25.487762451171875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:31 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: c94900af-f484-47bf-8627-8aa863334b63] Instance destroyed successfully.
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] No VIF found with MAC fa:16:3e:e3:8a:cb, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e1266470-c182-4c0c-a575-4c5043f54745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 86142721-b9dd-44ab-b994-f81443b5383c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c94900af-f484-47bf-8627-8aa863334b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 6579e6f5-93be-4b39-9c61-ca3dbc40b79f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 38451776-a726-4569-84c2-10874b488951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 201f0afe-8508-4357-8786-f62b70866aae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:08:31 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:08:32 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:08:32 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:08:32 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:08:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-d803852a-7c3e-487a-a55f-6e513d4173db req-9b19cb20-5e59-4e33-9ef5-bd84d1d31cd1 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received event network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d803852a-7c3e-487a-a55f-6e513d4173db req-9b19cb20-5e59-4e33-9ef5-bd84d1d31cd1 service nova] Acquiring lock "c94900af-f484-47bf-8627-8aa863334b63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d803852a-7c3e-487a-a55f-6e513d4173db req-9b19cb20-5e59-4e33-9ef5-bd84d1d31cd1 service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d803852a-7c3e-487a-a55f-6e513d4173db req-9b19cb20-5e59-4e33-9ef5-bd84d1d31cd1 service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-d803852a-7c3e-487a-a55f-6e513d4173db req-9b19cb20-5e59-4e33-9ef5-bd84d1d31cd1 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] No waiting events found dispatching network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:08:32 user nova-compute[75246]: WARNING nova.compute.manager [req-d803852a-7c3e-487a-a55f-6e513d4173db req-9b19cb20-5e59-4e33-9ef5-bd84d1d31cd1 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received unexpected event network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 for instance with vm_state active and task_state rescuing.
Nov 28 17:08:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:33 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:08:33 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:08:33 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:08:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-c735c94a-4337-40c6-add6-f2ea2c8c1a39 req-f739a980-fe73-494f-bb6b-0425d2fae8cc service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received event network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c735c94a-4337-40c6-add6-f2ea2c8c1a39 req-f739a980-fe73-494f-bb6b-0425d2fae8cc service nova] Acquiring lock "c94900af-f484-47bf-8627-8aa863334b63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c735c94a-4337-40c6-add6-f2ea2c8c1a39 req-f739a980-fe73-494f-bb6b-0425d2fae8cc service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c735c94a-4337-40c6-add6-f2ea2c8c1a39 req-f739a980-fe73-494f-bb6b-0425d2fae8cc service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-c735c94a-4337-40c6-add6-f2ea2c8c1a39 req-f739a980-fe73-494f-bb6b-0425d2fae8cc service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] No waiting events found dispatching network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:08:34 user nova-compute[75246]: WARNING nova.compute.manager [req-c735c94a-4337-40c6-add6-f2ea2c8c1a39 req-f739a980-fe73-494f-bb6b-0425d2fae8cc service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received unexpected event network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 for instance with vm_state active and task_state rescuing.
Nov 28 17:08:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-c735c94a-4337-40c6-add6-f2ea2c8c1a39 req-f739a980-fe73-494f-bb6b-0425d2fae8cc service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received event network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c735c94a-4337-40c6-add6-f2ea2c8c1a39 req-f739a980-fe73-494f-bb6b-0425d2fae8cc service nova] Acquiring lock "c94900af-f484-47bf-8627-8aa863334b63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c735c94a-4337-40c6-add6-f2ea2c8c1a39 req-f739a980-fe73-494f-bb6b-0425d2fae8cc service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c735c94a-4337-40c6-add6-f2ea2c8c1a39 req-f739a980-fe73-494f-bb6b-0425d2fae8cc service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-c735c94a-4337-40c6-add6-f2ea2c8c1a39 req-f739a980-fe73-494f-bb6b-0425d2fae8cc service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] No waiting events found dispatching network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:08:34 user nova-compute[75246]: WARNING nova.compute.manager [req-c735c94a-4337-40c6-add6-f2ea2c8c1a39 req-f739a980-fe73-494f-bb6b-0425d2fae8cc service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received unexpected event network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 for instance with vm_state active and task_state rescuing.
Nov 28 17:08:35 user nova-compute[75246]: DEBUG nova.compute.manager [None req-00cc4a53-cef0-4849-9913-96041523de4a tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:08:35 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 86142721-b9dd-44ab-b994-f81443b5383c is timed out.
Nov 28 17:08:35 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Successfully detached device vdb from instance 86142721-b9dd-44ab-b994-f81443b5383c from the live domain config.
Nov 28 17:08:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjrXBYVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:08:35 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[346bf696-a65a-4047-9976-fbd9aaa445bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:08:35 user nova-compute[75246]: No targets found.
Nov 28 17:08:35 user nova-compute[75246]: iSNS:
Nov 28 17:08:35 user nova-compute[75246]: No targets found.
Nov 28 17:08:35 user nova-compute[75246]: STATIC:
Nov 28 17:08:35 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f
Nov 28 17:08:35 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:08:35 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:08:35 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872
Nov 28 17:08:35 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:08:35 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:08:35 user nova-compute[75246]: FIRMWARE:
Nov 28 17:08:35 user nova-compute[75246]: No targets found.
Nov 28 17:08:35 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:08:35 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:08:35 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[91961f82-3de2-4394-8720-3058a5b9f0e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[593122f0-1c53-47c5-9b77-252380eb5c0a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:08:35 user nova-compute[75246]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)
Nov 28 17:08:35 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f (non-flash)
Nov 28 17:08:35 user nova-compute[75246]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)
Nov 28 17:08:35 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d85a0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f'): ({'sdc'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Removing single pathed devices sdc {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[13984cd7-55da-408f-8d5a-b27c81e0c2d2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac60ff15-deca-4b28-b8d2-0882ac9c4b2b]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Flushing IO for device /dev/sdc {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9155a225-d2b2-44fe-b50a-4adb28c3a15d]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[990eb012-3ac9-4fc3-877a-86679dd2787a]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa87aa23-8660-4bc8-8753-360982660d06]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2e9f41-888e-475b-b031-a1dbaac4347d]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f, portal: 172.16.0.220,3260]
Nov 28 17:08:35 user nova-compute[75246]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f, portal: 172.16.0.220,3260] successful.
Nov 28 17:08:35 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ff9554-4dcc-4603-8d71-cf41cf34fc2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0680151-a605-4ded-82ea-ed711e730f44]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] <== disconnect_volume: return (269ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:08:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:36 user nova-compute[75246]: DEBUG nova.objects.instance [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lazy-loading 'flavor' on Instance uuid 86142721-b9dd-44ab-b994-f81443b5383c {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:08:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-71db02a3-b168-41e7-a586-a81c8370b382 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "86142721-b9dd-44ab-b994-f81443b5383c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.765s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:41 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6579e6f5-93be-4b39-9c61-ca3dbc40b79f is timed out.
Nov 28 17:08:41 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Successfully detached device vdb from instance 6579e6f5-93be-4b39-9c61-ca3dbc40b79f from the live domain config.
Nov 28 17:08:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmighUaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:08:41 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ea6491-806f-4bbc-a61c-3ab22453ea10]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:08:41 user nova-compute[75246]: No targets found.
Nov 28 17:08:41 user nova-compute[75246]: iSNS:
Nov 28 17:08:41 user nova-compute[75246]: No targets found.
Nov 28 17:08:41 user nova-compute[75246]: STATIC:
Nov 28 17:08:41 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872
Nov 28 17:08:41 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:08:41 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:08:41 user nova-compute[75246]: FIRMWARE:
Nov 28 17:08:41 user nova-compute[75246]: No targets found.
Nov 28 17:08:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:08:41 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:08:41 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[634ca4a6-cba6-4893-80f3-1b05f77e2912]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8197e08d-25b0-46f6-959f-820cf2140eb2]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)
Nov 28 17:08:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 (non-flash)
Nov 28 17:08:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d85a24d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872'): ({'sde'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Removing single pathed devices sde {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[50495679-f98c-4cf5-9b67-9070437bc940]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[382bf9f7-de56-4721-b1f9-2bf11b6a1d30]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Flushing IO for device /dev/sde {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c227f4d-ca63-403f-a857-70a37c001e5f]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[93645d7d-2fb7-496b-b060-caa9c19cf4de]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] SCSI volumes sde have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfa6c1c-ffb8-407a-b86f-d267fc16487a]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e479036-1114-4f1e-83a5-9927107f5824]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872, portal: 172.16.0.220,3260]
Nov 28 17:08:41 user nova-compute[75246]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872, portal: 172.16.0.220,3260] successful.
Nov 28 17:08:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5acc1a2e-a8b9-4914-a2c4-ee26f8a17872 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b46b48-9b4b-4b42-859c-b68532678fb5]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] <== disconnect_volume: return (267ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:08:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "0d952de1-8c78-4bea-853d-21ac4f979845" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "0d952de1-8c78-4bea-853d-21ac4f979845" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:42 user nova-compute[75246]: INFO nova.compute.manager [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Unshelving
Nov 28 17:08:42 user nova-compute[75246]: INFO nova.virt.block_device [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Booting with volume e3d24323-24c5-486c-a65b-2560bb874c02 at /dev/vdc
Nov 28 17:08:42 user nova-compute[75246]: DEBUG os_brick.utils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfd8094-c876-4bdf-9ca4-0ca127e73680]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b87b6c-a6db-4b18-b0d7-8909fef7f856]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2559d7e-9c04-40c7-9100-f5146dc638da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb1af82-316b-492c-89be-1f4d13cbdb0c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:08:42 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:08:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdb7dd8-bc2b-4cb6-bfda-d7398f8318ed]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG os_brick.utils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Updating existing volume attachment record: 0d2e2edf-3eb9-4b0a-83a0-0da65553c34a {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG nova.objects.instance [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lazy-loading 'flavor' on Instance uuid 6579e6f5-93be-4b39-9c61-ca3dbc40b79f {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:08:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0720573e-d543-4de9-9729-d507c42f3e70 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.745s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:08:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:08:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:49 user nova-compute[75246]: DEBUG nova.objects.instance [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'pci_requests' on Instance uuid 0d952de1-8c78-4bea-853d-21ac4f979845 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:08:49 user nova-compute[75246]: DEBUG nova.objects.instance [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'numa_topology' on Instance uuid 0d952de1-8c78-4bea-853d-21ac4f979845 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:08:49 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:08:49 user nova-compute[75246]: INFO nova.compute.claims [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Claim successful on node user
Nov 28 17:08:50 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:08:50 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:08:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:50 user nova-compute[75246]: INFO nova.network.neutron [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Updating port ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 17:08:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:08:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquired lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:08:50 user nova-compute[75246]: DEBUG nova.network.neutron [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:08:50 user nova-compute[75246]: DEBUG nova.compute.manager [req-58ba426e-c3fb-4a71-b968-9f4ea2285bb3 req-a2b76f4f-4dd6-4307-bac5-922c1199301a service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received event network-changed-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:50 user nova-compute[75246]: DEBUG nova.compute.manager [req-58ba426e-c3fb-4a71-b968-9f4ea2285bb3 req-a2b76f4f-4dd6-4307-bac5-922c1199301a service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Refreshing instance network info cache due to event network-changed-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:08:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-58ba426e-c3fb-4a71-b968-9f4ea2285bb3 req-a2b76f4f-4dd6-4307-bac5-922c1199301a service nova] Acquiring lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Acquiring lock "38451776-a726-4569-84c2-10874b488951" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "38451776-a726-4569-84c2-10874b488951" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lazy-loading 'flavor' on Instance uuid 38451776-a726-4569-84c2-10874b488951 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "38451776-a726-4569-84c2-10874b488951" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Acquiring lock "38451776-a726-4569-84c2-10874b488951" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "38451776-a726-4569-84c2-10874b488951" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:51 user nova-compute[75246]: INFO nova.compute.manager [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Attaching volume 7efa09bd-421f-4dfe-84c1-10a4a3c57468 to /dev/vdb
Nov 28 17:08:51 user nova-compute[75246]: DEBUG os_brick.utils [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1df2671-28e1-4de1-b536-9d929da1ca5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5bc974-6896-457f-91c5-b7fd873bc967]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae709e9-c673-4424-a232-84cbae075ecf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c73737-3f19-4e0b-93ca-171839992855]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG nova.network.neutron [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Updating instance_info_cache with network_info: [{"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Releasing lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:08:51 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Creating image(s)
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "/opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "/opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG nova.objects.instance [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0d952de1-8c78-4bea-853d-21ac4f979845 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:08:51 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3978162a-b7d7-4a8d-a88f-40f882c896ad]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-58ba426e-c3fb-4a71-b968-9f4ea2285bb3 req-a2b76f4f-4dd6-4307-bac5-922c1199301a service nova] Acquired lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG nova.network.neutron [req-58ba426e-c3fb-4a71-b968-9f4ea2285bb3 req-a2b76f4f-4dd6-4307-bac5-922c1199301a service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Refreshing network info cache for port ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG os_brick.utils [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Updating existing volume attachment record: aea85187-e7aa-43b2-87e2-e3a1d5efd503 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG nova.objects.base [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Object Instance<0d952de1-8c78-4bea-853d-21ac4f979845> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "daf7d68032796a5015789dabd65fbc150eb60ab3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "daf7d68032796a5015789dabd65fbc150eb60ab3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3.part --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:52 user nova-compute[75246]: DEBUG nova.virt.images [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] 7930335a-9c24-4815-9763-7044275f3f1b was qcow2, converting to raw {{(pid=75246) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 17:08:52 user nova-compute[75246]: DEBUG nova.privsep.utils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75246) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 17:08:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3.part /opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3.converted {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:52 user nova-compute[75246]: DEBUG nova.network.neutron [req-58ba426e-c3fb-4a71-b968-9f4ea2285bb3 req-a2b76f4f-4dd6-4307-bac5-922c1199301a service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Updated VIF entry in instance network info cache for port ebb7a52b-f2f1-43e8-bea2-02a136b62aa1. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:08:52 user nova-compute[75246]: DEBUG nova.network.neutron [req-58ba426e-c3fb-4a71-b968-9f4ea2285bb3 req-a2b76f4f-4dd6-4307-bac5-922c1199301a service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Updating instance_info_cache with network_info: [{"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:08:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-58ba426e-c3fb-4a71-b968-9f4ea2285bb3 req-a2b76f4f-4dd6-4307-bac5-922c1199301a service nova] Releasing lock "refresh_cache-0d952de1-8c78-4bea-853d-21ac4f979845" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:08:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3.part /opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3.converted" returned: 0 in 0.484s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3.converted --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "daf7d68032796a5015789dabd65fbc150eb60ab3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.845s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3 --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "daf7d68032796a5015789dabd65fbc150eb60ab3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "daf7d68032796a5015789dabd65fbc150eb60ab3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3 --force-share --output=json" returned: 0 in 0.188s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3,backing_fmt=raw /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3,backing_fmt=raw /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk 1073741824" returned: 0 in 0.048s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "daf7d68032796a5015789dabd65fbc150eb60ab3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3 --force-share --output=json" returned: 0 in 0.170s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:54 user nova-compute[75246]: DEBUG nova.objects.instance [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'migration_context' on Instance uuid 0d952de1-8c78-4bea-853d-21ac4f979845 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:08:54 user nova-compute[75246]: DEBUG nova.objects.base [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Object Instance<0d952de1-8c78-4bea-853d-21ac4f979845> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:08:54 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Rebasing disk image.
Nov 28 17:08:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 -F raw /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 -F raw /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk" returned: 0 in 1.995s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Ensure instance console log exists: /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Start _get_guest_xml network_info=[{"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b4a3445a7e5cf8b3646f20781a5b6788',container_format='bare',created_at=2023-11-28T17:06:50Z,direct_url=<?>,disk_format='qcow2',id=7930335a-9c24-4815-9763-7044275f3f1b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-278996386-shelved',owner='cd94665acd9a4448a1ad1350d71d8f72',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T17:06:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '0d2e2edf-3eb9-4b0a-83a0-0da65553c34a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVsJRNkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '0d952de1-8c78-4bea-853d-21ac4f979845', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3d24323-24c5-486c-a65b-2560bb874c02', 'serial': 'e3d24323-24c5-486c-a65b-2560bb874c02'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:08:56 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:08:56 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b4a3445a7e5cf8b3646f20781a5b6788',container_format='bare',created_at=2023-11-28T17:06:50Z,direct_url=<?>,disk_format='qcow2',id=7930335a-9c24-4815-9763-7044275f3f1b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-278996386-shelved',owner='cd94665acd9a4448a1ad1350d71d8f72',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T17:06:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.objects.instance [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0d952de1-8c78-4bea-853d-21ac4f979845 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.objects.base [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Object Instance<0d952de1-8c78-4bea-853d-21ac4f979845> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVsJRNkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:08:56 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:08:56 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:08:56 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50b6dd1-76e7-42b6-8889-f795e8a0b629]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:08:56 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d3b89b-23b3-4c50-88d8-8bb4c5270116]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02] added
Nov 28 17:08:56 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[672a3f60-8902-4ad7-931d-8f8a2dcc1dca]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3611ea39-a4ca-4965-a790-fe69992a13a8]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LVsJRNkH {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LVsJRNkH" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be72473-b029-4657-a1a9-0f4f22b0596c]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LVsJRNkH'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9803429-4638-4c8a-b4ef-b06018f0c0ce]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[16920984-89b5-4e50-8954-bb1f6465d023]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 17:08:56 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 17:08:56 user nova-compute[75246]:  {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:08:56 user nova-compute[75246]: WARNING os_brick.initiator.connectors.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 17:08:56 user nova-compute[75246]: 
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a073bb-42f2-447a-89b1-6a2f75d5037a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02, portal: 172.16.0.220,3260]
Nov 28 17:08:56 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02, portal: 172.16.0.220,3260] successful.
Nov 28 17:08:56 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[520a0a55-5668-4457-b751-7d132daaa4b6]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a87e681-2f38-4028-9736-772689993ac8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)
Nov 28 17:08:56 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)
Nov 28 17:08:56 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d3eb1d-ac2f-492c-9d7f-851971269204]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:08:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVsJRNkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23335313935623333', 'path': '/dev/sdb'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335313935623333', 'path': '/dev/sdb'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T17:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-278996386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-278996386',id=19,image_ref='7930335a-9c24-4815-9763-7044275f3f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1103265416',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:05:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cd94665acd9a4448a1ad1350d71d8f72',ramdisk_id='',reservation_id='r-eelgg57i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726606277',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726606277-project-member',shelved_at='2023-11-28T17:06:54.713346',shelved_host='user',shelved_image_id='7930335a-9c24-4815-9763-7044275f3f1b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:08:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ed095223674edebcee82e4183c8ea0',uuid=0d952de1-8c78-4bea-853d-21ac4f979845,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converting VIF {"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:37:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebb7a52b-f2f1-43e8-bea2-02a136b62aa1,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb7a52b-f2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG nova.objects.instance [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d952de1-8c78-4bea-853d-21ac4f979845 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG nova.objects.base [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Object Instance<0d952de1-8c78-4bea-853d-21ac4f979845> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:08:57 user nova-compute[75246]:   <uuid>0d952de1-8c78-4bea-853d-21ac4f979845</uuid>
Nov 28 17:08:57 user nova-compute[75246]:   <name>instance-00000013</name>
Nov 28 17:08:57 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:08:57 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:08:57 user nova-compute[75246]:   <metadata>
Nov 28 17:08:57 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:08:57 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:08:57 user nova-compute[75246]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-278996386</nova:name>
Nov 28 17:08:57 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:08:56</nova:creationTime>
Nov 28 17:08:57 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:08:57 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:08:57 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:08:57 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:08:57 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:08:57 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:08:57 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:08:57 user nova-compute[75246]:       <nova:owner>
Nov 28 17:08:57 user nova-compute[75246]:         <nova:user uuid="a0ed095223674edebcee82e4183c8ea0">tempest-AttachVolumeShelveTestJSON-1726606277-project-member</nova:user>
Nov 28 17:08:57 user nova-compute[75246]:         <nova:project uuid="cd94665acd9a4448a1ad1350d71d8f72">tempest-AttachVolumeShelveTestJSON-1726606277</nova:project>
Nov 28 17:08:57 user nova-compute[75246]:       </nova:owner>
Nov 28 17:08:57 user nova-compute[75246]:       <nova:root type="image" uuid="7930335a-9c24-4815-9763-7044275f3f1b"/>
Nov 28 17:08:57 user nova-compute[75246]:       <nova:ports>
Nov 28 17:08:57 user nova-compute[75246]:         <nova:port uuid="ebb7a52b-f2f1-43e8-bea2-02a136b62aa1">
Nov 28 17:08:57 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 17:08:57 user nova-compute[75246]:         </nova:port>
Nov 28 17:08:57 user nova-compute[75246]:       </nova:ports>
Nov 28 17:08:57 user nova-compute[75246]:     </nova:instance>
Nov 28 17:08:57 user nova-compute[75246]:   </metadata>
Nov 28 17:08:57 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:08:57 user nova-compute[75246]:     <system>
Nov 28 17:08:57 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:08:57 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:08:57 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:08:57 user nova-compute[75246]:       <entry name="serial">0d952de1-8c78-4bea-853d-21ac4f979845</entry>
Nov 28 17:08:57 user nova-compute[75246]:       <entry name="uuid">0d952de1-8c78-4bea-853d-21ac4f979845</entry>
Nov 28 17:08:57 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:08:57 user nova-compute[75246]:     </system>
Nov 28 17:08:57 user nova-compute[75246]:   </sysinfo>
Nov 28 17:08:57 user nova-compute[75246]:   <os>
Nov 28 17:08:57 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:08:57 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:08:57 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:08:57 user nova-compute[75246]:   </os>
Nov 28 17:08:57 user nova-compute[75246]:   <features>
Nov 28 17:08:57 user nova-compute[75246]:     <acpi/>
Nov 28 17:08:57 user nova-compute[75246]:     <apic/>
Nov 28 17:08:57 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:08:57 user nova-compute[75246]:   </features>
Nov 28 17:08:57 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:08:57 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:08:57 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:08:57 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:08:57 user nova-compute[75246]:   </clock>
Nov 28 17:08:57 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:08:57 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:08:57 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:08:57 user nova-compute[75246]:   </cpu>
Nov 28 17:08:57 user nova-compute[75246]:   <devices>
Nov 28 17:08:57 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:08:57 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:08:57 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk"/>
Nov 28 17:08:57 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:08:57 user nova-compute[75246]:     </disk>
Nov 28 17:08:57 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:08:57 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:08:57 user nova-compute[75246]:       <source dev="/dev/sdb"/>
Nov 28 17:08:57 user nova-compute[75246]:       <target dev="vdc" bus="virtio"/>
Nov 28 17:08:57 user nova-compute[75246]:       <serial>e3d24323-24c5-486c-a65b-2560bb874c02</serial>
Nov 28 17:08:57 user nova-compute[75246]:     </disk>
Nov 28 17:08:57 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:08:57 user nova-compute[75246]:       <mac address="fa:16:3e:4a:37:ae"/>
Nov 28 17:08:57 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:08:57 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:08:57 user nova-compute[75246]:       <target dev="tapebb7a52b-f2"/>
Nov 28 17:08:57 user nova-compute[75246]:     </interface>
Nov 28 17:08:57 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:08:57 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/console.log" append="off"/>
Nov 28 17:08:57 user nova-compute[75246]:     </serial>
Nov 28 17:08:57 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:08:57 user nova-compute[75246]:     <video>
Nov 28 17:08:57 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:08:57 user nova-compute[75246]:     </video>
Nov 28 17:08:57 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:08:57 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:08:57 user nova-compute[75246]:     </rng>
Nov 28 17:08:57 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:08:57 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:08:57 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:08:57 user nova-compute[75246]:     </memballoon>
Nov 28 17:08:57 user nova-compute[75246]:   </devices>
Nov 28 17:08:57 user nova-compute[75246]: </domain>
Nov 28 17:08:57 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T17:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-278996386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-278996386',id=19,image_ref='7930335a-9c24-4815-9763-7044275f3f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1103265416',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:05:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cd94665acd9a4448a1ad1350d71d8f72',ramdisk_id='',reservation_id='r-eelgg57i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726606277',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726606277-project-member',shelved_at='2023-11-28T17:06:54.713346',shelved_host='user',shelved_image_id='7930335a-9c24-4815-9763-7044275f3f1b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:08:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ed095223674edebcee82e4183c8ea0',uuid=0d952de1-8c78-4bea-853d-21ac4f979845,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converting VIF {"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:37:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebb7a52b-f2f1-43e8-bea2-02a136b62aa1,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb7a52b-f2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG os_vif [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:37:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebb7a52b-f2f1-43e8-bea2-02a136b62aa1,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb7a52b-f2') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e58420c6-ca61-5a62-b0dc-de4e7643046d', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebb7a52b-f2, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebb7a52b-f2, col_values=(('qos', UUID('8eab0976-89f7-44a1-9ad5-66a2a1cdf41e')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebb7a52b-f2, col_values=(('external_ids', {'iface-id': 'ebb7a52b-f2f1-43e8-bea2-02a136b62aa1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:37:ae', 'vm-uuid': '0d952de1-8c78-4bea-853d-21ac4f979845'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:57 user nova-compute[75246]: INFO os_vif [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:37:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebb7a52b-f2f1-43e8-bea2-02a136b62aa1,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb7a52b-f2')
Nov 28 17:08:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:08:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] No VIF found with MAC fa:16:3e:4a:37:ae, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqfFEDch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:08:58 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:08:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:08:58 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:08:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:08:58 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cfa65d-af81-4b67-81e7-d10c459e3f41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:08:58 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76c38c3-f188-40d8-9590-ba499e806e72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468] added
Nov 28 17:08:58 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8e3a6c-77c5-4223-b7a0-500d033dbce1]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9a281e-a4dc-4f95-9be9-fcf9fc06d89b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UqfFEDch {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UqfFEDch" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7683dfa-a771-4e47-92f7-e7a6ebef8cd1]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UqfFEDch'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca94bb3-567e-4b70-a571-fbbbeb4434fb]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e121bc87-f09c-4b1d-8aea-6136b2e30140]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)
Nov 28 17:08:58 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)
Nov 28 17:08:58 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bf13a9-971b-46b7-8676-322bf2938bfd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468, portal: 172.16.0.220,3260]
Nov 28 17:08:58 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468, portal: 172.16.0.220,3260] successful.
Nov 28 17:08:58 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7927a76e-0558-44c6-9318-7265fa2118ad]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:08:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83d3c43-b86a-4fcf-8ada-c470e592ad56]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)
Nov 28 17:08:59 user nova-compute[75246]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 (non-flash)
Nov 28 17:08:59 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)
Nov 28 17:08:59 user nova-compute[75246]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 (non-flash)
Nov 28 17:08:59 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ee7e08-c057-4817-ba6f-985bec064736]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqfFEDch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-05f0e68a-8a79-4ddd-9dea-6264fb245223 req-923270ce-ffbb-40a5-af02-dce1e67e0ca2 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received event network-vif-plugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-05f0e68a-8a79-4ddd-9dea-6264fb245223 req-923270ce-ffbb-40a5-af02-dce1e67e0ca2 service nova] Acquiring lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-05f0e68a-8a79-4ddd-9dea-6264fb245223 req-923270ce-ffbb-40a5-af02-dce1e67e0ca2 service nova] Lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-05f0e68a-8a79-4ddd-9dea-6264fb245223 req-923270ce-ffbb-40a5-af02-dce1e67e0ca2 service nova] Lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-05f0e68a-8a79-4ddd-9dea-6264fb245223 req-923270ce-ffbb-40a5-af02-dce1e67e0ca2 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] No waiting events found dispatching network-vif-plugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:08:59 user nova-compute[75246]: WARNING nova.compute.manager [req-05f0e68a-8a79-4ddd-9dea-6264fb245223 req-923270ce-ffbb-40a5-af02-dce1e67e0ca2 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received unexpected event network-vif-plugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 17:08:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:08:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:09:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23938653132363065', 'path': '/dev/sdc'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:09:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938653132363065', 'path': '/dev/sdc'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:09:00 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lazy-loading 'flavor' on Instance uuid 38451776-a726-4569-84c2-10874b488951 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:09:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:09:00 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:09:00 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:09:00 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:09:00 user nova-compute[75246]:   <serial>7efa09bd-421f-4dfe-84c1-10a4a3c57468</serial>
Nov 28 17:09:00 user nova-compute[75246]: </disk>
Nov 28 17:09:00 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:09:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:09:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:09:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] No VIF found with MAC fa:16:3e:07:11:a4, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:09:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3f118fce-6ca9-4714-b614-06c62fffe207 tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "38451776-a726-4569-84c2-10874b488951" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.305s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Acquiring lock "38451776-a726-4569-84c2-10874b488951" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "38451776-a726-4569-84c2-10874b488951" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Acquiring lock "38451776-a726-4569-84c2-10874b488951-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "38451776-a726-4569-84c2-10874b488951-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "38451776-a726-4569-84c2-10874b488951-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:01 user nova-compute[75246]: INFO nova.compute.manager [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Terminating instance
Nov 28 17:09:01 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG nova.compute.manager [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:09:01 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Instance spawned successfully.
Nov 28 17:09:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-ce8b687a-5fd8-4b3e-92d4-8ad59463e106 req-c0f38fbb-56b1-41cb-9623-53705dc4203c service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Received event network-vif-unplugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ce8b687a-5fd8-4b3e-92d4-8ad59463e106 req-c0f38fbb-56b1-41cb-9623-53705dc4203c service nova] Acquiring lock "38451776-a726-4569-84c2-10874b488951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ce8b687a-5fd8-4b3e-92d4-8ad59463e106 req-c0f38fbb-56b1-41cb-9623-53705dc4203c service nova] Lock "38451776-a726-4569-84c2-10874b488951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ce8b687a-5fd8-4b3e-92d4-8ad59463e106 req-c0f38fbb-56b1-41cb-9623-53705dc4203c service nova] Lock "38451776-a726-4569-84c2-10874b488951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-ce8b687a-5fd8-4b3e-92d4-8ad59463e106 req-c0f38fbb-56b1-41cb-9623-53705dc4203c service nova] [instance: 38451776-a726-4569-84c2-10874b488951] No waiting events found dispatching network-vif-unplugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-ce8b687a-5fd8-4b3e-92d4-8ad59463e106 req-c0f38fbb-56b1-41cb-9623-53705dc4203c service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Received event network-vif-unplugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-b0f8083c-58f2-485f-8a5d-c8c43066d2e0 req-04a69437-35a0-4f3f-8acf-e663f82ec65e service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received event network-vif-plugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b0f8083c-58f2-485f-8a5d-c8c43066d2e0 req-04a69437-35a0-4f3f-8acf-e663f82ec65e service nova] Acquiring lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b0f8083c-58f2-485f-8a5d-c8c43066d2e0 req-04a69437-35a0-4f3f-8acf-e663f82ec65e service nova] Lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b0f8083c-58f2-485f-8a5d-c8c43066d2e0 req-04a69437-35a0-4f3f-8acf-e663f82ec65e service nova] Lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-b0f8083c-58f2-485f-8a5d-c8c43066d2e0 req-04a69437-35a0-4f3f-8acf-e663f82ec65e service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] No waiting events found dispatching network-vif-plugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:09:01 user nova-compute[75246]: WARNING nova.compute.manager [req-b0f8083c-58f2-485f-8a5d-c8c43066d2e0 req-04a69437-35a0-4f3f-8acf-e663f82ec65e service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received unexpected event network-vif-plugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 17:09:01 user nova-compute[75246]: DEBUG nova.compute.manager [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:09:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57980830-aa10-45ec-bfcf-d67fcfa82e15 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "0d952de1-8c78-4bea-853d-21ac4f979845" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.551s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:02 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 38451776-a726-4569-84c2-10874b488951] Instance destroyed successfully.
Nov 28 17:09:02 user nova-compute[75246]: DEBUG nova.objects.instance [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lazy-loading 'resources' on Instance uuid 38451776-a726-4569-84c2-10874b488951 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2095782534',display_name='tempest-DeleteServersTestJSON-server-2095782534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2095782534',id=21,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:07:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60190867db3f422fa01488fa7d82312d',ramdisk_id='',reservation_id='r-82h84glh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1079323567',owner_user_name='tempest-DeleteServersTestJSON-1079323567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:07:05Z,user_data=None,user_id='fc4a3d8c43d346e6be22348e0de295fa',uuid=38451776-a726-4569-84c2-10874b488951,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "address": "fa:16:3e:07:11:a4", "network": {"id": "b61eb188-49c5-416d-85f3-59eff43477be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-19142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60190867db3f422fa01488fa7d82312d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea4c6c1-ca", "ovs_interfaceid": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Converting VIF {"id": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "address": "fa:16:3e:07:11:a4", "network": {"id": "b61eb188-49c5-416d-85f3-59eff43477be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-19142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60190867db3f422fa01488fa7d82312d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea4c6c1-ca", "ovs_interfaceid": "1ea4c6c1-ca0a-41b6-a71c-092df222da26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:11:a4,bridge_name='br-int',has_traffic_filtering=True,id=1ea4c6c1-ca0a-41b6-a71c-092df222da26,network=Network(b61eb188-49c5-416d-85f3-59eff43477be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ea4c6c1-ca') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_vif [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:11:a4,bridge_name='br-int',has_traffic_filtering=True,id=1ea4c6c1-ca0a-41b6-a71c-092df222da26,network=Network(b61eb188-49c5-416d-85f3-59eff43477be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ea4c6c1-ca') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ea4c6c1-ca, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57de51e7-3642-4b46-966b-0832801e70be) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:02 user nova-compute[75246]: INFO os_vif [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:11:a4,bridge_name='br-int',has_traffic_filtering=True,id=1ea4c6c1-ca0a-41b6-a71c-092df222da26,network=Network(b61eb188-49c5-416d-85f3-59eff43477be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ea4c6c1-ca')
Nov 28 17:09:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqfFEDch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:09:02 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf0f8be-5882-4894-a16f-ec7abcf0050e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:09:02 user nova-compute[75246]: No targets found.
Nov 28 17:09:02 user nova-compute[75246]: iSNS:
Nov 28 17:09:02 user nova-compute[75246]: No targets found.
Nov 28 17:09:02 user nova-compute[75246]: STATIC:
Nov 28 17:09:02 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468
Nov 28 17:09:02 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:09:02 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:09:02 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02
Nov 28 17:09:02 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:09:02 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:09:02 user nova-compute[75246]: FIRMWARE:
Nov 28 17:09:02 user nova-compute[75246]: No targets found.
Nov 28 17:09:02 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:09:02 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:09:02 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[839ac261-d88e-40ad-a6b4-f84d2be4c7b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b3f05b-f8f6-4a8f-916b-7bd7abcea4d4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)
Nov 28 17:09:02 user nova-compute[75246]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 (non-flash)
Nov 28 17:09:02 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)
Nov 28 17:09:02 user nova-compute[75246]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 (non-flash)
Nov 28 17:09:02 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f80ee7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468'): ({'sdc'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Removing single pathed devices sdc {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3568e131-11a1-4619-99b6-4176b1dfc3c9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e1f6ad-262d-4711-9d13-d4416f1f5cd8]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Flushing IO for device /dev/sdc {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ded99ea-dd84-4944-b9b7-223f56a8835b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f126639-f546-4b00-bb2b-b13749969a85]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[985842c1-9d0a-4a60-9360-12d97154bf3e]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[725bad1d-2997-44a3-bdcc-a1219a1fc020]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468, portal: 172.16.0.220,3260]
Nov 28 17:09:02 user nova-compute[75246]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468, portal: 172.16.0.220,3260] successful.
Nov 28 17:09:02 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7efa09bd-421f-4dfe-84c1-10a4a3c57468 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[63087777-0dae-4ccf-b95b-fc763baf7574]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] <== disconnect_volume: return (342ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:09:02 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Deleting instance files /opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951_del
Nov 28 17:09:02 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Deletion of /opt/stack/data/nova/instances/38451776-a726-4569-84c2-10874b488951_del complete
Nov 28 17:09:02 user nova-compute[75246]: INFO nova.compute.manager [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 28 17:09:02 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 38451776-a726-4569-84c2-10874b488951] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 38451776-a726-4569-84c2-10874b488951] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 38451776-a726-4569-84c2-10874b488951] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:09:03 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 38451776-a726-4569-84c2-10874b488951] Took 0.57 seconds to deallocate network for instance.
Nov 28 17:09:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-bd852ece-b0b0-4aed-85b0-10d53fa56564 req-cc43e97b-b68d-451a-b5ce-2fe049e6080d service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Received event network-vif-deleted-1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:09:03 user nova-compute[75246]: INFO nova.compute.manager [req-bd852ece-b0b0-4aed-85b0-10d53fa56564 req-cc43e97b-b68d-451a-b5ce-2fe049e6080d service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Neutron deleted interface 1ea4c6c1-ca0a-41b6-a71c-092df222da26; detaching it from the instance and deleting it from the info cache
Nov 28 17:09:03 user nova-compute[75246]: DEBUG nova.network.neutron [req-bd852ece-b0b0-4aed-85b0-10d53fa56564 req-cc43e97b-b68d-451a-b5ce-2fe049e6080d service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-bd852ece-b0b0-4aed-85b0-10d53fa56564 req-cc43e97b-b68d-451a-b5ce-2fe049e6080d service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Detach interface failed, port_id=1ea4c6c1-ca0a-41b6-a71c-092df222da26, reason: Instance 38451776-a726-4569-84c2-10874b488951 could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Received event network-vif-plugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] Acquiring lock "38451776-a726-4569-84c2-10874b488951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] Lock "38451776-a726-4569-84c2-10874b488951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] Lock "38451776-a726-4569-84c2-10874b488951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] No waiting events found dispatching network-vif-plugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:09:03 user nova-compute[75246]: WARNING nova.compute.manager [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Received unexpected event network-vif-plugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 for instance with vm_state active and task_state deleting.
Nov 28 17:09:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Received event network-vif-plugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] Acquiring lock "38451776-a726-4569-84c2-10874b488951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] Lock "38451776-a726-4569-84c2-10874b488951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] Lock "38451776-a726-4569-84c2-10874b488951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] No waiting events found dispatching network-vif-plugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:09:03 user nova-compute[75246]: WARNING nova.compute.manager [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Received unexpected event network-vif-plugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 for instance with vm_state active and task_state deleting.
Nov 28 17:09:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Received event network-vif-plugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] Acquiring lock "38451776-a726-4569-84c2-10874b488951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] Lock "38451776-a726-4569-84c2-10874b488951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] Lock "38451776-a726-4569-84c2-10874b488951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] No waiting events found dispatching network-vif-plugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:09:03 user nova-compute[75246]: WARNING nova.compute.manager [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Received unexpected event network-vif-plugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 for instance with vm_state active and task_state deleting.
Nov 28 17:09:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Received event network-vif-unplugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] Acquiring lock "38451776-a726-4569-84c2-10874b488951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] Lock "38451776-a726-4569-84c2-10874b488951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] Lock "38451776-a726-4569-84c2-10874b488951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] No waiting events found dispatching network-vif-unplugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Received event network-vif-unplugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Received event network-vif-plugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] Acquiring lock "38451776-a726-4569-84c2-10874b488951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] Lock "38451776-a726-4569-84c2-10874b488951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] Lock "38451776-a726-4569-84c2-10874b488951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] No waiting events found dispatching network-vif-plugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:09:03 user nova-compute[75246]: WARNING nova.compute.manager [req-9e8b46a3-c804-47c9-b14d-cc4773078a05 req-69ccc766-55c6-4b87-8ca7-662159cce2f4 service nova] [instance: 38451776-a726-4569-84c2-10874b488951] Received unexpected event network-vif-plugged-1ea4c6c1-ca0a-41b6-a71c-092df222da26 for instance with vm_state active and task_state deleting.
Nov 28 17:09:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "86142721-b9dd-44ab-b994-f81443b5383c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "86142721-b9dd-44ab-b994-f81443b5383c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "86142721-b9dd-44ab-b994-f81443b5383c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "86142721-b9dd-44ab-b994-f81443b5383c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "86142721-b9dd-44ab-b994-f81443b5383c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:05 user nova-compute[75246]: INFO nova.compute.manager [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Terminating instance
Nov 28 17:09:05 user nova-compute[75246]: DEBUG nova.compute.manager [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:05 user nova-compute[75246]: INFO nova.compute.manager [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] [instance: 38451776-a726-4569-84c2-10874b488951] Took 2.33 seconds to detach 1 volumes for instance.
Nov 28 17:09:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-370b4832-e034-4e7e-92b2-67bf66f42efe req-ca4be4d9-7bc1-4f2a-9d75-242d0155e17d service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received event network-vif-unplugged-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-370b4832-e034-4e7e-92b2-67bf66f42efe req-ca4be4d9-7bc1-4f2a-9d75-242d0155e17d service nova] Acquiring lock "86142721-b9dd-44ab-b994-f81443b5383c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-370b4832-e034-4e7e-92b2-67bf66f42efe req-ca4be4d9-7bc1-4f2a-9d75-242d0155e17d service nova] Lock "86142721-b9dd-44ab-b994-f81443b5383c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-370b4832-e034-4e7e-92b2-67bf66f42efe req-ca4be4d9-7bc1-4f2a-9d75-242d0155e17d service nova] Lock "86142721-b9dd-44ab-b994-f81443b5383c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-370b4832-e034-4e7e-92b2-67bf66f42efe req-ca4be4d9-7bc1-4f2a-9d75-242d0155e17d service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] No waiting events found dispatching network-vif-unplugged-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-370b4832-e034-4e7e-92b2-67bf66f42efe req-ca4be4d9-7bc1-4f2a-9d75-242d0155e17d service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received event network-vif-unplugged-2438ce69-6032-4ced-abea-84518ff89dfb for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:09:05 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Instance destroyed successfully.
Nov 28 17:09:05 user nova-compute[75246]: DEBUG nova.objects.instance [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lazy-loading 'resources' on Instance uuid 86142721-b9dd-44ab-b994-f81443b5383c {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T17:03:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-982853153',display_name='tempest-ServerActionsTestOtherA-server-1558896318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-982853153',id=15,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsIJC+q4Y4+55AC0y9HnA2vvt/v6RCSMYzioCDQ5Wqsi/6fMiuZzeuzQCkQ89dqnBC2m8g7FsGK4x+WMLFrWYG5HbTNoob2Sth9T+5kRFE/RvVS0LYqJNwESjTmUvS1xg==',key_name='tempest-keypair-2146767292',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:05:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be06eee4e74a41b799f1df75ea55b955',ramdisk_id='',reservation_id='r-j7yi3b0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1554281978',owner_user_name='tempest-ServerActionsTestOtherA-1554281978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:05:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39d2eb0837eb4c729fe9ca2964cbe789',uuid=86142721-b9dd-44ab-b994-f81443b5383c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converting VIF {"id": "2438ce69-6032-4ced-abea-84518ff89dfb", "address": "fa:16:3e:b8:31:e2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2438ce69-60", "ovs_interfaceid": "2438ce69-6032-4ced-abea-84518ff89dfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:31:e2,bridge_name='br-int',has_traffic_filtering=True,id=2438ce69-6032-4ced-abea-84518ff89dfb,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2438ce69-60') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG os_vif [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:31:e2,bridge_name='br-int',has_traffic_filtering=True,id=2438ce69-6032-4ced-abea-84518ff89dfb,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2438ce69-60') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2438ce69-60, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=853a26a8-85ad-423c-8e58-656dd9ffbe63) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:09:05 user nova-compute[75246]: INFO os_vif [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:31:e2,bridge_name='br-int',has_traffic_filtering=True,id=2438ce69-6032-4ced-abea-84518ff89dfb,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2438ce69-60')
Nov 28 17:09:05 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Deleting instance files /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c_del
Nov 28 17:09:05 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Deletion of /opt/stack/data/nova/instances/86142721-b9dd-44ab-b994-f81443b5383c_del complete
Nov 28 17:09:05 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:09:05 user nova-compute[75246]: INFO nova.compute.manager [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 28 17:09:05 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:09:05 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:09:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:06 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Deleted allocations for instance 38451776-a726-4569-84c2-10874b488951
Nov 28 17:09:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e334c7e2-167c-4bc9-94d9-3cce1499338d tempest-DeleteServersTestJSON-1079323567 tempest-DeleteServersTestJSON-1079323567-project-member] Lock "38451776-a726-4569-84c2-10874b488951" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.845s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:06 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:09:06 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Took 0.91 seconds to deallocate network for instance.
Nov 28 17:09:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-239aa9e2-7fd2-4a54-8947-cde15b3f3a43 req-1446759b-1e91-4bb7-8b74-ddd4e343b5f3 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received event network-vif-deleted-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:09:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:07 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:09:07 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:09:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:07 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Deleted allocations for instance 86142721-b9dd-44ab-b994-f81443b5383c
Nov 28 17:09:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-15b2657b-1ae1-4436-96aa-6429a5fa3e72 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "86142721-b9dd-44ab-b994-f81443b5383c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.339s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:07 user nova-compute[75246]: DEBUG nova.compute.manager [req-56d85da7-13cb-4c28-9efe-78381e9fae2a req-d47ae400-7266-4463-b19f-7de10197ae14 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received event network-vif-plugged-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:09:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-56d85da7-13cb-4c28-9efe-78381e9fae2a req-d47ae400-7266-4463-b19f-7de10197ae14 service nova] Acquiring lock "86142721-b9dd-44ab-b994-f81443b5383c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-56d85da7-13cb-4c28-9efe-78381e9fae2a req-d47ae400-7266-4463-b19f-7de10197ae14 service nova] Lock "86142721-b9dd-44ab-b994-f81443b5383c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-56d85da7-13cb-4c28-9efe-78381e9fae2a req-d47ae400-7266-4463-b19f-7de10197ae14 service nova] Lock "86142721-b9dd-44ab-b994-f81443b5383c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:07 user nova-compute[75246]: DEBUG nova.compute.manager [req-56d85da7-13cb-4c28-9efe-78381e9fae2a req-d47ae400-7266-4463-b19f-7de10197ae14 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] No waiting events found dispatching network-vif-plugged-2438ce69-6032-4ced-abea-84518ff89dfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:09:07 user nova-compute[75246]: WARNING nova.compute.manager [req-56d85da7-13cb-4c28-9efe-78381e9fae2a req-d47ae400-7266-4463-b19f-7de10197ae14 service nova] [instance: 86142721-b9dd-44ab-b994-f81443b5383c] Received unexpected event network-vif-plugged-2438ce69-6032-4ced-abea-84518ff89dfb for instance with vm_state deleted and task_state None.
Nov 28 17:09:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:15 user nova-compute[75246]: INFO nova.compute.manager [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Terminating instance
Nov 28 17:09:15 user nova-compute[75246]: DEBUG nova.compute.manager [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-11215836-1e35-4ff8-9550-f1f74f8d60c5 req-12f0ff15-c9d0-4829-995b-0cf70324a47b service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received event network-vif-unplugged-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-11215836-1e35-4ff8-9550-f1f74f8d60c5 req-12f0ff15-c9d0-4829-995b-0cf70324a47b service nova] Acquiring lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-11215836-1e35-4ff8-9550-f1f74f8d60c5 req-12f0ff15-c9d0-4829-995b-0cf70324a47b service nova] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-11215836-1e35-4ff8-9550-f1f74f8d60c5 req-12f0ff15-c9d0-4829-995b-0cf70324a47b service nova] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-11215836-1e35-4ff8-9550-f1f74f8d60c5 req-12f0ff15-c9d0-4829-995b-0cf70324a47b service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] No waiting events found dispatching network-vif-unplugged-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-11215836-1e35-4ff8-9550-f1f74f8d60c5 req-12f0ff15-c9d0-4829-995b-0cf70324a47b service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received event network-vif-unplugged-8932d31b-ff61-4b52-9f2d-a646560d3777 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:09:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Instance destroyed successfully.
Nov 28 17:09:16 user nova-compute[75246]: DEBUG nova.objects.instance [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lazy-loading 'resources' on Instance uuid 6579e6f5-93be-4b39-9c61-ca3dbc40b79f {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:04:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1459152348',display_name='tempest-TestMinimumBasicScenario-server-1459152348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1459152348',id=18,image_ref='314c5acf-fabe-491c-8951-2240751d2dd2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV+cCKVKkKjippHw8fvg8ZUQ588Q45fV8SzYDVWZENrWtuGg6Vh8hnO4mjpQRK6qsK31ree66V8juizOkiDArzejhbRH/K2TpIsEaUaC5icEpgo6owAmBBXtqppX4HiNQ==',key_name='tempest-TestMinimumBasicScenario-700258823',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:04:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d01a3eaa26b4fc790abe7761fb2bb8a',ramdisk_id='',reservation_id='r-5f8m3x0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='314c5acf-fabe-491c-8951-2240751d2dd2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-433831737',owner_user_name='tempest-TestMinimumBasicScenario-433831737-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:06:37Z,user_data=None,user_id='194df496b87a48d68835cb7aa0802560',uuid=6579e6f5-93be-4b39-9c61-ca3dbc40b79f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Converting VIF {"id": "8932d31b-ff61-4b52-9f2d-a646560d3777", "address": "fa:16:3e:2c:21:7a", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8932d31b-ff", "ovs_interfaceid": "8932d31b-ff61-4b52-9f2d-a646560d3777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:21:7a,bridge_name='br-int',has_traffic_filtering=True,id=8932d31b-ff61-4b52-9f2d-a646560d3777,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8932d31b-ff') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG os_vif [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:21:7a,bridge_name='br-int',has_traffic_filtering=True,id=8932d31b-ff61-4b52-9f2d-a646560d3777,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8932d31b-ff') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8932d31b-ff, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b243ec5e-95a1-4f07-b636-39493dfb7c95) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:16 user nova-compute[75246]: INFO os_vif [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:21:7a,bridge_name='br-int',has_traffic_filtering=True,id=8932d31b-ff61-4b52-9f2d-a646560d3777,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8932d31b-ff')
Nov 28 17:09:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Deleting instance files /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f_del
Nov 28 17:09:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Deletion of /opt/stack/data/nova/instances/6579e6f5-93be-4b39-9c61-ca3dbc40b79f_del complete
Nov 28 17:09:16 user nova-compute[75246]: INFO nova.compute.manager [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 28 17:09:16 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:09:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:17 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:09:17 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Took 0.50 seconds to deallocate network for instance.
Nov 28 17:09:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-616e35a6-d501-4735-b34d-3f7685fa7695 req-3eefbf82-f074-45f2-9716-053ce9a202c9 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received event network-vif-deleted-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:09:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:17 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:09:17 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:09:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:17 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Deleted allocations for instance 6579e6f5-93be-4b39-9c61-ca3dbc40b79f
Nov 28 17:09:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66b2d45e-5f6f-40d3-b0a0-0d6c2d235ae4 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.840s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-1f2b7c1e-21d8-4cd1-a8df-f7356e099448 req-c5f17731-15a1-493b-9a4a-bdb2777820f5 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received event network-vif-plugged-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:09:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1f2b7c1e-21d8-4cd1-a8df-f7356e099448 req-c5f17731-15a1-493b-9a4a-bdb2777820f5 service nova] Acquiring lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1f2b7c1e-21d8-4cd1-a8df-f7356e099448 req-c5f17731-15a1-493b-9a4a-bdb2777820f5 service nova] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1f2b7c1e-21d8-4cd1-a8df-f7356e099448 req-c5f17731-15a1-493b-9a4a-bdb2777820f5 service nova] Lock "6579e6f5-93be-4b39-9c61-ca3dbc40b79f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-1f2b7c1e-21d8-4cd1-a8df-f7356e099448 req-c5f17731-15a1-493b-9a4a-bdb2777820f5 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] No waiting events found dispatching network-vif-plugged-8932d31b-ff61-4b52-9f2d-a646560d3777 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:09:18 user nova-compute[75246]: WARNING nova.compute.manager [req-1f2b7c1e-21d8-4cd1-a8df-f7356e099448 req-c5f17731-15a1-493b-9a4a-bdb2777820f5 service nova] [instance: 6579e6f5-93be-4b39-9c61-ca3dbc40b79f] Received unexpected event network-vif-plugged-8932d31b-ff61-4b52-9f2d-a646560d3777 for instance with vm_state deleted and task_state None.
Nov 28 17:09:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:21 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:09:22 user nova-compute[75246]: DEBUG nova.compute.manager [req-59e75f08-41f5-45a9-87d0-449c46b3ff04 req-9592d312-eb5f-4d64-acc9-cfb52646d3b7 service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Received event network-changed-c3201b44-4689-4e0e-8fcd-1e9bd2de0279 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:09:22 user nova-compute[75246]: DEBUG nova.compute.manager [req-59e75f08-41f5-45a9-87d0-449c46b3ff04 req-9592d312-eb5f-4d64-acc9-cfb52646d3b7 service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Refreshing instance network info cache due to event network-changed-c3201b44-4689-4e0e-8fcd-1e9bd2de0279. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:09:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-59e75f08-41f5-45a9-87d0-449c46b3ff04 req-9592d312-eb5f-4d64-acc9-cfb52646d3b7 service nova] Acquiring lock "refresh_cache-201f0afe-8508-4357-8786-f62b70866aae" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:09:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-59e75f08-41f5-45a9-87d0-449c46b3ff04 req-9592d312-eb5f-4d64-acc9-cfb52646d3b7 service nova] Acquired lock "refresh_cache-201f0afe-8508-4357-8786-f62b70866aae" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:09:22 user nova-compute[75246]: DEBUG nova.network.neutron [req-59e75f08-41f5-45a9-87d0-449c46b3ff04 req-9592d312-eb5f-4d64-acc9-cfb52646d3b7 service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Refreshing network info cache for port c3201b44-4689-4e0e-8fcd-1e9bd2de0279 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:09:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:23 user nova-compute[75246]: DEBUG nova.network.neutron [req-59e75f08-41f5-45a9-87d0-449c46b3ff04 req-9592d312-eb5f-4d64-acc9-cfb52646d3b7 service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Updated VIF entry in instance network info cache for port c3201b44-4689-4e0e-8fcd-1e9bd2de0279. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:09:23 user nova-compute[75246]: DEBUG nova.network.neutron [req-59e75f08-41f5-45a9-87d0-449c46b3ff04 req-9592d312-eb5f-4d64-acc9-cfb52646d3b7 service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Updating instance_info_cache with network_info: [{"id": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "address": "fa:16:3e:21:36:22", "network": {"id": "2780db75-33d3-4c1b-9f6b-ebf1527a1675", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-198988837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2faaf456953448b8b999ce71bfae9478", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3201b44-46", "ovs_interfaceid": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:09:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-59e75f08-41f5-45a9-87d0-449c46b3ff04 req-9592d312-eb5f-4d64-acc9-cfb52646d3b7 service nova] Releasing lock "refresh_cache-201f0afe-8508-4357-8786-f62b70866aae" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:09:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Acquiring lock "201f0afe-8508-4357-8786-f62b70866aae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "201f0afe-8508-4357-8786-f62b70866aae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:25 user nova-compute[75246]: DEBUG nova.objects.instance [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lazy-loading 'flavor' on Instance uuid 201f0afe-8508-4357-8786-f62b70866aae {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:09:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "201f0afe-8508-4357-8786-f62b70866aae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:25 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Acquiring lock "201f0afe-8508-4357-8786-f62b70866aae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "201f0afe-8508-4357-8786-f62b70866aae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:26 user nova-compute[75246]: INFO nova.compute.manager [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Attaching volume a78675ff-dcd9-4b85-b245-3685f2de8554 to /dev/vdb
Nov 28 17:09:26 user nova-compute[75246]: DEBUG os_brick.utils [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[243b0786-9de6-4eeb-a9f6-27bb7118da4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07ed9a8-501d-4eb4-85fd-15983fe09bb8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b3579d-75f1-4391-95eb-41d6e7bbba73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[694d79cb-e7fe-41e4-b4e3-b29442a6edb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:09:26 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:09:26 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caa78c9-c58e-43f5-905c-ca4f429f53c2]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG os_brick.utils [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Updating existing volume attachment record: 6565501a-60cc-4d3f-b22d-ea2c1a692e6e {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:09:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:28 user nova-compute[75246]: DEBUG nova.compute.manager [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:09:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:28 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:09:28 user nova-compute[75246]: INFO nova.compute.claims [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Claim successful on node user
Nov 28 17:09:28 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:09:28 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:09:28 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: c94900af-f484-47bf-8627-8aa863334b63] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG nova.compute.manager [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG nova.compute.manager [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG nova.network.neutron [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:09:29 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:09:29 user nova-compute[75246]: DEBUG nova.compute.manager [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG nova.policy [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03ae91a734974162a14d7b4c498c4b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d39dde859674409847b50613bcc608b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG nova.compute.manager [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:09:29 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Creating image(s)
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "/opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "/opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.235s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: c94900af-f484-47bf-8627-8aa863334b63] Updating instance_info_cache with network_info: [{"id": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "address": "fa:16:3e:e3:8a:cb", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dca6bfe-f1", "ovs_interfaceid": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: c94900af-f484-47bf-8627-8aa863334b63] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.176s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk 1073741824" returned: 0 in 0.055s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.209s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Cannot resize image /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Ensure instance console log exists: /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG nova.network.neutron [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Successfully created port: 26eaa437-c34e-4b6f-b907-e3083bc7b10a {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG nova.network.neutron [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Successfully updated port: 26eaa437-c34e-4b6f-b907-e3083bc7b10a {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG nova.compute.manager [req-0ef1f5f7-3182-48b4-ab10-ed40a3439caa req-ffab249d-cecb-4c94-a724-e46afa8b8372 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Received event network-changed-26eaa437-c34e-4b6f-b907-e3083bc7b10a {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG nova.compute.manager [req-0ef1f5f7-3182-48b4-ab10-ed40a3439caa req-ffab249d-cecb-4c94-a724-e46afa8b8372 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Refreshing instance network info cache due to event network-changed-26eaa437-c34e-4b6f-b907-e3083bc7b10a. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0ef1f5f7-3182-48b4-ab10-ed40a3439caa req-ffab249d-cecb-4c94-a724-e46afa8b8372 service nova] Acquiring lock "refresh_cache-aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0ef1f5f7-3182-48b4-ab10-ed40a3439caa req-ffab249d-cecb-4c94-a724-e46afa8b8372 service nova] Acquired lock "refresh_cache-aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG nova.network.neutron [req-0ef1f5f7-3182-48b4-ab10-ed40a3439caa req-ffab249d-cecb-4c94-a724-e46afa8b8372 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Refreshing network info cache for port 26eaa437-c34e-4b6f-b907-e3083bc7b10a {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "refresh_cache-aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG nova.network.neutron [req-0ef1f5f7-3182-48b4-ab10-ed40a3439caa req-ffab249d-cecb-4c94-a724-e46afa8b8372 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:31 user nova-compute[75246]: DEBUG nova.network.neutron [req-0ef1f5f7-3182-48b4-ab10-ed40a3439caa req-ffab249d-cecb-4c94-a724-e46afa8b8372 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0ef1f5f7-3182-48b4-ab10-ed40a3439caa req-ffab249d-cecb-4c94-a724-e46afa8b8372 service nova] Releasing lock "refresh_cache-aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquired lock "refresh_cache-aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.network.neutron [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.network.neutron [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.network.neutron [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Updating instance_info_cache with network_info: [{"id": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "address": "fa:16:3e:75:a4:ec", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26eaa437-c3", "ovs_interfaceid": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Releasing lock "refresh_cache-aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.compute.manager [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Instance network_info: |[{"id": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "address": "fa:16:3e:75:a4:ec", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26eaa437-c3", "ovs_interfaceid": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Start _get_guest_xml network_info=[{"id": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "address": "fa:16:3e:75:a4:ec", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26eaa437-c3", "ovs_interfaceid": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:09:32 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:09:32 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1587321449',display_name='tempest-AttachVolumeNegativeTest-server-1587321449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1587321449',id=23,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMJpyaT8CK+Br7PkJisTxCGe990GQUVzKkTd8HJwrslD24/jfvlsksP/66OPc0gL3eNW2409OuXhOMmHcyGBHXc6I7Sax3GX0L0tFRZT9xf3bufQ4/MbAO1PypFyMBDBA==',key_name='tempest-keypair-1614315722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d39dde859674409847b50613bcc608b',ramdisk_id='',reservation_id='r-bk1g2e0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-524813585',owner_user_name='tempest-AttachVolumeNegativeTest-524813585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:09:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ae91a734974162a14d7b4c498c4b8d',uuid=aa9ef0b8-3519-416a-b42c-cd953c4ddc0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "address": "fa:16:3e:75:a4:ec", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26eaa437-c3", "ovs_interfaceid": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converting VIF {"id": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "address": "fa:16:3e:75:a4:ec", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26eaa437-c3", "ovs_interfaceid": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a4:ec,bridge_name='br-int',has_traffic_filtering=True,id=26eaa437-c34e-4b6f-b907-e3083bc7b10a,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26eaa437-c3') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.objects.instance [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lazy-loading 'pci_devices' on Instance uuid aa9ef0b8-3519-416a-b42c-cd953c4ddc0d {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:09:32 user nova-compute[75246]:   <uuid>aa9ef0b8-3519-416a-b42c-cd953c4ddc0d</uuid>
Nov 28 17:09:32 user nova-compute[75246]:   <name>instance-00000017</name>
Nov 28 17:09:32 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:09:32 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:09:32 user nova-compute[75246]:   <metadata>
Nov 28 17:09:32 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:09:32 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:09:32 user nova-compute[75246]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1587321449</nova:name>
Nov 28 17:09:32 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:09:32</nova:creationTime>
Nov 28 17:09:32 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:09:32 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:09:32 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:09:32 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:09:32 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:09:32 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:09:32 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:09:32 user nova-compute[75246]:       <nova:owner>
Nov 28 17:09:32 user nova-compute[75246]:         <nova:user uuid="03ae91a734974162a14d7b4c498c4b8d">tempest-AttachVolumeNegativeTest-524813585-project-member</nova:user>
Nov 28 17:09:32 user nova-compute[75246]:         <nova:project uuid="9d39dde859674409847b50613bcc608b">tempest-AttachVolumeNegativeTest-524813585</nova:project>
Nov 28 17:09:32 user nova-compute[75246]:       </nova:owner>
Nov 28 17:09:32 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:09:32 user nova-compute[75246]:       <nova:ports>
Nov 28 17:09:32 user nova-compute[75246]:         <nova:port uuid="26eaa437-c34e-4b6f-b907-e3083bc7b10a">
Nov 28 17:09:32 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 17:09:32 user nova-compute[75246]:         </nova:port>
Nov 28 17:09:32 user nova-compute[75246]:       </nova:ports>
Nov 28 17:09:32 user nova-compute[75246]:     </nova:instance>
Nov 28 17:09:32 user nova-compute[75246]:   </metadata>
Nov 28 17:09:32 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:09:32 user nova-compute[75246]:     <system>
Nov 28 17:09:32 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:09:32 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:09:32 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:09:32 user nova-compute[75246]:       <entry name="serial">aa9ef0b8-3519-416a-b42c-cd953c4ddc0d</entry>
Nov 28 17:09:32 user nova-compute[75246]:       <entry name="uuid">aa9ef0b8-3519-416a-b42c-cd953c4ddc0d</entry>
Nov 28 17:09:32 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:09:32 user nova-compute[75246]:     </system>
Nov 28 17:09:32 user nova-compute[75246]:   </sysinfo>
Nov 28 17:09:32 user nova-compute[75246]:   <os>
Nov 28 17:09:32 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:09:32 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:09:32 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:09:32 user nova-compute[75246]:   </os>
Nov 28 17:09:32 user nova-compute[75246]:   <features>
Nov 28 17:09:32 user nova-compute[75246]:     <acpi/>
Nov 28 17:09:32 user nova-compute[75246]:     <apic/>
Nov 28 17:09:32 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:09:32 user nova-compute[75246]:   </features>
Nov 28 17:09:32 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:09:32 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:09:32 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:09:32 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:09:32 user nova-compute[75246]:   </clock>
Nov 28 17:09:32 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:09:32 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:09:32 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:09:32 user nova-compute[75246]:   </cpu>
Nov 28 17:09:32 user nova-compute[75246]:   <devices>
Nov 28 17:09:32 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:09:32 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:09:32 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk"/>
Nov 28 17:09:32 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:09:32 user nova-compute[75246]:     </disk>
Nov 28 17:09:32 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:09:32 user nova-compute[75246]:       <mac address="fa:16:3e:75:a4:ec"/>
Nov 28 17:09:32 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:09:32 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:09:32 user nova-compute[75246]:       <target dev="tap26eaa437-c3"/>
Nov 28 17:09:32 user nova-compute[75246]:     </interface>
Nov 28 17:09:32 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:09:32 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/console.log" append="off"/>
Nov 28 17:09:32 user nova-compute[75246]:     </serial>
Nov 28 17:09:32 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:09:32 user nova-compute[75246]:     <video>
Nov 28 17:09:32 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:09:32 user nova-compute[75246]:     </video>
Nov 28 17:09:32 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:09:32 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:09:32 user nova-compute[75246]:     </rng>
Nov 28 17:09:32 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:09:32 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:09:32 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:09:32 user nova-compute[75246]:     </memballoon>
Nov 28 17:09:32 user nova-compute[75246]:   </devices>
Nov 28 17:09:32 user nova-compute[75246]: </domain>
Nov 28 17:09:32 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1587321449',display_name='tempest-AttachVolumeNegativeTest-server-1587321449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1587321449',id=23,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMJpyaT8CK+Br7PkJisTxCGe990GQUVzKkTd8HJwrslD24/jfvlsksP/66OPc0gL3eNW2409OuXhOMmHcyGBHXc6I7Sax3GX0L0tFRZT9xf3bufQ4/MbAO1PypFyMBDBA==',key_name='tempest-keypair-1614315722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d39dde859674409847b50613bcc608b',ramdisk_id='',reservation_id='r-bk1g2e0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-524813585',owner_user_name='tempest-AttachVolumeNegativeTest-524813585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:09:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ae91a734974162a14d7b4c498c4b8d',uuid=aa9ef0b8-3519-416a-b42c-cd953c4ddc0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "address": "fa:16:3e:75:a4:ec", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26eaa437-c3", "ovs_interfaceid": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converting VIF {"id": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "address": "fa:16:3e:75:a4:ec", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26eaa437-c3", "ovs_interfaceid": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a4:ec,bridge_name='br-int',has_traffic_filtering=True,id=26eaa437-c34e-4b6f-b907-e3083bc7b10a,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26eaa437-c3') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG os_vif [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a4:ec,bridge_name='br-int',has_traffic_filtering=True,id=26eaa437-c34e-4b6f-b907-e3083bc7b10a,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26eaa437-c3') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '657a147e-5b92-5fd7-81ec-4c612ce789b5', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk.rescue --force-share --output=json" returned: 0 in 0.248s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26eaa437-c3, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26eaa437-c3, col_values=(('qos', UUID('3388db8b-36f3-4893-9244-98ff4e4abb31')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26eaa437-c3, col_values=(('external_ids', {'iface-id': '26eaa437-c34e-4b6f-b907-e3083bc7b10a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:a4:ec', 'vm-uuid': 'aa9ef0b8-3519-416a-b42c-cd953c4ddc0d'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:32 user nova-compute[75246]: INFO os_vif [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a4:ec,bridge_name='br-int',has_traffic_filtering=True,id=26eaa437-c34e-4b6f-b907-e3083bc7b10a,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26eaa437-c3')
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:09:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] No VIF found with MAC fa:16:3e:75:a4:ec, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:09:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:33 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:09:33 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:09:33 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8073MB free_disk=25.523845672607422GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:09:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e1266470-c182-4c0c-a575-4c5043f54745 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c94900af-f484-47bf-8627-8aa863334b63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 201f0afe-8508-4357-8786-f62b70866aae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 0d952de1-8c78-4bea-853d-21ac4f979845 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance aa9ef0b8-3519-416a-b42c-cd953c4ddc0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-49a174c7-b8b5-439d-935a-05f6a67c0428 req-1a32ae91-070e-4a5e-b75e-527cb19d5a37 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Received event network-vif-plugged-26eaa437-c34e-4b6f-b907-e3083bc7b10a {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-49a174c7-b8b5-439d-935a-05f6a67c0428 req-1a32ae91-070e-4a5e-b75e-527cb19d5a37 service nova] Acquiring lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-49a174c7-b8b5-439d-935a-05f6a67c0428 req-1a32ae91-070e-4a5e-b75e-527cb19d5a37 service nova] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-49a174c7-b8b5-439d-935a-05f6a67c0428 req-1a32ae91-070e-4a5e-b75e-527cb19d5a37 service nova] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-49a174c7-b8b5-439d-935a-05f6a67c0428 req-1a32ae91-070e-4a5e-b75e-527cb19d5a37 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] No waiting events found dispatching network-vif-plugged-26eaa437-c34e-4b6f-b907-e3083bc7b10a {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:09:34 user nova-compute[75246]: WARNING nova.compute.manager [req-49a174c7-b8b5-439d-935a-05f6a67c0428 req-1a32ae91-070e-4a5e-b75e-527cb19d5a37 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Received unexpected event network-vif-plugged-26eaa437-c34e-4b6f-b907-e3083bc7b10a for instance with vm_state building and task_state spawning.
Nov 28 17:09:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:09:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:09:36 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Instance spawned successfully.
Nov 28 17:09:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:09:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:09:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:09:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:09:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:09:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:09:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:09:36 user nova-compute[75246]: INFO nova.compute.manager [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Took 7.25 seconds to spawn the instance on the hypervisor.
Nov 28 17:09:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:09:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-9bef58a1-8b66-4b42-9dbd-c5acf142be85 req-bac596f2-738e-47d2-9466-384c3a48f357 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Received event network-vif-plugged-26eaa437-c34e-4b6f-b907-e3083bc7b10a {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:09:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9bef58a1-8b66-4b42-9dbd-c5acf142be85 req-bac596f2-738e-47d2-9466-384c3a48f357 service nova] Acquiring lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9bef58a1-8b66-4b42-9dbd-c5acf142be85 req-bac596f2-738e-47d2-9466-384c3a48f357 service nova] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9bef58a1-8b66-4b42-9dbd-c5acf142be85 req-bac596f2-738e-47d2-9466-384c3a48f357 service nova] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-9bef58a1-8b66-4b42-9dbd-c5acf142be85 req-bac596f2-738e-47d2-9466-384c3a48f357 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] No waiting events found dispatching network-vif-plugged-26eaa437-c34e-4b6f-b907-e3083bc7b10a {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:09:36 user nova-compute[75246]: WARNING nova.compute.manager [req-9bef58a1-8b66-4b42-9dbd-c5acf142be85 req-bac596f2-738e-47d2-9466-384c3a48f357 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Received unexpected event network-vif-plugged-26eaa437-c34e-4b6f-b907-e3083bc7b10a for instance with vm_state building and task_state spawning.
Nov 28 17:09:36 user nova-compute[75246]: INFO nova.compute.manager [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Took 8.05 seconds to build instance.
Nov 28 17:09:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-61bb6a80-0fcd-4c68-abf1-a48d7371c33d tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.201s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etsuoFfP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:09:37 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:09:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:09:37 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:09:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:09:37 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deeef62-3c3d-47f3-b7d5-fd06421bbb13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:09:37 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8c5ea9-1ae2-4e93-85ad-415ab5af7c13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554] added
Nov 28 17:09:37 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b678d973-2384-4026-92aa-88a904cb3cdb]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6471f30d-8aca-403f-b513-ca31bd1997f9]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etsuoFfP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etsuoFfP" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[756b12b2-f53c-489f-a36b-17dcfde8a41c]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'etsuoFfP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b2b0da-aeed-4bc2-8e6d-53f0e51228eb]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d10933-2445-487d-beea-2bc60c2f15e2]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)
Nov 28 17:09:37 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)
Nov 28 17:09:37 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:09:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93d5f45-e45e-44bc-88f7-1430c0ee8461]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554, portal: 172.16.0.220,3260]
Nov 28 17:09:38 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554, portal: 172.16.0.220,3260] successful.
Nov 28 17:09:38 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc3c3d3-50ae-455b-9f4f-42bf312eede6]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[43be6b02-ceb0-4f1b-860a-337131f44853]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)
Nov 28 17:09:38 user nova-compute[75246]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 (non-flash)
Nov 28 17:09:38 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)
Nov 28 17:09:38 user nova-compute[75246]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 (non-flash)
Nov 28 17:09:38 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8902a9-cff6-4403-8864-941706f07b25]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:09:38 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:09:39 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:09:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etsuoFfP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:09:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:09:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23235353032363637', 'path': '/dev/sdc'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:09:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235353032363637', 'path': '/dev/sdc'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:09:39 user nova-compute[75246]: DEBUG nova.objects.instance [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lazy-loading 'flavor' on Instance uuid 201f0afe-8508-4357-8786-f62b70866aae {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:09:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:09:39 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:09:39 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:09:39 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:09:39 user nova-compute[75246]:   <serial>a78675ff-dcd9-4b85-b245-3685f2de8554</serial>
Nov 28 17:09:39 user nova-compute[75246]: </disk>
Nov 28 17:09:39 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:09:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:09:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:09:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] No VIF found with MAC fa:16:3e:21:36:22, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:09:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-307637e2-dde6-4e28-98cf-aecb460c08ef tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "201f0afe-8508-4357-8786-f62b70866aae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.648s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:09:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Acquiring lock "201f0afe-8508-4357-8786-f62b70866aae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:09:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "201f0afe-8508-4357-8786-f62b70866aae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:09:41 user nova-compute[75246]: INFO nova.compute.manager [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Detaching volume a78675ff-dcd9-4b85-b245-3685f2de8554
Nov 28 17:09:41 user nova-compute[75246]: INFO nova.virt.block_device [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Attempting to driver detach volume a78675ff-dcd9-4b85-b245-3685f2de8554 from mountpoint /dev/vdb
Nov 28 17:09:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Attempting to detach device vdb from instance 201f0afe-8508-4357-8786-f62b70866aae from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:09:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:09:41 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:09:41 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:09:41 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:09:41 user nova-compute[75246]:   <serial>a78675ff-dcd9-4b85-b245-3685f2de8554</serial>
Nov 28 17:09:41 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:09:41 user nova-compute[75246]: </disk>
Nov 28 17:09:41 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:09:41 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Successfully detached device vdb from instance 201f0afe-8508-4357-8786-f62b70866aae from the persistent domain config.
Nov 28 17:09:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 201f0afe-8508-4357-8786-f62b70866aae from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:09:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:09:41 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:09:41 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:09:41 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:09:41 user nova-compute[75246]:   <serial>a78675ff-dcd9-4b85-b245-3685f2de8554</serial>
Nov 28 17:09:41 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:09:41 user nova-compute[75246]: </disk>
Nov 28 17:09:41 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:09:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 201f0afe-8508-4357-8786-f62b70866aae {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:09:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:09:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:09:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:02 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 201f0afe-8508-4357-8786-f62b70866aae is timed out.
Nov 28 17:10:02 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Successfully detached device vdb from instance 201f0afe-8508-4357-8786-f62b70866aae from the live domain config.
Nov 28 17:10:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etsuoFfP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:10:02 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5476699-81b2-4f35-8e06-309151231930]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:10:02 user nova-compute[75246]: No targets found.
Nov 28 17:10:02 user nova-compute[75246]: iSNS:
Nov 28 17:10:02 user nova-compute[75246]: No targets found.
Nov 28 17:10:02 user nova-compute[75246]: STATIC:
Nov 28 17:10:02 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02
Nov 28 17:10:02 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:10:02 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:10:02 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554
Nov 28 17:10:02 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:10:02 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:10:02 user nova-compute[75246]: FIRMWARE:
Nov 28 17:10:02 user nova-compute[75246]: No targets found.
Nov 28 17:10:02 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:10:02 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:10:02 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee82a40-5416-4dca-b262-fb5b86e68068]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[627f0f6d-5c6b-4d7d-bdf2-1338b2cb28db]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)
Nov 28 17:10:02 user nova-compute[75246]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 (non-flash)
Nov 28 17:10:02 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)
Nov 28 17:10:02 user nova-compute[75246]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 (non-flash)
Nov 28 17:10:02 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4b87105e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554'): ({'sdc'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Removing single pathed devices sdc {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[174ccd20-4690-4c03-a1db-96fee71e0c73]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[94793d67-9d18-4bca-bb80-44a4e1197cd5]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Flushing IO for device /dev/sdc {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[077eb4cf-0bab-4fd8-b33c-20f04adf3fe1]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda4ff5e-4be1-461c-815e-06ea22f4f7cc]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae3bbf8-aa9a-4b3d-ae40-790e31b0ffb8]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33f7a4d-9592-4844-899e-8fbc26f4ee55]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554, portal: 172.16.0.220,3260]
Nov 28 17:10:02 user nova-compute[75246]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554, portal: 172.16.0.220,3260] successful.
Nov 28 17:10:02 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78675ff-dcd9-4b85-b245-3685f2de8554 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7635f4d0-85ab-4d18-b5e2-6ede69eaedb4]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] <== disconnect_volume: return (293ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:10:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:03 user nova-compute[75246]: DEBUG nova.objects.instance [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lazy-loading 'flavor' on Instance uuid 201f0afe-8508-4357-8786-f62b70866aae {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:10:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a72d9e0e-b3a4-4e8f-86b2-07e94dbe9cf1 tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "201f0afe-8508-4357-8786-f62b70866aae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.862s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:10 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:10:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:10 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:10:10 user nova-compute[75246]: INFO nova.compute.claims [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Claim successful on node user
Nov 28 17:10:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:10 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:10:10 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:10:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:10 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:10:11 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:10:11 user nova-compute[75246]: DEBUG nova.network.neutron [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:10:11 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:10:11 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:10:11 user nova-compute[75246]: DEBUG nova.policy [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '194df496b87a48d68835cb7aa0802560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d01a3eaa26b4fc790abe7761fb2bb8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:10:11 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:10:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:10:11 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Creating image(s)
Nov 28 17:10:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "/opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "/opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "/opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "48cc211e93c81418eb476cc0622bb08ddadd0c94" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "48cc211e93c81418eb476cc0622bb08ddadd0c94" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94.part --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:12 user nova-compute[75246]: DEBUG nova.virt.images [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] 54e18ca0-fa62-4673-b826-73048d2c0357 was qcow2, converting to raw {{(pid=75246) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 17:10:12 user nova-compute[75246]: DEBUG nova.privsep.utils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75246) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 17:10:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94.part /opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94.converted {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94.part /opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94.converted" returned: 0 in 0.266s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94.converted --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "48cc211e93c81418eb476cc0622bb08ddadd0c94" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.281s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:12 user nova-compute[75246]: DEBUG nova.network.neutron [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Successfully created port: cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:10:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94 --force-share --output=json" returned: 0 in 0.226s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "48cc211e93c81418eb476cc0622bb08ddadd0c94" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "48cc211e93c81418eb476cc0622bb08ddadd0c94" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94 --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94,backing_fmt=raw /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94,backing_fmt=raw /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk 1073741824" returned: 0 in 0.062s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "48cc211e93c81418eb476cc0622bb08ddadd0c94" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94 --force-share --output=json" returned: 0 in 0.196s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Cannot resize image /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Ensure instance console log exists: /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.network.neutron [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Successfully updated port: cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquired lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.network.neutron [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.network.neutron [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-dddc0fa9-202f-40bb-9dfa-6f6077297eb0 req-186443a7-7d92-49f6-bb50-fb592ef0d481 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received event network-changed-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-dddc0fa9-202f-40bb-9dfa-6f6077297eb0 req-186443a7-7d92-49f6-bb50-fb592ef0d481 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Refreshing instance network info cache due to event network-changed-cadf851f-d826-43fb-984d-4f15cafa5f64. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-dddc0fa9-202f-40bb-9dfa-6f6077297eb0 req-186443a7-7d92-49f6-bb50-fb592ef0d481 service nova] Acquiring lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.network.neutron [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Updating instance_info_cache with network_info: [{"id": "cadf851f-d826-43fb-984d-4f15cafa5f64", "address": "fa:16:3e:74:a8:07", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadf851f-d8", "ovs_interfaceid": "cadf851f-d826-43fb-984d-4f15cafa5f64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Releasing lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Instance network_info: |[{"id": "cadf851f-d826-43fb-984d-4f15cafa5f64", "address": "fa:16:3e:74:a8:07", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadf851f-d8", "ovs_interfaceid": "cadf851f-d826-43fb-984d-4f15cafa5f64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-dddc0fa9-202f-40bb-9dfa-6f6077297eb0 req-186443a7-7d92-49f6-bb50-fb592ef0d481 service nova] Acquired lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.network.neutron [req-dddc0fa9-202f-40bb-9dfa-6f6077297eb0 req-186443a7-7d92-49f6-bb50-fb592ef0d481 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Refreshing network info cache for port cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Start _get_guest_xml network_info=[{"id": "cadf851f-d826-43fb-984d-4f15cafa5f64", "address": "fa:16:3e:74:a8:07", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadf851f-d8", "ovs_interfaceid": "cadf851f-d826-43fb-984d-4f15cafa5f64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T17:10:07Z,direct_url=<?>,disk_format='qcow2',id=54e18ca0-fa62-4673-b826-73048d2c0357,min_disk=0,min_ram=0,name='tempest-scenario-img--71206579',owner='2d01a3eaa26b4fc790abe7761fb2bb8a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T17:10:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '54e18ca0-fa62-4673-b826-73048d2c0357'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:10:13 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:10:13 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T17:10:07Z,direct_url=<?>,disk_format='qcow2',id=54e18ca0-fa62-4673-b826-73048d2c0357,min_disk=0,min_ram=0,name='tempest-scenario-img--71206579',owner='2d01a3eaa26b4fc790abe7761fb2bb8a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T17:10:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:10:13 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1660038977',display_name='tempest-TestMinimumBasicScenario-server-1660038977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1660038977',id=24,image_ref='54e18ca0-fa62-4673-b826-73048d2c0357',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPffPZx5HtyUTtuyElK8T2h3LJDo9CkoGf9Uk87IsKnp59gU96LEw/ql/olfbqBcInGNp0uWKaupc6QdJUDgr00AaZzJG7ufaKdWtkye1jcvGvyXXqU3gI4tXP94aeII7g==',key_name='tempest-TestMinimumBasicScenario-525419178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d01a3eaa26b4fc790abe7761fb2bb8a',ramdisk_id='',reservation_id='r-mbkjshax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='54e18ca0-fa62-4673-b826-73048d2c0357',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-433831737',owner_user_name='tempest-TestMinimumBasicScenario-433831737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:10:11Z,user_data=None,user_id='194df496b87a48d68835cb7aa0802560',uuid=36e65da9-4cc0-4d73-9e5d-e64520e08f34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cadf851f-d826-43fb-984d-4f15cafa5f64", "address": "fa:16:3e:74:a8:07", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadf851f-d8", "ovs_interfaceid": "cadf851f-d826-43fb-984d-4f15cafa5f64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Converting VIF {"id": "cadf851f-d826-43fb-984d-4f15cafa5f64", "address": "fa:16:3e:74:a8:07", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadf851f-d8", "ovs_interfaceid": "cadf851f-d826-43fb-984d-4f15cafa5f64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=cadf851f-d826-43fb-984d-4f15cafa5f64,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadf851f-d8') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG nova.objects.instance [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lazy-loading 'pci_devices' on Instance uuid 36e65da9-4cc0-4d73-9e5d-e64520e08f34 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:10:14 user nova-compute[75246]:   <uuid>36e65da9-4cc0-4d73-9e5d-e64520e08f34</uuid>
Nov 28 17:10:14 user nova-compute[75246]:   <name>instance-00000018</name>
Nov 28 17:10:14 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:10:14 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:10:14 user nova-compute[75246]:   <metadata>
Nov 28 17:10:14 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:10:14 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:10:14 user nova-compute[75246]:       <nova:name>tempest-TestMinimumBasicScenario-server-1660038977</nova:name>
Nov 28 17:10:14 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:10:13</nova:creationTime>
Nov 28 17:10:14 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:10:14 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:10:14 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:10:14 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:10:14 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:10:14 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:10:14 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:10:14 user nova-compute[75246]:       <nova:owner>
Nov 28 17:10:14 user nova-compute[75246]:         <nova:user uuid="194df496b87a48d68835cb7aa0802560">tempest-TestMinimumBasicScenario-433831737-project-member</nova:user>
Nov 28 17:10:14 user nova-compute[75246]:         <nova:project uuid="2d01a3eaa26b4fc790abe7761fb2bb8a">tempest-TestMinimumBasicScenario-433831737</nova:project>
Nov 28 17:10:14 user nova-compute[75246]:       </nova:owner>
Nov 28 17:10:14 user nova-compute[75246]:       <nova:root type="image" uuid="54e18ca0-fa62-4673-b826-73048d2c0357"/>
Nov 28 17:10:14 user nova-compute[75246]:       <nova:ports>
Nov 28 17:10:14 user nova-compute[75246]:         <nova:port uuid="cadf851f-d826-43fb-984d-4f15cafa5f64">
Nov 28 17:10:14 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 17:10:14 user nova-compute[75246]:         </nova:port>
Nov 28 17:10:14 user nova-compute[75246]:       </nova:ports>
Nov 28 17:10:14 user nova-compute[75246]:     </nova:instance>
Nov 28 17:10:14 user nova-compute[75246]:   </metadata>
Nov 28 17:10:14 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:10:14 user nova-compute[75246]:     <system>
Nov 28 17:10:14 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:10:14 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:10:14 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:10:14 user nova-compute[75246]:       <entry name="serial">36e65da9-4cc0-4d73-9e5d-e64520e08f34</entry>
Nov 28 17:10:14 user nova-compute[75246]:       <entry name="uuid">36e65da9-4cc0-4d73-9e5d-e64520e08f34</entry>
Nov 28 17:10:14 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:10:14 user nova-compute[75246]:     </system>
Nov 28 17:10:14 user nova-compute[75246]:   </sysinfo>
Nov 28 17:10:14 user nova-compute[75246]:   <os>
Nov 28 17:10:14 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:10:14 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:10:14 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:10:14 user nova-compute[75246]:   </os>
Nov 28 17:10:14 user nova-compute[75246]:   <features>
Nov 28 17:10:14 user nova-compute[75246]:     <acpi/>
Nov 28 17:10:14 user nova-compute[75246]:     <apic/>
Nov 28 17:10:14 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:10:14 user nova-compute[75246]:   </features>
Nov 28 17:10:14 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:10:14 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:10:14 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:10:14 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:10:14 user nova-compute[75246]:   </clock>
Nov 28 17:10:14 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:10:14 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:10:14 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:10:14 user nova-compute[75246]:   </cpu>
Nov 28 17:10:14 user nova-compute[75246]:   <devices>
Nov 28 17:10:14 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:10:14 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:10:14 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk"/>
Nov 28 17:10:14 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:10:14 user nova-compute[75246]:     </disk>
Nov 28 17:10:14 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:10:14 user nova-compute[75246]:       <mac address="fa:16:3e:74:a8:07"/>
Nov 28 17:10:14 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:10:14 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:10:14 user nova-compute[75246]:       <target dev="tapcadf851f-d8"/>
Nov 28 17:10:14 user nova-compute[75246]:     </interface>
Nov 28 17:10:14 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:10:14 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/console.log" append="off"/>
Nov 28 17:10:14 user nova-compute[75246]:     </serial>
Nov 28 17:10:14 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:10:14 user nova-compute[75246]:     <video>
Nov 28 17:10:14 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:10:14 user nova-compute[75246]:     </video>
Nov 28 17:10:14 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:10:14 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:10:14 user nova-compute[75246]:     </rng>
Nov 28 17:10:14 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:10:14 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:10:14 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:10:14 user nova-compute[75246]:     </memballoon>
Nov 28 17:10:14 user nova-compute[75246]:   </devices>
Nov 28 17:10:14 user nova-compute[75246]: </domain>
Nov 28 17:10:14 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1660038977',display_name='tempest-TestMinimumBasicScenario-server-1660038977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1660038977',id=24,image_ref='54e18ca0-fa62-4673-b826-73048d2c0357',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPffPZx5HtyUTtuyElK8T2h3LJDo9CkoGf9Uk87IsKnp59gU96LEw/ql/olfbqBcInGNp0uWKaupc6QdJUDgr00AaZzJG7ufaKdWtkye1jcvGvyXXqU3gI4tXP94aeII7g==',key_name='tempest-TestMinimumBasicScenario-525419178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d01a3eaa26b4fc790abe7761fb2bb8a',ramdisk_id='',reservation_id='r-mbkjshax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='54e18ca0-fa62-4673-b826-73048d2c0357',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-433831737',owner_user_name='tempest-TestMinimumBasicScenario-433831737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:10:11Z,user_data=None,user_id='194df496b87a48d68835cb7aa0802560',uuid=36e65da9-4cc0-4d73-9e5d-e64520e08f34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cadf851f-d826-43fb-984d-4f15cafa5f64", "address": "fa:16:3e:74:a8:07", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadf851f-d8", "ovs_interfaceid": "cadf851f-d826-43fb-984d-4f15cafa5f64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Converting VIF {"id": "cadf851f-d826-43fb-984d-4f15cafa5f64", "address": "fa:16:3e:74:a8:07", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadf851f-d8", "ovs_interfaceid": "cadf851f-d826-43fb-984d-4f15cafa5f64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=cadf851f-d826-43fb-984d-4f15cafa5f64,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadf851f-d8') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG os_vif [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=cadf851f-d826-43fb-984d-4f15cafa5f64,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadf851f-d8') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cdb9bbdb-1e9d-5d95-8c70-fd70526e1cfe', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcadf851f-d8, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcadf851f-d8, col_values=(('qos', UUID('6520bc89-f4ef-4056-af85-db6cef795e7e')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcadf851f-d8, col_values=(('external_ids', {'iface-id': 'cadf851f-d826-43fb-984d-4f15cafa5f64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:a8:07', 'vm-uuid': '36e65da9-4cc0-4d73-9e5d-e64520e08f34'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:14 user nova-compute[75246]: INFO os_vif [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=cadf851f-d826-43fb-984d-4f15cafa5f64,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadf851f-d8')
Nov 28 17:10:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] No VIF found with MAC fa:16:3e:74:a8:07, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG nova.network.neutron [req-dddc0fa9-202f-40bb-9dfa-6f6077297eb0 req-186443a7-7d92-49f6-bb50-fb592ef0d481 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Updated VIF entry in instance network info cache for port cadf851f-d826-43fb-984d-4f15cafa5f64. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG nova.network.neutron [req-dddc0fa9-202f-40bb-9dfa-6f6077297eb0 req-186443a7-7d92-49f6-bb50-fb592ef0d481 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Updating instance_info_cache with network_info: [{"id": "cadf851f-d826-43fb-984d-4f15cafa5f64", "address": "fa:16:3e:74:a8:07", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadf851f-d8", "ovs_interfaceid": "cadf851f-d826-43fb-984d-4f15cafa5f64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:10:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-dddc0fa9-202f-40bb-9dfa-6f6077297eb0 req-186443a7-7d92-49f6-bb50-fb592ef0d481 service nova] Releasing lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:10:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-66f92e83-d8c3-4b22-a9b3-67388b3b956d req-a6c967c8-a8ce-4f74-92b0-ab7e1c5fe35b service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received event network-vif-plugged-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:10:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-66f92e83-d8c3-4b22-a9b3-67388b3b956d req-a6c967c8-a8ce-4f74-92b0-ab7e1c5fe35b service nova] Acquiring lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-66f92e83-d8c3-4b22-a9b3-67388b3b956d req-a6c967c8-a8ce-4f74-92b0-ab7e1c5fe35b service nova] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-66f92e83-d8c3-4b22-a9b3-67388b3b956d req-a6c967c8-a8ce-4f74-92b0-ab7e1c5fe35b service nova] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-66f92e83-d8c3-4b22-a9b3-67388b3b956d req-a6c967c8-a8ce-4f74-92b0-ab7e1c5fe35b service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] No waiting events found dispatching network-vif-plugged-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:10:15 user nova-compute[75246]: WARNING nova.compute.manager [req-66f92e83-d8c3-4b22-a9b3-67388b3b956d req-a6c967c8-a8ce-4f74-92b0-ab7e1c5fe35b service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received unexpected event network-vif-plugged-cadf851f-d826-43fb-984d-4f15cafa5f64 for instance with vm_state building and task_state spawning.
Nov 28 17:10:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:10:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:10:17 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Instance spawned successfully.
Nov 28 17:10:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:10:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:10:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:10:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:10:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:10:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:10:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:10:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-93f31dbb-f57f-4f79-9f3f-f375d15a77f4 req-3548d157-0c54-4f00-9040-55e0f9524bfe service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received event network-vif-plugged-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:10:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-93f31dbb-f57f-4f79-9f3f-f375d15a77f4 req-3548d157-0c54-4f00-9040-55e0f9524bfe service nova] Acquiring lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-93f31dbb-f57f-4f79-9f3f-f375d15a77f4 req-3548d157-0c54-4f00-9040-55e0f9524bfe service nova] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-93f31dbb-f57f-4f79-9f3f-f375d15a77f4 req-3548d157-0c54-4f00-9040-55e0f9524bfe service nova] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-93f31dbb-f57f-4f79-9f3f-f375d15a77f4 req-3548d157-0c54-4f00-9040-55e0f9524bfe service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] No waiting events found dispatching network-vif-plugged-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:10:17 user nova-compute[75246]: WARNING nova.compute.manager [req-93f31dbb-f57f-4f79-9f3f-f375d15a77f4 req-3548d157-0c54-4f00-9040-55e0f9524bfe service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received unexpected event network-vif-plugged-cadf851f-d826-43fb-984d-4f15cafa5f64 for instance with vm_state building and task_state spawning.
Nov 28 17:10:17 user nova-compute[75246]: INFO nova.compute.manager [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Took 6.66 seconds to spawn the instance on the hypervisor.
Nov 28 17:10:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:10:17 user nova-compute[75246]: INFO nova.compute.manager [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Took 7.42 seconds to build instance.
Nov 28 17:10:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e64db387-bcf5-4a4b-9ac3-ac85a93110e9 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.535s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:20 user nova-compute[75246]: INFO nova.compute.manager [None req-096ca9e2-4f7c-48bc-8f14-9afd3fa032e3 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Unrescuing
Nov 28 17:10:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-096ca9e2-4f7c-48bc-8f14-9afd3fa032e3 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:10:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-096ca9e2-4f7c-48bc-8f14-9afd3fa032e3 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquired lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:10:20 user nova-compute[75246]: DEBUG nova.network.neutron [None req-096ca9e2-4f7c-48bc-8f14-9afd3fa032e3 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:10:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:20 user nova-compute[75246]: DEBUG nova.network.neutron [None req-096ca9e2-4f7c-48bc-8f14-9afd3fa032e3 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Updating instance_info_cache with network_info: [{"id": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "address": "fa:16:3e:e3:8a:cb", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dca6bfe-f1", "ovs_interfaceid": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:10:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-096ca9e2-4f7c-48bc-8f14-9afd3fa032e3 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Releasing lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:10:20 user nova-compute[75246]: DEBUG nova.objects.instance [None req-096ca9e2-4f7c-48bc-8f14-9afd3fa032e3 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'flavor' on Instance uuid c94900af-f484-47bf-8627-8aa863334b63 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:10:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:21 user nova-compute[75246]: DEBUG nova.compute.manager [req-28496aa9-1623-471f-9dd3-eaa4aadc11f1 req-3a6dd76c-5c0c-4652-8292-c037bb3d1621 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received event network-vif-unplugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:10:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-28496aa9-1623-471f-9dd3-eaa4aadc11f1 req-3a6dd76c-5c0c-4652-8292-c037bb3d1621 service nova] Acquiring lock "c94900af-f484-47bf-8627-8aa863334b63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-28496aa9-1623-471f-9dd3-eaa4aadc11f1 req-3a6dd76c-5c0c-4652-8292-c037bb3d1621 service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-28496aa9-1623-471f-9dd3-eaa4aadc11f1 req-3a6dd76c-5c0c-4652-8292-c037bb3d1621 service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:21 user nova-compute[75246]: DEBUG nova.compute.manager [req-28496aa9-1623-471f-9dd3-eaa4aadc11f1 req-3a6dd76c-5c0c-4652-8292-c037bb3d1621 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] No waiting events found dispatching network-vif-unplugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:10:21 user nova-compute[75246]: WARNING nova.compute.manager [req-28496aa9-1623-471f-9dd3-eaa4aadc11f1 req-3a6dd76c-5c0c-4652-8292-c037bb3d1621 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received unexpected event network-vif-unplugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 for instance with vm_state rescued and task_state unrescuing.
Nov 28 17:10:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:21 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: c94900af-f484-47bf-8627-8aa863334b63] Instance destroyed successfully.
Nov 28 17:10:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:10:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:10:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 17:10:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:23 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] There are 0 instances to clean {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 17:10:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-8e5eb4f7-7b29-4fa2-be0e-fa6b82668a22 req-6bf2293e-c3f9-4b2e-95a2-e7f8f8841db2 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received event network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:10:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8e5eb4f7-7b29-4fa2-be0e-fa6b82668a22 req-6bf2293e-c3f9-4b2e-95a2-e7f8f8841db2 service nova] Acquiring lock "c94900af-f484-47bf-8627-8aa863334b63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8e5eb4f7-7b29-4fa2-be0e-fa6b82668a22 req-6bf2293e-c3f9-4b2e-95a2-e7f8f8841db2 service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8e5eb4f7-7b29-4fa2-be0e-fa6b82668a22 req-6bf2293e-c3f9-4b2e-95a2-e7f8f8841db2 service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-8e5eb4f7-7b29-4fa2-be0e-fa6b82668a22 req-6bf2293e-c3f9-4b2e-95a2-e7f8f8841db2 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] No waiting events found dispatching network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:10:23 user nova-compute[75246]: WARNING nova.compute.manager [req-8e5eb4f7-7b29-4fa2-be0e-fa6b82668a22 req-6bf2293e-c3f9-4b2e-95a2-e7f8f8841db2 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received unexpected event network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 for instance with vm_state rescued and task_state unrescuing.
Nov 28 17:10:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-8e5eb4f7-7b29-4fa2-be0e-fa6b82668a22 req-6bf2293e-c3f9-4b2e-95a2-e7f8f8841db2 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received event network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:10:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8e5eb4f7-7b29-4fa2-be0e-fa6b82668a22 req-6bf2293e-c3f9-4b2e-95a2-e7f8f8841db2 service nova] Acquiring lock "c94900af-f484-47bf-8627-8aa863334b63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8e5eb4f7-7b29-4fa2-be0e-fa6b82668a22 req-6bf2293e-c3f9-4b2e-95a2-e7f8f8841db2 service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8e5eb4f7-7b29-4fa2-be0e-fa6b82668a22 req-6bf2293e-c3f9-4b2e-95a2-e7f8f8841db2 service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-8e5eb4f7-7b29-4fa2-be0e-fa6b82668a22 req-6bf2293e-c3f9-4b2e-95a2-e7f8f8841db2 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] No waiting events found dispatching network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:10:23 user nova-compute[75246]: WARNING nova.compute.manager [req-8e5eb4f7-7b29-4fa2-be0e-fa6b82668a22 req-6bf2293e-c3f9-4b2e-95a2-e7f8f8841db2 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received unexpected event network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 for instance with vm_state rescued and task_state unrescuing.
Nov 28 17:10:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:25 user nova-compute[75246]: DEBUG nova.compute.manager [None req-096ca9e2-4f7c-48bc-8f14-9afd3fa032e3 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:10:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-a3e610be-b483-4595-88ed-1eadbee8fa8b req-dc1087d5-806e-4abc-9ced-affc642560e9 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received event network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:10:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a3e610be-b483-4595-88ed-1eadbee8fa8b req-dc1087d5-806e-4abc-9ced-affc642560e9 service nova] Acquiring lock "c94900af-f484-47bf-8627-8aa863334b63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a3e610be-b483-4595-88ed-1eadbee8fa8b req-dc1087d5-806e-4abc-9ced-affc642560e9 service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a3e610be-b483-4595-88ed-1eadbee8fa8b req-dc1087d5-806e-4abc-9ced-affc642560e9 service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-a3e610be-b483-4595-88ed-1eadbee8fa8b req-dc1087d5-806e-4abc-9ced-affc642560e9 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] No waiting events found dispatching network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:10:25 user nova-compute[75246]: WARNING nova.compute.manager [req-a3e610be-b483-4595-88ed-1eadbee8fa8b req-dc1087d5-806e-4abc-9ced-affc642560e9 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received unexpected event network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 for instance with vm_state rescued and task_state unrescuing.
Nov 28 17:10:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:28 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:10:28 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:10:28 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:10:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:29 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:10:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:10:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.260s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:33 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:10:33 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8059MB free_disk=25.45882797241211GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "0d952de1-8c78-4bea-853d-21ac4f979845" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "0d952de1-8c78-4bea-853d-21ac4f979845" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:33 user nova-compute[75246]: INFO nova.compute.manager [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Detaching volume e3d24323-24c5-486c-a65b-2560bb874c02
Nov 28 17:10:33 user nova-compute[75246]: INFO nova.virt.block_device [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Attempting to driver detach volume e3d24323-24c5-486c-a65b-2560bb874c02 from mountpoint /dev/vdc
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Attempting to detach device vdc from instance 0d952de1-8c78-4bea-853d-21ac4f979845 from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:10:33 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:10:33 user nova-compute[75246]:   <source dev="/dev/sdb"/>
Nov 28 17:10:33 user nova-compute[75246]:   <target dev="vdc" bus="virtio"/>
Nov 28 17:10:33 user nova-compute[75246]:   <serial>e3d24323-24c5-486c-a65b-2560bb874c02</serial>
Nov 28 17:10:33 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 17:10:33 user nova-compute[75246]: </disk>
Nov 28 17:10:33 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:10:33 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Successfully detached device vdc from instance 0d952de1-8c78-4bea-853d-21ac4f979845 from the persistent domain config.
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0d952de1-8c78-4bea-853d-21ac4f979845 from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:10:33 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:10:33 user nova-compute[75246]:   <source dev="/dev/sdb"/>
Nov 28 17:10:33 user nova-compute[75246]:   <target dev="vdc" bus="virtio"/>
Nov 28 17:10:33 user nova-compute[75246]:   <serial>e3d24323-24c5-486c-a65b-2560bb874c02</serial>
Nov 28 17:10:33 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 17:10:33 user nova-compute[75246]: </disk>
Nov 28 17:10:33 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e1266470-c182-4c0c-a575-4c5043f54745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c94900af-f484-47bf-8627-8aa863334b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 201f0afe-8508-4357-8786-f62b70866aae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 0d952de1-8c78-4bea-853d-21ac4f979845 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance aa9ef0b8-3519-416a-b42c-cd953c4ddc0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 36e65da9-4cc0-4d73-9e5d-e64520e08f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing inventories for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating ProviderTree inventory for provider 241ad926-9deb-44ba-a618-a49e4ac21089 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating inventory in ProviderTree for provider 241ad926-9deb-44ba-a618-a49e4ac21089 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing aggregate associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, aggregates: None {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 17:10:33 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing trait associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0d952de1-8c78-4bea-853d-21ac4f979845 {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "8ae64996-670b-4179-9280-27fa7141a8d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.900s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75246) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:10:34 user nova-compute[75246]: INFO nova.compute.claims [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Claim successful on node user
Nov 28 17:10:34 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:10:34 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:10:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:10:34 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:10:35 user nova-compute[75246]: INFO nova.virt.block_device [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Booting with volume dc02ace1-85f5-476c-8300-f15e2555272b at /dev/vda
Nov 28 17:10:35 user nova-compute[75246]: DEBUG nova.policy [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9da5fcd6e6e24f0aaddfbeb5ad34cb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3144ba262d42ac98ac03dc7052e8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG os_brick.utils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cf27bb-e8ac-4067-8472-d68e135198ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f20a307-c670-4610-8502-1ad4815f05b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4ddca4-eea3-45cf-b5b5-417aea3e34c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2944c5d1-294d-4e47-b270-cf90aec236c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:10:35 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:10:35 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d9658f-f4b6-4971-8ee2-cee29c13f418]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG os_brick.utils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Updating existing volume attachment record: 6ea33b53-685e-46d2-a681-6bb13dd25fe7 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:10:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:36 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Updating instance_info_cache with network_info: [{"id": "0a3da48f-457a-450f-8102-d758c18d2554", "address": "fa:16:3e:a5:be:9f", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a3da48f-45", "ovs_interfaceid": "0a3da48f-457a-450f-8102-d758c18d2554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:10:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:10:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:10:36 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:10:36 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:10:36 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:10:36 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:10:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:10:36 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Successfully created port: 204beaa6-93fe-477c-a9c6-9682ad9f95ef {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:10:36 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Successfully created port: b198a574-6fe0-47d1-90c2-98ffe1c7c1bc {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:10:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Acquiring lock "201f0afe-8508-4357-8786-f62b70866aae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "201f0afe-8508-4357-8786-f62b70866aae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Acquiring lock "201f0afe-8508-4357-8786-f62b70866aae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "201f0afe-8508-4357-8786-f62b70866aae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "201f0afe-8508-4357-8786-f62b70866aae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:36 user nova-compute[75246]: INFO nova.compute.manager [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Terminating instance
Nov 28 17:10:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:10:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG nova.compute.manager [req-73957b21-0407-42cd-91a3-0585a466c1a0 req-62e8c94c-50e2-4082-aca2-986f49b5a2f3 service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Received event network-vif-unplugged-c3201b44-4689-4e0e-8fcd-1e9bd2de0279 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-73957b21-0407-42cd-91a3-0585a466c1a0 req-62e8c94c-50e2-4082-aca2-986f49b5a2f3 service nova] Acquiring lock "201f0afe-8508-4357-8786-f62b70866aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-73957b21-0407-42cd-91a3-0585a466c1a0 req-62e8c94c-50e2-4082-aca2-986f49b5a2f3 service nova] Lock "201f0afe-8508-4357-8786-f62b70866aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-73957b21-0407-42cd-91a3-0585a466c1a0 req-62e8c94c-50e2-4082-aca2-986f49b5a2f3 service nova] Lock "201f0afe-8508-4357-8786-f62b70866aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG nova.compute.manager [req-73957b21-0407-42cd-91a3-0585a466c1a0 req-62e8c94c-50e2-4082-aca2-986f49b5a2f3 service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] No waiting events found dispatching network-vif-unplugged-c3201b44-4689-4e0e-8fcd-1e9bd2de0279 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG nova.compute.manager [req-73957b21-0407-42cd-91a3-0585a466c1a0 req-62e8c94c-50e2-4082-aca2-986f49b5a2f3 service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Received event network-vif-unplugged-c3201b44-4689-4e0e-8fcd-1e9bd2de0279 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:10:37 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Instance destroyed successfully.
Nov 28 17:10:37 user nova-compute[75246]: DEBUG nova.objects.instance [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lazy-loading 'resources' on Instance uuid 201f0afe-8508-4357-8786-f62b70866aae {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-302873916',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-302873916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3028739',id=22,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1LstQ0G7Ovfino2jtuzxl7WBjtK15U0MqnBvG2f6G/WU5SB8DOKPSyS95PYWqsQ+I9AZjy6N/qH8DBnRBZ/gnv3JBhlukuWn8QRxfRsrwwHj2AFj7O6yFUBpNH0Q52DQ==',key_name='tempest-keypair-2145950247',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2faaf456953448b8b999ce71bfae9478',ramdisk_id='',reservation_id='r-5w09351z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-880583918',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:07:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52fa83aab7634d1296bdc99455ab2a82',uuid=201f0afe-8508-4357-8786-f62b70866aae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "address": "fa:16:3e:21:36:22", "network": {"id": "2780db75-33d3-4c1b-9f6b-ebf1527a1675", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-198988837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2faaf456953448b8b999ce71bfae9478", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3201b44-46", "ovs_interfaceid": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Converting VIF {"id": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "address": "fa:16:3e:21:36:22", "network": {"id": "2780db75-33d3-4c1b-9f6b-ebf1527a1675", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-198988837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2faaf456953448b8b999ce71bfae9478", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3201b44-46", "ovs_interfaceid": "c3201b44-4689-4e0e-8fcd-1e9bd2de0279", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:36:22,bridge_name='br-int',has_traffic_filtering=True,id=c3201b44-4689-4e0e-8fcd-1e9bd2de0279,network=Network(2780db75-33d3-4c1b-9f6b-ebf1527a1675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3201b44-46') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG os_vif [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:36:22,bridge_name='br-int',has_traffic_filtering=True,id=c3201b44-4689-4e0e-8fcd-1e9bd2de0279,network=Network(2780db75-33d3-4c1b-9f6b-ebf1527a1675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3201b44-46') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3201b44-46, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b7dcab9-5848-4159-a1c8-7ae32c05f49c) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:37 user nova-compute[75246]: INFO os_vif [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:36:22,bridge_name='br-int',has_traffic_filtering=True,id=c3201b44-4689-4e0e-8fcd-1e9bd2de0279,network=Network(2780db75-33d3-4c1b-9f6b-ebf1527a1675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3201b44-46')
Nov 28 17:10:37 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Deleting instance files /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae_del
Nov 28 17:10:37 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Deletion of /opt/stack/data/nova/instances/201f0afe-8508-4357-8786-f62b70866aae_del complete
Nov 28 17:10:37 user nova-compute[75246]: INFO nova.compute.manager [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 17:10:37 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:10:37 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 201f0afe-8508-4357-8786-f62b70866aae] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:10:38 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Successfully created port: 7895e4b8-0496-479c-8ccd-1de0613b1c19 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:10:38 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:10:39 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:10:39 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Took 1.34 seconds to deallocate network for instance.
Nov 28 17:10:39 user nova-compute[75246]: DEBUG nova.compute.manager [req-4668d987-92bd-48c8-9a81-ec8ee7df7aec req-8c65b7d7-fbe1-466f-80af-b80f8d8de56a service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Received event network-vif-deleted-c3201b44-4689-4e0e-8fcd-1e9bd2de0279 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:10:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:39 user nova-compute[75246]: DEBUG nova.compute.manager [req-bb1d724c-dbd1-4bfb-81f7-9378e80dee5c req-20887ca5-1d0c-45cd-a40d-31718ed001f1 service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Received event network-vif-plugged-c3201b44-4689-4e0e-8fcd-1e9bd2de0279 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:10:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-bb1d724c-dbd1-4bfb-81f7-9378e80dee5c req-20887ca5-1d0c-45cd-a40d-31718ed001f1 service nova] Acquiring lock "201f0afe-8508-4357-8786-f62b70866aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:10:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-bb1d724c-dbd1-4bfb-81f7-9378e80dee5c req-20887ca5-1d0c-45cd-a40d-31718ed001f1 service nova] Lock "201f0afe-8508-4357-8786-f62b70866aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:10:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-bb1d724c-dbd1-4bfb-81f7-9378e80dee5c req-20887ca5-1d0c-45cd-a40d-31718ed001f1 service nova] Lock "201f0afe-8508-4357-8786-f62b70866aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:39 user nova-compute[75246]: DEBUG nova.compute.manager [req-bb1d724c-dbd1-4bfb-81f7-9378e80dee5c req-20887ca5-1d0c-45cd-a40d-31718ed001f1 service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] No waiting events found dispatching network-vif-plugged-c3201b44-4689-4e0e-8fcd-1e9bd2de0279 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:10:39 user nova-compute[75246]: WARNING nova.compute.manager [req-bb1d724c-dbd1-4bfb-81f7-9378e80dee5c req-20887ca5-1d0c-45cd-a40d-31718ed001f1 service nova] [instance: 201f0afe-8508-4357-8786-f62b70866aae] Received unexpected event network-vif-plugged-c3201b44-4689-4e0e-8fcd-1e9bd2de0279 for instance with vm_state deleted and task_state None.
Nov 28 17:10:39 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Successfully created port: f31d8039-9a73-4288-813c-fb13de3d2a12 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:10:39 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:10:39 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:10:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:39 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Deleted allocations for instance 201f0afe-8508-4357-8786-f62b70866aae
Nov 28 17:10:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7ad4ebfa-a953-4f5b-b796-3d7bc9a5de8d tempest-TestServerVolumeAttachScenarioOldVersion-880583918 tempest-TestServerVolumeAttachScenarioOldVersion-880583918-project-member] Lock "201f0afe-8508-4357-8786-f62b70866aae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.901s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:40 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Successfully created port: 1fcb1e63-1b0b-4c45-9fda-200b1fd719c5 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:10:40 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Successfully updated port: 204beaa6-93fe-477c-a9c6-9682ad9f95ef {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:10:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:41 user nova-compute[75246]: DEBUG nova.compute.manager [req-42da40d1-4258-4d10-88f6-eae14e083a58 req-ac6d6023-7f77-404c-91d0-722d51875f7b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-changed-204beaa6-93fe-477c-a9c6-9682ad9f95ef {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:10:41 user nova-compute[75246]: DEBUG nova.compute.manager [req-42da40d1-4258-4d10-88f6-eae14e083a58 req-ac6d6023-7f77-404c-91d0-722d51875f7b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Refreshing instance network info cache due to event network-changed-204beaa6-93fe-477c-a9c6-9682ad9f95ef. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:10:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-42da40d1-4258-4d10-88f6-eae14e083a58 req-ac6d6023-7f77-404c-91d0-722d51875f7b service nova] Acquiring lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:10:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-42da40d1-4258-4d10-88f6-eae14e083a58 req-ac6d6023-7f77-404c-91d0-722d51875f7b service nova] Acquired lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:10:41 user nova-compute[75246]: DEBUG nova.network.neutron [req-42da40d1-4258-4d10-88f6-eae14e083a58 req-ac6d6023-7f77-404c-91d0-722d51875f7b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Refreshing network info cache for port 204beaa6-93fe-477c-a9c6-9682ad9f95ef {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:10:41 user nova-compute[75246]: DEBUG nova.network.neutron [req-42da40d1-4258-4d10-88f6-eae14e083a58 req-ac6d6023-7f77-404c-91d0-722d51875f7b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:10:41 user nova-compute[75246]: DEBUG nova.network.neutron [req-42da40d1-4258-4d10-88f6-eae14e083a58 req-ac6d6023-7f77-404c-91d0-722d51875f7b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:10:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-42da40d1-4258-4d10-88f6-eae14e083a58 req-ac6d6023-7f77-404c-91d0-722d51875f7b service nova] Releasing lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:10:41 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Successfully updated port: bd7e4bce-235e-41c2-88c5-b042af4b50bf {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:10:42 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Successfully updated port: 3decefbc-a21c-466b-bf11-1ea7fe421a89 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:10:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:43 user nova-compute[75246]: DEBUG nova.compute.manager [req-e43f2073-0f59-47b5-9622-b30b2e335924 req-7d666ada-9b7e-44c3-8449-6d0cd8e5dbaf service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-changed-bd7e4bce-235e-41c2-88c5-b042af4b50bf {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:10:43 user nova-compute[75246]: DEBUG nova.compute.manager [req-e43f2073-0f59-47b5-9622-b30b2e335924 req-7d666ada-9b7e-44c3-8449-6d0cd8e5dbaf service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Refreshing instance network info cache due to event network-changed-bd7e4bce-235e-41c2-88c5-b042af4b50bf. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:10:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e43f2073-0f59-47b5-9622-b30b2e335924 req-7d666ada-9b7e-44c3-8449-6d0cd8e5dbaf service nova] Acquiring lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:10:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e43f2073-0f59-47b5-9622-b30b2e335924 req-7d666ada-9b7e-44c3-8449-6d0cd8e5dbaf service nova] Acquired lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:10:43 user nova-compute[75246]: DEBUG nova.network.neutron [req-e43f2073-0f59-47b5-9622-b30b2e335924 req-7d666ada-9b7e-44c3-8449-6d0cd8e5dbaf service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Refreshing network info cache for port bd7e4bce-235e-41c2-88c5-b042af4b50bf {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:10:43 user nova-compute[75246]: DEBUG nova.network.neutron [req-e43f2073-0f59-47b5-9622-b30b2e335924 req-7d666ada-9b7e-44c3-8449-6d0cd8e5dbaf service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:10:43 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Successfully updated port: b198a574-6fe0-47d1-90c2-98ffe1c7c1bc {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:10:43 user nova-compute[75246]: DEBUG nova.network.neutron [req-e43f2073-0f59-47b5-9622-b30b2e335924 req-7d666ada-9b7e-44c3-8449-6d0cd8e5dbaf service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:10:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e43f2073-0f59-47b5-9622-b30b2e335924 req-7d666ada-9b7e-44c3-8449-6d0cd8e5dbaf service nova] Releasing lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:10:43 user nova-compute[75246]: DEBUG nova.compute.manager [req-e43f2073-0f59-47b5-9622-b30b2e335924 req-7d666ada-9b7e-44c3-8449-6d0cd8e5dbaf service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-changed-3decefbc-a21c-466b-bf11-1ea7fe421a89 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:10:43 user nova-compute[75246]: DEBUG nova.compute.manager [req-e43f2073-0f59-47b5-9622-b30b2e335924 req-7d666ada-9b7e-44c3-8449-6d0cd8e5dbaf service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Refreshing instance network info cache due to event network-changed-3decefbc-a21c-466b-bf11-1ea7fe421a89. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:10:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e43f2073-0f59-47b5-9622-b30b2e335924 req-7d666ada-9b7e-44c3-8449-6d0cd8e5dbaf service nova] Acquiring lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:10:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e43f2073-0f59-47b5-9622-b30b2e335924 req-7d666ada-9b7e-44c3-8449-6d0cd8e5dbaf service nova] Acquired lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:10:43 user nova-compute[75246]: DEBUG nova.network.neutron [req-e43f2073-0f59-47b5-9622-b30b2e335924 req-7d666ada-9b7e-44c3-8449-6d0cd8e5dbaf service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Refreshing network info cache for port 3decefbc-a21c-466b-bf11-1ea7fe421a89 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:10:43 user nova-compute[75246]: DEBUG nova.network.neutron [req-e43f2073-0f59-47b5-9622-b30b2e335924 req-7d666ada-9b7e-44c3-8449-6d0cd8e5dbaf service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:10:44 user nova-compute[75246]: DEBUG nova.network.neutron [req-e43f2073-0f59-47b5-9622-b30b2e335924 req-7d666ada-9b7e-44c3-8449-6d0cd8e5dbaf service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:10:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e43f2073-0f59-47b5-9622-b30b2e335924 req-7d666ada-9b7e-44c3-8449-6d0cd8e5dbaf service nova] Releasing lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:10:44 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Successfully updated port: 7895e4b8-0496-479c-8ccd-1de0613b1c19 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:10:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-d2e13c93-9f38-493d-8e56-0ad30c30c231 req-b0b83f39-1973-4af8-8bd6-6b1a9241e6cc service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-changed-b198a574-6fe0-47d1-90c2-98ffe1c7c1bc {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:10:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-d2e13c93-9f38-493d-8e56-0ad30c30c231 req-b0b83f39-1973-4af8-8bd6-6b1a9241e6cc service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Refreshing instance network info cache due to event network-changed-b198a574-6fe0-47d1-90c2-98ffe1c7c1bc. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:10:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d2e13c93-9f38-493d-8e56-0ad30c30c231 req-b0b83f39-1973-4af8-8bd6-6b1a9241e6cc service nova] Acquiring lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:10:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d2e13c93-9f38-493d-8e56-0ad30c30c231 req-b0b83f39-1973-4af8-8bd6-6b1a9241e6cc service nova] Acquired lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:10:45 user nova-compute[75246]: DEBUG nova.network.neutron [req-d2e13c93-9f38-493d-8e56-0ad30c30c231 req-b0b83f39-1973-4af8-8bd6-6b1a9241e6cc service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Refreshing network info cache for port b198a574-6fe0-47d1-90c2-98ffe1c7c1bc {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:10:45 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Successfully updated port: f31d8039-9a73-4288-813c-fb13de3d2a12 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:10:45 user nova-compute[75246]: DEBUG nova.network.neutron [req-d2e13c93-9f38-493d-8e56-0ad30c30c231 req-b0b83f39-1973-4af8-8bd6-6b1a9241e6cc service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:10:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-d2e13c93-9f38-493d-8e56-0ad30c30c231 req-b0b83f39-1973-4af8-8bd6-6b1a9241e6cc service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:10:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d2e13c93-9f38-493d-8e56-0ad30c30c231 req-b0b83f39-1973-4af8-8bd6-6b1a9241e6cc service nova] Releasing lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:10:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-d2e13c93-9f38-493d-8e56-0ad30c30c231 req-b0b83f39-1973-4af8-8bd6-6b1a9241e6cc service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-changed-7895e4b8-0496-479c-8ccd-1de0613b1c19 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:10:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-d2e13c93-9f38-493d-8e56-0ad30c30c231 req-b0b83f39-1973-4af8-8bd6-6b1a9241e6cc service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Refreshing instance network info cache due to event network-changed-7895e4b8-0496-479c-8ccd-1de0613b1c19. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:10:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d2e13c93-9f38-493d-8e56-0ad30c30c231 req-b0b83f39-1973-4af8-8bd6-6b1a9241e6cc service nova] Acquiring lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:10:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d2e13c93-9f38-493d-8e56-0ad30c30c231 req-b0b83f39-1973-4af8-8bd6-6b1a9241e6cc service nova] Acquired lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:10:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-d2e13c93-9f38-493d-8e56-0ad30c30c231 req-b0b83f39-1973-4af8-8bd6-6b1a9241e6cc service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Refreshing network info cache for port 7895e4b8-0496-479c-8ccd-1de0613b1c19 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:10:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-d2e13c93-9f38-493d-8e56-0ad30c30c231 req-b0b83f39-1973-4af8-8bd6-6b1a9241e6cc service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:10:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-d2e13c93-9f38-493d-8e56-0ad30c30c231 req-b0b83f39-1973-4af8-8bd6-6b1a9241e6cc service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:10:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d2e13c93-9f38-493d-8e56-0ad30c30c231 req-b0b83f39-1973-4af8-8bd6-6b1a9241e6cc service nova] Releasing lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:10:46 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Successfully updated port: 1fcb1e63-1b0b-4c45-9fda-200b1fd719c5 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:10:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Acquiring lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:10:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Acquired lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:10:46 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:10:46 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:10:47 user nova-compute[75246]: INFO nova.virt.block_device [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Booting with volume 7f6e8e13-9a7b-4372-9027-7fe6e58641e9 at /dev/vdb
Nov 28 17:10:47 user nova-compute[75246]: DEBUG os_brick.utils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[861cfffb-f939-49e2-b394-b59947d8e323]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2dd6fc2-c6bf-4625-8072-5c9e4f2c7964]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f099bc-291b-4f71-bb3a-16b0625d7a40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a73a1d-a60d-4b67-ba85-53f36a935441]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:10:47 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:10:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[687cff5f-838f-4922-a5cb-2d443671f989]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG os_brick.utils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Updating existing volume attachment record: 421945c4-c210-461b-855b-223046e99e9f {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG nova.compute.manager [req-fa0ffae3-fa2c-4119-836a-1585aae615e5 req-6648de86-6106-4e6a-ae10-b5c8713bbc59 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-changed-f31d8039-9a73-4288-813c-fb13de3d2a12 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG nova.compute.manager [req-fa0ffae3-fa2c-4119-836a-1585aae615e5 req-6648de86-6106-4e6a-ae10-b5c8713bbc59 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Refreshing instance network info cache due to event network-changed-f31d8039-9a73-4288-813c-fb13de3d2a12. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fa0ffae3-fa2c-4119-836a-1585aae615e5 req-6648de86-6106-4e6a-ae10-b5c8713bbc59 service nova] Acquiring lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:10:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:50 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Updating instance_info_cache with network_info: [{"id": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "address": "fa:16:3e:54:fe:1f", "network": {"id": "544b007d-d4e9-4bdf-b20a-0d680ffc4922", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1651046378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204beaa6-93", "ovs_interfaceid": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "address": "fa:16:3e:86:6c:fd", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7e4bce-23", "ovs_interfaceid": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "address": "fa:16:3e:84:ca:5e", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3decefbc-a2", "ovs_interfaceid": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "address": "fa:16:3e:7f:22:59", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb198a574-6f", "ovs_interfaceid": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "address": "fa:16:3e:c6:36:3f", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7895e4b8-04", "ovs_interfaceid": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f31d8039-9a73-4288-813c-fb13de3d2a12", "address": "fa:16:3e:7d:b9:0d", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31d8039-9a", "ovs_interfaceid": "f31d8039-9a73-4288-813c-fb13de3d2a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "address": "fa:16:3e:5c:ef:c4", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcb1e63-1b", "ovs_interfaceid": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:10:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Releasing lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:10:50 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Instance network_info: |[{"id": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "address": "fa:16:3e:54:fe:1f", "network": {"id": "544b007d-d4e9-4bdf-b20a-0d680ffc4922", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1651046378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204beaa6-93", "ovs_interfaceid": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "address": "fa:16:3e:86:6c:fd", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7e4bce-23", "ovs_interfaceid": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "address": "fa:16:3e:84:ca:5e", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3decefbc-a2", "ovs_interfaceid": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "address": "fa:16:3e:7f:22:59", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb198a574-6f", "ovs_interfaceid": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "address": "fa:16:3e:c6:36:3f", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7895e4b8-04", "ovs_interfaceid": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f31d8039-9a73-4288-813c-fb13de3d2a12", "address": "fa:16:3e:7d:b9:0d", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31d8039-9a", "ovs_interfaceid": "f31d8039-9a73-4288-813c-fb13de3d2a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "address": "fa:16:3e:5c:ef:c4", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcb1e63-1b", "ovs_interfaceid": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:10:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fa0ffae3-fa2c-4119-836a-1585aae615e5 req-6648de86-6106-4e6a-ae10-b5c8713bbc59 service nova] Acquired lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:10:50 user nova-compute[75246]: DEBUG nova.network.neutron [req-fa0ffae3-fa2c-4119-836a-1585aae615e5 req-6648de86-6106-4e6a-ae10-b5c8713bbc59 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Refreshing network info cache for port f31d8039-9a73-4288-813c-fb13de3d2a12 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:10:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:51 user nova-compute[75246]: DEBUG nova.network.neutron [req-fa0ffae3-fa2c-4119-836a-1585aae615e5 req-6648de86-6106-4e6a-ae10-b5c8713bbc59 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Updated VIF entry in instance network info cache for port f31d8039-9a73-4288-813c-fb13de3d2a12. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:10:51 user nova-compute[75246]: DEBUG nova.network.neutron [req-fa0ffae3-fa2c-4119-836a-1585aae615e5 req-6648de86-6106-4e6a-ae10-b5c8713bbc59 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Updating instance_info_cache with network_info: [{"id": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "address": "fa:16:3e:54:fe:1f", "network": {"id": "544b007d-d4e9-4bdf-b20a-0d680ffc4922", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1651046378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204beaa6-93", "ovs_interfaceid": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "address": "fa:16:3e:86:6c:fd", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7e4bce-23", "ovs_interfaceid": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "address": "fa:16:3e:84:ca:5e", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3decefbc-a2", "ovs_interfaceid": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "address": "fa:16:3e:7f:22:59", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb198a574-6f", "ovs_interfaceid": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "address": "fa:16:3e:c6:36:3f", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7895e4b8-04", "ovs_interfaceid": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f31d8039-9a73-4288-813c-fb13de3d2a12", "address": "fa:16:3e:7d:b9:0d", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31d8039-9a", "ovs_interfaceid": "f31d8039-9a73-4288-813c-fb13de3d2a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "address": "fa:16:3e:5c:ef:c4", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcb1e63-1b", "ovs_interfaceid": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:10:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fa0ffae3-fa2c-4119-836a-1585aae615e5 req-6648de86-6106-4e6a-ae10-b5c8713bbc59 service nova] Releasing lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:10:51 user nova-compute[75246]: DEBUG nova.compute.manager [req-fa0ffae3-fa2c-4119-836a-1585aae615e5 req-6648de86-6106-4e6a-ae10-b5c8713bbc59 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-changed-1fcb1e63-1b0b-4c45-9fda-200b1fd719c5 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:10:51 user nova-compute[75246]: DEBUG nova.compute.manager [req-fa0ffae3-fa2c-4119-836a-1585aae615e5 req-6648de86-6106-4e6a-ae10-b5c8713bbc59 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Refreshing instance network info cache due to event network-changed-1fcb1e63-1b0b-4c45-9fda-200b1fd719c5. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:10:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fa0ffae3-fa2c-4119-836a-1585aae615e5 req-6648de86-6106-4e6a-ae10-b5c8713bbc59 service nova] Acquiring lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:10:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fa0ffae3-fa2c-4119-836a-1585aae615e5 req-6648de86-6106-4e6a-ae10-b5c8713bbc59 service nova] Acquired lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:10:51 user nova-compute[75246]: DEBUG nova.network.neutron [req-fa0ffae3-fa2c-4119-836a-1585aae615e5 req-6648de86-6106-4e6a-ae10-b5c8713bbc59 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Refreshing network info cache for port 1fcb1e63-1b0b-4c45-9fda-200b1fd719c5 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:10:52 user nova-compute[75246]: DEBUG nova.network.neutron [req-fa0ffae3-fa2c-4119-836a-1585aae615e5 req-6648de86-6106-4e6a-ae10-b5c8713bbc59 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Updated VIF entry in instance network info cache for port 1fcb1e63-1b0b-4c45-9fda-200b1fd719c5. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:10:52 user nova-compute[75246]: DEBUG nova.network.neutron [req-fa0ffae3-fa2c-4119-836a-1585aae615e5 req-6648de86-6106-4e6a-ae10-b5c8713bbc59 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Updating instance_info_cache with network_info: [{"id": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "address": "fa:16:3e:54:fe:1f", "network": {"id": "544b007d-d4e9-4bdf-b20a-0d680ffc4922", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1651046378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204beaa6-93", "ovs_interfaceid": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "address": "fa:16:3e:86:6c:fd", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7e4bce-23", "ovs_interfaceid": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "address": "fa:16:3e:84:ca:5e", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3decefbc-a2", "ovs_interfaceid": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "address": "fa:16:3e:7f:22:59", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb198a574-6f", "ovs_interfaceid": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "address": "fa:16:3e:c6:36:3f", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7895e4b8-04", "ovs_interfaceid": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f31d8039-9a73-4288-813c-fb13de3d2a12", "address": "fa:16:3e:7d:b9:0d", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31d8039-9a", "ovs_interfaceid": "f31d8039-9a73-4288-813c-fb13de3d2a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "address": "fa:16:3e:5c:ef:c4", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcb1e63-1b", "ovs_interfaceid": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:10:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fa0ffae3-fa2c-4119-836a-1585aae615e5 req-6648de86-6106-4e6a-ae10-b5c8713bbc59 service nova] Releasing lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:10:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:54 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0d952de1-8c78-4bea-853d-21ac4f979845 is timed out.
Nov 28 17:10:54 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Successfully detached device vdc from instance 0d952de1-8c78-4bea-853d-21ac4f979845 from the live domain config.
Nov 28 17:10:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVsJRNkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:10:54 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f79ab4-d69a-475c-a725-51f85c818e6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:10:54 user nova-compute[75246]: No targets found.
Nov 28 17:10:54 user nova-compute[75246]: iSNS:
Nov 28 17:10:54 user nova-compute[75246]: No targets found.
Nov 28 17:10:54 user nova-compute[75246]: STATIC:
Nov 28 17:10:54 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02
Nov 28 17:10:54 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:10:54 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:10:54 user nova-compute[75246]: FIRMWARE:
Nov 28 17:10:54 user nova-compute[75246]: No targets found.
Nov 28 17:10:54 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:10:54 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:10:54 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a295804-e4a8-4a7b-888a-71054fe00c6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae058c9-7206-4b8c-bcb1-a511ae83fac0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)
Nov 28 17:10:54 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 (non-flash)
Nov 28 17:10:54 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d83f69e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02'): ({'sdb'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Removing single pathed devices sdb {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25a4674-ad38-4e4d-ae56-2477b2c9ecd2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bf54c3-191f-46a2-a7ae-6799b1e58a15]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Flushing IO for device /dev/sdb {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4848bc4-e2c6-4ef9-a2a2-10a6b73c25e1]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a9350e-ee0c-4e36-9fd4-f1dda2d8205f]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba097bd-5587-42a1-a35b-1382bc711987]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b90a79-1562-46ca-aee7-4eae90079bb5]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02, portal: 172.16.0.220,3260]
Nov 28 17:10:54 user nova-compute[75246]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02, portal: 172.16.0.220,3260] successful.
Nov 28 17:10:54 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d24323-24c5-486c-a65b-2560bb874c02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d93da8d-9a44-4068-93ae-56783ad4a606]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] <== disconnect_volume: return (303ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:10:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG nova.objects.instance [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'flavor' on Instance uuid 0d952de1-8c78-4bea-853d-21ac4f979845 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bcb4bc19-1821-492a-9fa7-19614a9496ce tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "0d952de1-8c78-4bea-853d-21ac4f979845" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.819s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:10:55 user nova-compute[75246]: INFO nova.virt.block_device [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Booting with volume 93cece48-a518-4bf3-b1e6-8d98ecb74b95 at /dev/vdc
Nov 28 17:10:55 user nova-compute[75246]: DEBUG os_brick.utils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c412db7-38a5-4208-acf4-c0fa044685a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c682f90c-5162-422c-83f4-1bd62cbc17cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8253663-45b2-4d5a-acd5-fbdc3f3b7de2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d81d517-6354-4e48-bf28-fb6f72f822bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:10:55 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:10:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a8ced2-e4b6-45ab-afcc-9caef1c5683a]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG os_brick.utils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Updating existing volume attachment record: 0b20621f-0c69-43d2-88d2-fbca82103475 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:10:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:10:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:11:03 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Creating image(s)
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Did not create local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Ensure instance console log exists: /opt/stack/data/nova/instances/8ae64996-670b-4179-9280-27fa7141a8d1/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Start _get_guest_xml network_info=[{"id": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "address": "fa:16:3e:54:fe:1f", "network": {"id": "544b007d-d4e9-4bdf-b20a-0d680ffc4922", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1651046378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204beaa6-93", "ovs_interfaceid": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "address": "fa:16:3e:86:6c:fd", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7e4bce-23", "ovs_interfaceid": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "address": "fa:16:3e:84:ca:5e", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3decefbc-a2", "ovs_interfaceid": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "address": "fa:16:3e:7f:22:59", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb198a574-6f", "ovs_interfaceid": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "address": "fa:16:3e:c6:36:3f", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7895e4b8-04", "ovs_interfaceid": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f31d8039-9a73-4288-813c-fb13de3d2a12", "address": "fa:16:3e:7d:b9:0d", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31d8039-9a", "ovs_interfaceid": "f31d8039-9a73-4288-813c-fb13de3d2a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "address": "fa:16:3e:5c:ef:c4", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcb1e63-1b", "ovs_interfaceid": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '6ea33b53-685e-46d2-a681-6bb13dd25fe7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdICwYHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ae64996-670b-4179-9280-27fa7141a8d1', 'attached_at': '', 'detached_at': '', 'volume_id': 'dc02ace1-85f5-476c-8300-f15e2555272b', 'serial': 'dc02ace1-85f5-476c-8300-f15e2555272b'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 1, 'attachment_id': '421945c4-c210-461b-855b-223046e99e9f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XSquVioC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ae64996-670b-4179-9280-27fa7141a8d1', 'attached_at': '', 'detached_at': '', 'volume_id': '7f6e8e13-9a7b-4372-9027-7fe6e58641e9', 'serial': '7f6e8e13-9a7b-4372-9027-7fe6e58641e9'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 2, 'attachment_id': '0b20621f-0c69-43d2-88d2-fbca82103475', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvLTdmUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ae64996-670b-4179-9280-27fa7141a8d1', 'attached_at': '', 'detached_at': '', 'volume_id': '93cece48-a518-4bf3-b1e6-8d98ecb74b95', 'serial': '93cece48-a518-4bf3-b1e6-8d98ecb74b95'}, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:11:03 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:11:03 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdICwYHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:11:03 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:11:03 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:11:03 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c425f72b-29d9-4440-ad67-bf916c8229ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:11:03 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32ac613-ba8f-4899-8ae5-0dd74ca174bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b] added
Nov 28 17:11:03 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc8c091-40a4-4faa-a42a-5ea65f939fa1]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b51dc3-59fa-4e69-9d82-972a6ba77a8b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdICwYHD {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdICwYHD" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77190e7-17f5-4d2c-9a5c-d5f4d0545ae2]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JdICwYHD'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cad851-556e-4708-9e5e-cb89ebacab94]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f315e7a-9cb8-4f94-b1a8-b6f9d080d568]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 17:11:03 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 17:11:03 user nova-compute[75246]:  {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:11:03 user nova-compute[75246]: WARNING os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 17:11:03 user nova-compute[75246]: 
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ed463d-7d57-4f3e-9d91-b8782ad52349]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b, portal: 172.16.0.220,3260]
Nov 28 17:11:03 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b, portal: 172.16.0.220,3260] successful.
Nov 28 17:11:03 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f4c03c-b39a-4212-bd76-1375a3d28ba1]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f5974e-e954-4351-9995-8eef7aec7bd2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:03 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:03 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca3b7e5-723c-4f97-933a-8dce8de40471]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdICwYHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:03 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:11:03 user nova-compute[75246]: INFO nova.compute.claims [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Claim successful on node user
Nov 28 17:11:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.684s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG nova.network.neutron [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:11:04 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:11:04 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG nova.policy [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6897bba4a31544f78a2f1911294deb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84705237374f40e287bdc39098936027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26232666665366365', 'path': '/dev/sdb'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232666665366365', 'path': '/dev/sdb'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XSquVioC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:11:04 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:11:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:11:04 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:11:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:11:04 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:11:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc2bf11-a4a0-4122-a202-74e22cb72b94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:11:04 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:11:04 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Creating image(s)
Nov 28 17:11:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "/opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "/opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[23279cc5-aeba-4d38-87d6-9c480597a366]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9] added
Nov 28 17:11:04 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffcbaef-1129-4474-bc8f-d98520a62369]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9bd962-ce8e-4a6c-9fb6-fd35efaff07e]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XSquVioC {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XSquVioC" returned: 0 in 0.040s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee516f62-a0a9-46e1-be2f-592384bc5598]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XSquVioC'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5d389e-9a2a-49ce-8ff9-f9a783eda8a7]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdb90fb-5cb3-42eb-9b5f-3c51c2ef2824]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:05 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:05 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.222s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[937a19cb-0ae7-42e7-a978-13956f59a94e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9, portal: 172.16.0.220,3260]
Nov 28 17:11:05 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9, portal: 172.16.0.220,3260] successful.
Nov 28 17:11:05 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5a399d-c41f-4235-8fb1-7f61df05c725]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[994e3d4c-a4e7-479d-beec-3699743e8787]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:05 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:11:05 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:05 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:11:05 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cab2da3-0b74-4c26-9543-98de3d8e2e92]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: None {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk 1073741824" returned: 0 in 0.059s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG nova.compute.manager [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:11:05 user nova-compute[75246]: INFO nova.compute.claims [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Claim successful on node user
Nov 28 17:11:05 user nova-compute[75246]: DEBUG nova.network.neutron [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Successfully created port: 1e7e447d-e8b6-4a5e-893a-dd06e8818b24 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Cannot resize image /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Ensure instance console log exists: /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:11:05 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG nova.network.neutron [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:11:06 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:11:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:11:06 user nova-compute[75246]: INFO nova.virt.block_device [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Booting with volume 705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 at /dev/vda
Nov 28 17:11:06 user nova-compute[75246]: DEBUG nova.policy [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39d2eb0837eb4c729fe9ca2964cbe789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be06eee4e74a41b799f1df75ea55b955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XSquVioC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '26565643761646635', 'path': '/dev/sdc'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565643761646635', 'path': '/dev/sdc'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvLTdmUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:11:06 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:11:06 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:11:06 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51a3311-5195-4457-a007-3ec37a505638]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:11:06 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.utils [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb0bf42-d6cb-4ecc-91bd-600d3a4265bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95] added
Nov 28 17:11:06 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[865e0781-9b2c-4343-a9d3-bb566aad19e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4094335e-ec03-4d89-8c34-95bbb507b538]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dfa22a-b85c-4401-9447-be9ea4b0657e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8136cd6-52f7-4576-be5a-1aab18538853]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvLTdmUN {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[736b7859-763f-47c2-87e2-7e20de06fea6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd2c6e4-fdf1-4e9c-b656-a030061292d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvLTdmUN" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c03d9db-079c-43e5-a119-b2205e3dbc48]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uvLTdmUN'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:11:06 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2450d2a5-d3d4-491f-aa4b-54cdc5ae41aa]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.utils [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Updating existing volume attachment record: b9379923-57ec-4876-a213-e79a4abf6bec {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53231bc-e358-40fc-af2d-20a6201aa61d]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[806eecf0-5986-40c2-b11a-48913b69e26b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:06 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:11:06 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:06 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:11:06 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG nova.network.neutron [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Successfully updated port: 1e7e447d-e8b6-4a5e-893a-dd06e8818b24 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[60734276-4be8-4d00-9753-2030e95501eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95, portal: 172.16.0.220,3260]
Nov 28 17:11:06 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95, portal: 172.16.0.220,3260] successful.
Nov 28 17:11:06 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "refresh_cache-0ed72d2a-ca9b-4b99-b422-86fa93af945c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquired lock "refresh_cache-0ed72d2a-ca9b-4b99-b422-86fa93af945c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG nova.network.neutron [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0110e4ef-2cbc-4ec1-a584-8049f2534d0a]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-091f4315-35e6-4096-a740-22aae7dc5adf req-2ba5b3fb-afd7-4184-8265-9db011b4d027 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Received event network-changed-1e7e447d-e8b6-4a5e-893a-dd06e8818b24 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-091f4315-35e6-4096-a740-22aae7dc5adf req-2ba5b3fb-afd7-4184-8265-9db011b4d027 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Refreshing instance network info cache due to event network-changed-1e7e447d-e8b6-4a5e-893a-dd06e8818b24. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-091f4315-35e6-4096-a740-22aae7dc5adf req-2ba5b3fb-afd7-4184-8265-9db011b4d027 service nova] Acquiring lock "refresh_cache-0ed72d2a-ca9b-4b99-b422-86fa93af945c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bce887-3e9d-4178-9b0d-f365a6691841]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:06 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:11:06 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:11:06 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:06 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:11:06 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:11:06 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[75932e15-c037-418b-9e81-0c5b2c69af21]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvLTdmUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:11:06 user nova-compute[75246]: DEBUG nova.network.neutron [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.neutron [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Updating instance_info_cache with network_info: [{"id": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "address": "fa:16:3e:ef:e7:23", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e447d-e8", "ovs_interfaceid": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Releasing lock "refresh_cache-0ed72d2a-ca9b-4b99-b422-86fa93af945c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Instance network_info: |[{"id": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "address": "fa:16:3e:ef:e7:23", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e447d-e8", "ovs_interfaceid": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-091f4315-35e6-4096-a740-22aae7dc5adf req-2ba5b3fb-afd7-4184-8265-9db011b4d027 service nova] Acquired lock "refresh_cache-0ed72d2a-ca9b-4b99-b422-86fa93af945c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.neutron [req-091f4315-35e6-4096-a740-22aae7dc5adf req-2ba5b3fb-afd7-4184-8265-9db011b4d027 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Refreshing network info cache for port 1e7e447d-e8b6-4a5e-893a-dd06e8818b24 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Start _get_guest_xml network_info=[{"id": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "address": "fa:16:3e:ef:e7:23", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e447d-e8", "ovs_interfaceid": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:11:07 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:11:07 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:11:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1178057911',display_name='tempest-TestStampPattern-server-1178057911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1178057911',id=26,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnj4hviUDvSX6hriv+L/QlZItoNaDMhnx3xQZWny569+OHLO66OwUH6l0a05JpEbHna9f+mLN7Ii3Ir+MVNbuGgRCX/YzUtBIJTlrG7CTESk7NAniXb5lC2lIImNVOo0A==',key_name='tempest-TestStampPattern-150119392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84705237374f40e287bdc39098936027',ramdisk_id='',reservation_id='r-l3hud2uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1581372233',owner_user_name='tempest-TestStampPattern-1581372233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:11:05Z,user_data=None,user_id='6897bba4a31544f78a2f1911294deb97',uuid=0ed72d2a-ca9b-4b99-b422-86fa93af945c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "address": "fa:16:3e:ef:e7:23", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e447d-e8", "ovs_interfaceid": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Converting VIF {"id": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "address": "fa:16:3e:ef:e7:23", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e447d-e8", "ovs_interfaceid": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:e7:23,bridge_name='br-int',has_traffic_filtering=True,id=1e7e447d-e8b6-4a5e-893a-dd06e8818b24,network=Network(ce13947d-26bc-4814-afed-38b0697cb13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7e447d-e8') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.objects.instance [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ed72d2a-ca9b-4b99-b422-86fa93af945c {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:11:07 user nova-compute[75246]:   <uuid>0ed72d2a-ca9b-4b99-b422-86fa93af945c</uuid>
Nov 28 17:11:07 user nova-compute[75246]:   <name>instance-0000001a</name>
Nov 28 17:11:07 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:11:07 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:11:07 user nova-compute[75246]:   <metadata>
Nov 28 17:11:07 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:11:07 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:11:07 user nova-compute[75246]:       <nova:name>tempest-TestStampPattern-server-1178057911</nova:name>
Nov 28 17:11:07 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:11:07</nova:creationTime>
Nov 28 17:11:07 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:11:07 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:11:07 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:11:07 user nova-compute[75246]:       <nova:owner>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:user uuid="6897bba4a31544f78a2f1911294deb97">tempest-TestStampPattern-1581372233-project-member</nova:user>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:project uuid="84705237374f40e287bdc39098936027">tempest-TestStampPattern-1581372233</nova:project>
Nov 28 17:11:07 user nova-compute[75246]:       </nova:owner>
Nov 28 17:11:07 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:11:07 user nova-compute[75246]:       <nova:ports>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:port uuid="1e7e447d-e8b6-4a5e-893a-dd06e8818b24">
Nov 28 17:11:07 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 17:11:07 user nova-compute[75246]:         </nova:port>
Nov 28 17:11:07 user nova-compute[75246]:       </nova:ports>
Nov 28 17:11:07 user nova-compute[75246]:     </nova:instance>
Nov 28 17:11:07 user nova-compute[75246]:   </metadata>
Nov 28 17:11:07 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:11:07 user nova-compute[75246]:     <system>
Nov 28 17:11:07 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:11:07 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:11:07 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:11:07 user nova-compute[75246]:       <entry name="serial">0ed72d2a-ca9b-4b99-b422-86fa93af945c</entry>
Nov 28 17:11:07 user nova-compute[75246]:       <entry name="uuid">0ed72d2a-ca9b-4b99-b422-86fa93af945c</entry>
Nov 28 17:11:07 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:11:07 user nova-compute[75246]:     </system>
Nov 28 17:11:07 user nova-compute[75246]:   </sysinfo>
Nov 28 17:11:07 user nova-compute[75246]:   <os>
Nov 28 17:11:07 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:11:07 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:11:07 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:11:07 user nova-compute[75246]:   </os>
Nov 28 17:11:07 user nova-compute[75246]:   <features>
Nov 28 17:11:07 user nova-compute[75246]:     <acpi/>
Nov 28 17:11:07 user nova-compute[75246]:     <apic/>
Nov 28 17:11:07 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:11:07 user nova-compute[75246]:   </features>
Nov 28 17:11:07 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:11:07 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:11:07 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:11:07 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:11:07 user nova-compute[75246]:   </clock>
Nov 28 17:11:07 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:11:07 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:11:07 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:11:07 user nova-compute[75246]:   </cpu>
Nov 28 17:11:07 user nova-compute[75246]:   <devices>
Nov 28 17:11:07 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:11:07 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:11:07 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk"/>
Nov 28 17:11:07 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:11:07 user nova-compute[75246]:     </disk>
Nov 28 17:11:07 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:11:07 user nova-compute[75246]:       <mac address="fa:16:3e:ef:e7:23"/>
Nov 28 17:11:07 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:11:07 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:11:07 user nova-compute[75246]:       <target dev="tap1e7e447d-e8"/>
Nov 28 17:11:07 user nova-compute[75246]:     </interface>
Nov 28 17:11:07 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:11:07 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/console.log" append="off"/>
Nov 28 17:11:07 user nova-compute[75246]:     </serial>
Nov 28 17:11:07 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:11:07 user nova-compute[75246]:     <video>
Nov 28 17:11:07 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:11:07 user nova-compute[75246]:     </video>
Nov 28 17:11:07 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:11:07 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:11:07 user nova-compute[75246]:     </rng>
Nov 28 17:11:07 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:11:07 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:11:07 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:11:07 user nova-compute[75246]:     </memballoon>
Nov 28 17:11:07 user nova-compute[75246]:   </devices>
Nov 28 17:11:07 user nova-compute[75246]: </domain>
Nov 28 17:11:07 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:11:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1178057911',display_name='tempest-TestStampPattern-server-1178057911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1178057911',id=26,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnj4hviUDvSX6hriv+L/QlZItoNaDMhnx3xQZWny569+OHLO66OwUH6l0a05JpEbHna9f+mLN7Ii3Ir+MVNbuGgRCX/YzUtBIJTlrG7CTESk7NAniXb5lC2lIImNVOo0A==',key_name='tempest-TestStampPattern-150119392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84705237374f40e287bdc39098936027',ramdisk_id='',reservation_id='r-l3hud2uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1581372233',owner_user_name='tempest-TestStampPattern-1581372233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:11:05Z,user_data=None,user_id='6897bba4a31544f78a2f1911294deb97',uuid=0ed72d2a-ca9b-4b99-b422-86fa93af945c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "address": "fa:16:3e:ef:e7:23", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e447d-e8", "ovs_interfaceid": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Converting VIF {"id": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "address": "fa:16:3e:ef:e7:23", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e447d-e8", "ovs_interfaceid": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:e7:23,bridge_name='br-int',has_traffic_filtering=True,id=1e7e447d-e8b6-4a5e-893a-dd06e8818b24,network=Network(ce13947d-26bc-4814-afed-38b0697cb13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7e447d-e8') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG os_vif [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:e7:23,bridge_name='br-int',has_traffic_filtering=True,id=1e7e447d-e8b6-4a5e-893a-dd06e8818b24,network=Network(ce13947d-26bc-4814-afed-38b0697cb13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7e447d-e8') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da032915-0b95-50e1-b188-c0dcd16400be', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e7e447d-e8, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e7e447d-e8, col_values=(('qos', UUID('08d26d20-97e7-4c9e-8f41-848c10b96fff')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e7e447d-e8, col_values=(('external_ids', {'iface-id': '1e7e447d-e8b6-4a5e-893a-dd06e8818b24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:e7:23', 'vm-uuid': '0ed72d2a-ca9b-4b99-b422-86fa93af945c'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: INFO os_vif [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:e7:23,bridge_name='br-int',has_traffic_filtering=True,id=1e7e447d-e8b6-4a5e-893a-dd06e8818b24,network=Network(ce13947d-26bc-4814-afed-38b0697cb13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7e447d-e8')
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] No VIF found with MAC fa:16:3e:ef:e7:23, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.neutron [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Successfully created port: 3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23836396664653561', 'path': '/dev/sdd'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836396664653561', 'path': '/dev/sdd'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "address": "fa:16:3e:54:fe:1f", "network": {"id": "544b007d-d4e9-4bdf-b20a-0d680ffc4922", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1651046378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204beaa6-93", "ovs_interfaceid": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "address": "fa:16:3e:54:fe:1f", "network": {"id": "544b007d-d4e9-4bdf-b20a-0d680ffc4922", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1651046378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204beaa6-93", "ovs_interfaceid": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:fe:1f,bridge_name='br-int',has_traffic_filtering=True,id=204beaa6-93fe-477c-a9c6-9682ad9f95ef,network=Network(544b007d-d4e9-4bdf-b20a-0d680ffc4922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204beaa6-93') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "address": "fa:16:3e:86:6c:fd", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7e4bce-23", "ovs_interfaceid": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "address": "fa:16:3e:86:6c:fd", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7e4bce-23", "ovs_interfaceid": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:6c:fd,bridge_name='br-int',has_traffic_filtering=True,id=bd7e4bce-235e-41c2-88c5-b042af4b50bf,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd7e4bce-23') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "address": "fa:16:3e:84:ca:5e", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3decefbc-a2", "ovs_interfaceid": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "address": "fa:16:3e:84:ca:5e", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3decefbc-a2", "ovs_interfaceid": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ca:5e,bridge_name='br-int',has_traffic_filtering=True,id=3decefbc-a21c-466b-bf11-1ea7fe421a89,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3decefbc-a2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "address": "fa:16:3e:7f:22:59", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb198a574-6f", "ovs_interfaceid": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "address": "fa:16:3e:7f:22:59", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb198a574-6f", "ovs_interfaceid": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:22:59,bridge_name='br-int',has_traffic_filtering=True,id=b198a574-6fe0-47d1-90c2-98ffe1c7c1bc,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb198a574-6f') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "address": "fa:16:3e:c6:36:3f", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7895e4b8-04", "ovs_interfaceid": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "address": "fa:16:3e:c6:36:3f", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7895e4b8-04", "ovs_interfaceid": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:36:3f,bridge_name='br-int',has_traffic_filtering=True,id=7895e4b8-0496-479c-8ccd-1de0613b1c19,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7895e4b8-04') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f31d8039-9a73-4288-813c-fb13de3d2a12", "address": "fa:16:3e:7d:b9:0d", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31d8039-9a", "ovs_interfaceid": "f31d8039-9a73-4288-813c-fb13de3d2a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "f31d8039-9a73-4288-813c-fb13de3d2a12", "address": "fa:16:3e:7d:b9:0d", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31d8039-9a", "ovs_interfaceid": "f31d8039-9a73-4288-813c-fb13de3d2a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=f31d8039-9a73-4288-813c-fb13de3d2a12,network=Network(5322f285-a4cc-4a45-a4f6-8b97dca86962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31d8039-9a') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "address": "fa:16:3e:5c:ef:c4", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcb1e63-1b", "ovs_interfaceid": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "address": "fa:16:3e:5c:ef:c4", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcb1e63-1b", "ovs_interfaceid": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ef:c4,bridge_name='br-int',has_traffic_filtering=True,id=1fcb1e63-1b0b-4c45-9fda-200b1fd719c5,network=Network(5322f285-a4cc-4a45-a4f6-8b97dca86962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fcb1e63-1b') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.objects.instance [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ae64996-670b-4179-9280-27fa7141a8d1 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:11:07 user nova-compute[75246]:   <uuid>8ae64996-670b-4179-9280-27fa7141a8d1</uuid>
Nov 28 17:11:07 user nova-compute[75246]:   <name>instance-00000019</name>
Nov 28 17:11:07 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:11:07 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:11:07 user nova-compute[75246]:   <metadata>
Nov 28 17:11:07 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:11:07 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:11:07 user nova-compute[75246]:       <nova:name>tempest-device-tagging-server-2101189537</nova:name>
Nov 28 17:11:07 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:11:03</nova:creationTime>
Nov 28 17:11:07 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:11:07 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:11:07 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:11:07 user nova-compute[75246]:       <nova:owner>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:user uuid="9da5fcd6e6e24f0aaddfbeb5ad34cb17">tempest-TaggedBootDevicesTest-1843849941-project-member</nova:user>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:project uuid="0e3144ba262d42ac98ac03dc7052e8ae">tempest-TaggedBootDevicesTest-1843849941</nova:project>
Nov 28 17:11:07 user nova-compute[75246]:       </nova:owner>
Nov 28 17:11:07 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:11:07 user nova-compute[75246]:       <nova:ports>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:port uuid="204beaa6-93fe-477c-a9c6-9682ad9f95ef">
Nov 28 17:11:07 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 17:11:07 user nova-compute[75246]:         </nova:port>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:port uuid="bd7e4bce-235e-41c2-88c5-b042af4b50bf">
Nov 28 17:11:07 user nova-compute[75246]:           <nova:ip type="fixed" address="10.1.1.76" ipVersion="4"/>
Nov 28 17:11:07 user nova-compute[75246]:         </nova:port>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:port uuid="3decefbc-a21c-466b-bf11-1ea7fe421a89">
Nov 28 17:11:07 user nova-compute[75246]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Nov 28 17:11:07 user nova-compute[75246]:         </nova:port>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:port uuid="b198a574-6fe0-47d1-90c2-98ffe1c7c1bc">
Nov 28 17:11:07 user nova-compute[75246]:           <nova:ip type="fixed" address="10.1.1.91" ipVersion="4"/>
Nov 28 17:11:07 user nova-compute[75246]:         </nova:port>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:port uuid="7895e4b8-0496-479c-8ccd-1de0613b1c19">
Nov 28 17:11:07 user nova-compute[75246]:           <nova:ip type="fixed" address="10.1.1.134" ipVersion="4"/>
Nov 28 17:11:07 user nova-compute[75246]:         </nova:port>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:port uuid="f31d8039-9a73-4288-813c-fb13de3d2a12">
Nov 28 17:11:07 user nova-compute[75246]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 28 17:11:07 user nova-compute[75246]:         </nova:port>
Nov 28 17:11:07 user nova-compute[75246]:         <nova:port uuid="1fcb1e63-1b0b-4c45-9fda-200b1fd719c5">
Nov 28 17:11:07 user nova-compute[75246]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 28 17:11:07 user nova-compute[75246]:         </nova:port>
Nov 28 17:11:07 user nova-compute[75246]:       </nova:ports>
Nov 28 17:11:07 user nova-compute[75246]:     </nova:instance>
Nov 28 17:11:07 user nova-compute[75246]:   </metadata>
Nov 28 17:11:07 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:11:07 user nova-compute[75246]:     <system>
Nov 28 17:11:07 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:11:07 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:11:07 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:11:07 user nova-compute[75246]:       <entry name="serial">8ae64996-670b-4179-9280-27fa7141a8d1</entry>
Nov 28 17:11:07 user nova-compute[75246]:       <entry name="uuid">8ae64996-670b-4179-9280-27fa7141a8d1</entry>
Nov 28 17:11:07 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:11:07 user nova-compute[75246]:     </system>
Nov 28 17:11:07 user nova-compute[75246]:   </sysinfo>
Nov 28 17:11:07 user nova-compute[75246]:   <os>
Nov 28 17:11:07 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:11:07 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:11:07 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:11:07 user nova-compute[75246]:   </os>
Nov 28 17:11:07 user nova-compute[75246]:   <features>
Nov 28 17:11:07 user nova-compute[75246]:     <acpi/>
Nov 28 17:11:07 user nova-compute[75246]:     <apic/>
Nov 28 17:11:07 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:11:07 user nova-compute[75246]:   </features>
Nov 28 17:11:07 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:11:07 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:11:07 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:11:07 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:11:07 user nova-compute[75246]:   </clock>
Nov 28 17:11:07 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:11:07 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:11:07 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:11:07 user nova-compute[75246]:   </cpu>
Nov 28 17:11:07 user nova-compute[75246]:   <devices>
Nov 28 17:11:07 user nova-compute[75246]:     <disk type="file" device="cdrom">
Nov 28 17:11:07 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 17:11:07 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/8ae64996-670b-4179-9280-27fa7141a8d1/disk.config"/>
Nov 28 17:11:07 user nova-compute[75246]:       <target dev="hda" bus="ide"/>
Nov 28 17:11:07 user nova-compute[75246]:     </disk>
Nov 28 17:11:07 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:11:07 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:11:07 user nova-compute[75246]:       <source dev="/dev/sdb"/>
Nov 28 17:11:07 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:11:07 user nova-compute[75246]:       <serial>dc02ace1-85f5-476c-8300-f15e2555272b</serial>
Nov 28 17:11:07 user nova-compute[75246]:     </disk>
Nov 28 17:11:07 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:11:07 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:11:07 user nova-compute[75246]:       <source dev="/dev/sdc"/>
Nov 28 17:11:07 user nova-compute[75246]:       <target dev="vdb" bus="virtio"/>
Nov 28 17:11:07 user nova-compute[75246]:       <serial>7f6e8e13-9a7b-4372-9027-7fe6e58641e9</serial>
Nov 28 17:11:07 user nova-compute[75246]:     </disk>
Nov 28 17:11:07 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:11:07 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:11:07 user nova-compute[75246]:       <source dev="/dev/sdd"/>
Nov 28 17:11:07 user nova-compute[75246]:       <target dev="vdc" bus="virtio"/>
Nov 28 17:11:07 user nova-compute[75246]:       <serial>93cece48-a518-4bf3-b1e6-8d98ecb74b95</serial>
Nov 28 17:11:07 user nova-compute[75246]:     </disk>
Nov 28 17:11:07 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:11:07 user nova-compute[75246]:       <mac address="fa:16:3e:54:fe:1f"/>
Nov 28 17:11:07 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:11:07 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:11:07 user nova-compute[75246]:       <target dev="tap204beaa6-93"/>
Nov 28 17:11:07 user nova-compute[75246]:     </interface>
Nov 28 17:11:07 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:11:07 user nova-compute[75246]:       <mac address="fa:16:3e:86:6c:fd"/>
Nov 28 17:11:07 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:11:07 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:11:07 user nova-compute[75246]:       <target dev="tapbd7e4bce-23"/>
Nov 28 17:11:07 user nova-compute[75246]:     </interface>
Nov 28 17:11:07 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:11:07 user nova-compute[75246]:       <mac address="fa:16:3e:84:ca:5e"/>
Nov 28 17:11:07 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:11:07 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:11:07 user nova-compute[75246]:       <target dev="tap3decefbc-a2"/>
Nov 28 17:11:07 user nova-compute[75246]:     </interface>
Nov 28 17:11:07 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:11:07 user nova-compute[75246]:       <mac address="fa:16:3e:7f:22:59"/>
Nov 28 17:11:07 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:11:07 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:11:07 user nova-compute[75246]:       <target dev="tapb198a574-6f"/>
Nov 28 17:11:07 user nova-compute[75246]:     </interface>
Nov 28 17:11:07 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:11:07 user nova-compute[75246]:       <mac address="fa:16:3e:c6:36:3f"/>
Nov 28 17:11:07 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:11:07 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:11:07 user nova-compute[75246]:       <target dev="tap7895e4b8-04"/>
Nov 28 17:11:07 user nova-compute[75246]:     </interface>
Nov 28 17:11:07 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:11:07 user nova-compute[75246]:       <mac address="fa:16:3e:7d:b9:0d"/>
Nov 28 17:11:07 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:11:07 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:11:07 user nova-compute[75246]:       <target dev="tapf31d8039-9a"/>
Nov 28 17:11:07 user nova-compute[75246]:     </interface>
Nov 28 17:11:07 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:11:07 user nova-compute[75246]:       <mac address="fa:16:3e:5c:ef:c4"/>
Nov 28 17:11:07 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:11:07 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:11:07 user nova-compute[75246]:       <target dev="tap1fcb1e63-1b"/>
Nov 28 17:11:07 user nova-compute[75246]:     </interface>
Nov 28 17:11:07 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:11:07 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/8ae64996-670b-4179-9280-27fa7141a8d1/console.log" append="off"/>
Nov 28 17:11:07 user nova-compute[75246]:     </serial>
Nov 28 17:11:07 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:11:07 user nova-compute[75246]:     <video>
Nov 28 17:11:07 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:11:07 user nova-compute[75246]:     </video>
Nov 28 17:11:07 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:11:07 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:11:07 user nova-compute[75246]:     </rng>
Nov 28 17:11:07 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:11:07 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:11:07 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:11:07 user nova-compute[75246]:     </memballoon>
Nov 28 17:11:07 user nova-compute[75246]:   </devices>
Nov 28 17:11:07 user nova-compute[75246]: </domain>
Nov 28 17:11:07 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "address": "fa:16:3e:54:fe:1f", "network": {"id": "544b007d-d4e9-4bdf-b20a-0d680ffc4922", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1651046378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204beaa6-93", "ovs_interfaceid": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "address": "fa:16:3e:54:fe:1f", "network": {"id": "544b007d-d4e9-4bdf-b20a-0d680ffc4922", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1651046378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204beaa6-93", "ovs_interfaceid": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:fe:1f,bridge_name='br-int',has_traffic_filtering=True,id=204beaa6-93fe-477c-a9c6-9682ad9f95ef,network=Network(544b007d-d4e9-4bdf-b20a-0d680ffc4922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204beaa6-93') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG os_vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:fe:1f,bridge_name='br-int',has_traffic_filtering=True,id=204beaa6-93fe-477c-a9c6-9682ad9f95ef,network=Network(544b007d-d4e9-4bdf-b20a-0d680ffc4922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204beaa6-93') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3100278-da7f-507c-a07c-f41b152875ff', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap204beaa6-93, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap204beaa6-93, col_values=(('qos', UUID('9832d146-b4c1-4cec-bc2b-4bfacd12b94f')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap204beaa6-93, col_values=(('external_ids', {'iface-id': '204beaa6-93fe-477c-a9c6-9682ad9f95ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:fe:1f', 'vm-uuid': '8ae64996-670b-4179-9280-27fa7141a8d1'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: INFO os_vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:fe:1f,bridge_name='br-int',has_traffic_filtering=True,id=204beaa6-93fe-477c-a9c6-9682ad9f95ef,network=Network(544b007d-d4e9-4bdf-b20a-0d680ffc4922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204beaa6-93')
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "address": "fa:16:3e:86:6c:fd", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7e4bce-23", "ovs_interfaceid": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "address": "fa:16:3e:86:6c:fd", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7e4bce-23", "ovs_interfaceid": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:6c:fd,bridge_name='br-int',has_traffic_filtering=True,id=bd7e4bce-235e-41c2-88c5-b042af4b50bf,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd7e4bce-23') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG os_vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:6c:fd,bridge_name='br-int',has_traffic_filtering=True,id=bd7e4bce-235e-41c2-88c5-b042af4b50bf,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd7e4bce-23') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4529d475-6f58-5e31-8bcd-a55a8a1e9249', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd7e4bce-23, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd7e4bce-23, col_values=(('qos', UUID('9865e1fd-21fb-49c7-b5b5-4806629d488c')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd7e4bce-23, col_values=(('external_ids', {'iface-id': 'bd7e4bce-235e-41c2-88c5-b042af4b50bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:6c:fd', 'vm-uuid': '8ae64996-670b-4179-9280-27fa7141a8d1'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: INFO os_vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:6c:fd,bridge_name='br-int',has_traffic_filtering=True,id=bd7e4bce-235e-41c2-88c5-b042af4b50bf,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd7e4bce-23')
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "address": "fa:16:3e:84:ca:5e", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3decefbc-a2", "ovs_interfaceid": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "address": "fa:16:3e:84:ca:5e", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3decefbc-a2", "ovs_interfaceid": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ca:5e,bridge_name='br-int',has_traffic_filtering=True,id=3decefbc-a21c-466b-bf11-1ea7fe421a89,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3decefbc-a2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG os_vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ca:5e,bridge_name='br-int',has_traffic_filtering=True,id=3decefbc-a21c-466b-bf11-1ea7fe421a89,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3decefbc-a2') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84347de7-d70d-56c8-a85e-daab29a7c35e', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3decefbc-a2, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3decefbc-a2, col_values=(('qos', UUID('4a521146-0f7d-406f-a002-04cf08ee36b2')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3decefbc-a2, col_values=(('external_ids', {'iface-id': '3decefbc-a21c-466b-bf11-1ea7fe421a89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:ca:5e', 'vm-uuid': '8ae64996-670b-4179-9280-27fa7141a8d1'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: INFO os_vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ca:5e,bridge_name='br-int',has_traffic_filtering=True,id=3decefbc-a21c-466b-bf11-1ea7fe421a89,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3decefbc-a2')
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "address": "fa:16:3e:7f:22:59", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb198a574-6f", "ovs_interfaceid": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "address": "fa:16:3e:7f:22:59", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb198a574-6f", "ovs_interfaceid": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:22:59,bridge_name='br-int',has_traffic_filtering=True,id=b198a574-6fe0-47d1-90c2-98ffe1c7c1bc,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb198a574-6f') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG os_vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:22:59,bridge_name='br-int',has_traffic_filtering=True,id=b198a574-6fe0-47d1-90c2-98ffe1c7c1bc,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb198a574-6f') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3bb230ae-02d1-5fb4-8c6e-e5cf00a233f4', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb198a574-6f, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb198a574-6f, col_values=(('qos', UUID('12187eb2-9498-4d8c-881f-a9cd2d7a4cc9')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb198a574-6f, col_values=(('external_ids', {'iface-id': 'b198a574-6fe0-47d1-90c2-98ffe1c7c1bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:22:59', 'vm-uuid': '8ae64996-670b-4179-9280-27fa7141a8d1'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.network.neutron [req-091f4315-35e6-4096-a740-22aae7dc5adf req-2ba5b3fb-afd7-4184-8265-9db011b4d027 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Updated VIF entry in instance network info cache for port 1e7e447d-e8b6-4a5e-893a-dd06e8818b24. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.network.neutron [req-091f4315-35e6-4096-a740-22aae7dc5adf req-2ba5b3fb-afd7-4184-8265-9db011b4d027 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Updating instance_info_cache with network_info: [{"id": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "address": "fa:16:3e:ef:e7:23", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e447d-e8", "ovs_interfaceid": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-091f4315-35e6-4096-a740-22aae7dc5adf req-2ba5b3fb-afd7-4184-8265-9db011b4d027 service nova] Releasing lock "refresh_cache-0ed72d2a-ca9b-4b99-b422-86fa93af945c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: INFO os_vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:22:59,bridge_name='br-int',has_traffic_filtering=True,id=b198a574-6fe0-47d1-90c2-98ffe1c7c1bc,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb198a574-6f')
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "address": "fa:16:3e:c6:36:3f", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7895e4b8-04", "ovs_interfaceid": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "address": "fa:16:3e:c6:36:3f", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7895e4b8-04", "ovs_interfaceid": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:36:3f,bridge_name='br-int',has_traffic_filtering=True,id=7895e4b8-0496-479c-8ccd-1de0613b1c19,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7895e4b8-04') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG os_vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:36:3f,bridge_name='br-int',has_traffic_filtering=True,id=7895e4b8-0496-479c-8ccd-1de0613b1c19,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7895e4b8-04') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b73dfb01-8514-5150-b051-3c57d13db0fa', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7895e4b8-04, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7895e4b8-04, col_values=(('qos', UUID('a2ea469b-a96b-4287-a27d-4b912f40cd4c')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7895e4b8-04, col_values=(('external_ids', {'iface-id': '7895e4b8-0496-479c-8ccd-1de0613b1c19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:36:3f', 'vm-uuid': '8ae64996-670b-4179-9280-27fa7141a8d1'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: INFO os_vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:36:3f,bridge_name='br-int',has_traffic_filtering=True,id=7895e4b8-0496-479c-8ccd-1de0613b1c19,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7895e4b8-04')
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f31d8039-9a73-4288-813c-fb13de3d2a12", "address": "fa:16:3e:7d:b9:0d", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31d8039-9a", "ovs_interfaceid": "f31d8039-9a73-4288-813c-fb13de3d2a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "f31d8039-9a73-4288-813c-fb13de3d2a12", "address": "fa:16:3e:7d:b9:0d", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31d8039-9a", "ovs_interfaceid": "f31d8039-9a73-4288-813c-fb13de3d2a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=f31d8039-9a73-4288-813c-fb13de3d2a12,network=Network(5322f285-a4cc-4a45-a4f6-8b97dca86962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31d8039-9a') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG os_vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=f31d8039-9a73-4288-813c-fb13de3d2a12,network=Network(5322f285-a4cc-4a45-a4f6-8b97dca86962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31d8039-9a') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae6fe79b-d62e-54d7-9c1f-3111701a1dc6', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf31d8039-9a, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf31d8039-9a, col_values=(('qos', UUID('179d1a16-06fe-4ce5-9d27-0ccbaa30e49d')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf31d8039-9a, col_values=(('external_ids', {'iface-id': 'f31d8039-9a73-4288-813c-fb13de3d2a12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:b9:0d', 'vm-uuid': '8ae64996-670b-4179-9280-27fa7141a8d1'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: INFO os_vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=f31d8039-9a73-4288-813c-fb13de3d2a12,network=Network(5322f285-a4cc-4a45-a4f6-8b97dca86962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31d8039-9a')
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "address": "fa:16:3e:5c:ef:c4", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcb1e63-1b", "ovs_interfaceid": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "address": "fa:16:3e:5c:ef:c4", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcb1e63-1b", "ovs_interfaceid": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ef:c4,bridge_name='br-int',has_traffic_filtering=True,id=1fcb1e63-1b0b-4c45-9fda-200b1fd719c5,network=Network(5322f285-a4cc-4a45-a4f6-8b97dca86962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fcb1e63-1b') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG os_vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ef:c4,bridge_name='br-int',has_traffic_filtering=True,id=1fcb1e63-1b0b-4c45-9fda-200b1fd719c5,network=Network(5322f285-a4cc-4a45-a4f6-8b97dca86962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fcb1e63-1b') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ca8dc62-6c70-5ecb-a503-7a2dad2ffff8', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fcb1e63-1b, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1fcb1e63-1b, col_values=(('qos', UUID('718b80f0-8904-4ee0-b562-7f7abb033718')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1fcb1e63-1b, col_values=(('external_ids', {'iface-id': '1fcb1e63-1b0b-4c45-9fda-200b1fd719c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:ef:c4', 'vm-uuid': '8ae64996-670b-4179-9280-27fa7141a8d1'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.network.neutron [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Successfully updated port: 3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquired lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.network.neutron [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: INFO os_vif [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ef:c4,bridge_name='br-int',has_traffic_filtering=True,id=1fcb1e63-1b0b-4c45-9fda-200b1fd719c5,network=Network(5322f285-a4cc-4a45-a4f6-8b97dca86962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fcb1e63-1b')
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.network.neutron [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] No BDM found with device name hda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] No VIF found with MAC fa:16:3e:54:fe:1f, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] No VIF found with MAC fa:16:3e:c6:36:3f, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:11:08 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Using config drive
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.compute.manager [req-5205f79f-38c4-45c7-b7da-84cd714bbebf req-a65a5c89-5477-4917-8122-0de42155ccef service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received event network-changed-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG nova.compute.manager [req-5205f79f-38c4-45c7-b7da-84cd714bbebf req-a65a5c89-5477-4917-8122-0de42155ccef service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Refreshing instance network info cache due to event network-changed-3f3c2850-37c8-4c04-a0ae-588a394ac8d9. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5205f79f-38c4-45c7-b7da-84cd714bbebf req-a65a5c89-5477-4917-8122-0de42155ccef service nova] Acquiring lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:11:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:09 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Creating config drive at /opt/stack/data/nova/instances/8ae64996-670b-4179-9280-27fa7141a8d1/disk.config
Nov 28 17:11:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8ae64996-670b-4179-9280-27fa7141a8d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp90zbosso {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:09 user nova-compute[75246]: DEBUG nova.network.neutron [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Updating instance_info_cache with network_info: [{"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:11:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8ae64996-670b-4179-9280-27fa7141a8d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp90zbosso" returned: 0 in 0.068s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Releasing lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:11:09 user nova-compute[75246]: DEBUG nova.compute.manager [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Instance network_info: |[{"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:11:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5205f79f-38c4-45c7-b7da-84cd714bbebf req-a65a5c89-5477-4917-8122-0de42155ccef service nova] Acquired lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:11:09 user nova-compute[75246]: DEBUG nova.network.neutron [req-5205f79f-38c4-45c7-b7da-84cd714bbebf req-a65a5c89-5477-4917-8122-0de42155ccef service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Refreshing network info cache for port 3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:11:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:09 user nova-compute[75246]: DEBUG nova.network.neutron [req-5205f79f-38c4-45c7-b7da-84cd714bbebf req-a65a5c89-5477-4917-8122-0de42155ccef service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Updated VIF entry in instance network info cache for port 3f3c2850-37c8-4c04-a0ae-588a394ac8d9. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:11:09 user nova-compute[75246]: DEBUG nova.network.neutron [req-5205f79f-38c4-45c7-b7da-84cd714bbebf req-a65a5c89-5477-4917-8122-0de42155ccef service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Updating instance_info_cache with network_info: [{"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:11:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5205f79f-38c4-45c7-b7da-84cd714bbebf req-a65a5c89-5477-4917-8122-0de42155ccef service nova] Releasing lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:11:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:11:11 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Instance spawned successfully.
Nov 28 17:11:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:11 user nova-compute[75246]: INFO nova.compute.manager [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Took 6.41 seconds to spawn the instance on the hypervisor.
Nov 28 17:11:11 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-db82f92f-9ddc-48f8-a58c-c0270aed7dc7 req-05439b7d-7c96-4391-aa3e-8fd6d4a0bbf8 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Received event network-vif-plugged-1e7e447d-e8b6-4a5e-893a-dd06e8818b24 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-db82f92f-9ddc-48f8-a58c-c0270aed7dc7 req-05439b7d-7c96-4391-aa3e-8fd6d4a0bbf8 service nova] Acquiring lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-db82f92f-9ddc-48f8-a58c-c0270aed7dc7 req-05439b7d-7c96-4391-aa3e-8fd6d4a0bbf8 service nova] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-db82f92f-9ddc-48f8-a58c-c0270aed7dc7 req-05439b7d-7c96-4391-aa3e-8fd6d4a0bbf8 service nova] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-db82f92f-9ddc-48f8-a58c-c0270aed7dc7 req-05439b7d-7c96-4391-aa3e-8fd6d4a0bbf8 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] No waiting events found dispatching network-vif-plugged-1e7e447d-e8b6-4a5e-893a-dd06e8818b24 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:11 user nova-compute[75246]: WARNING nova.compute.manager [req-db82f92f-9ddc-48f8-a58c-c0270aed7dc7 req-05439b7d-7c96-4391-aa3e-8fd6d4a0bbf8 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Received unexpected event network-vif-plugged-1e7e447d-e8b6-4a5e-893a-dd06e8818b24 for instance with vm_state building and task_state spawning.
Nov 28 17:11:11 user nova-compute[75246]: INFO nova.compute.manager [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Took 7.89 seconds to build instance.
Nov 28 17:11:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f87c71f4-0a4c-44fa-be68-e854f3b90ad0 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.029s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Received event network-vif-plugged-1e7e447d-e8b6-4a5e-893a-dd06e8818b24 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Acquiring lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] No waiting events found dispatching network-vif-plugged-1e7e447d-e8b6-4a5e-893a-dd06e8818b24 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:13 user nova-compute[75246]: WARNING nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Received unexpected event network-vif-plugged-1e7e447d-e8b6-4a5e-893a-dd06e8818b24 for instance with vm_state active and task_state None.
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-204beaa6-93fe-477c-a9c6-9682ad9f95ef {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-204beaa6-93fe-477c-a9c6-9682ad9f95ef {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:13 user nova-compute[75246]: WARNING nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-204beaa6-93fe-477c-a9c6-9682ad9f95ef for instance with vm_state building and task_state spawning.
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-204beaa6-93fe-477c-a9c6-9682ad9f95ef {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-204beaa6-93fe-477c-a9c6-9682ad9f95ef {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:13 user nova-compute[75246]: WARNING nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-204beaa6-93fe-477c-a9c6-9682ad9f95ef for instance with vm_state building and task_state spawning.
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-bd7e4bce-235e-41c2-88c5-b042af4b50bf {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-bd7e4bce-235e-41c2-88c5-b042af4b50bf {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:13 user nova-compute[75246]: WARNING nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-bd7e4bce-235e-41c2-88c5-b042af4b50bf for instance with vm_state building and task_state spawning.
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-bd7e4bce-235e-41c2-88c5-b042af4b50bf {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-bd7e4bce-235e-41c2-88c5-b042af4b50bf {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:13 user nova-compute[75246]: WARNING nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-bd7e4bce-235e-41c2-88c5-b042af4b50bf for instance with vm_state building and task_state spawning.
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-3decefbc-a21c-466b-bf11-1ea7fe421a89 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-3decefbc-a21c-466b-bf11-1ea7fe421a89 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:13 user nova-compute[75246]: WARNING nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-3decefbc-a21c-466b-bf11-1ea7fe421a89 for instance with vm_state building and task_state spawning.
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-3decefbc-a21c-466b-bf11-1ea7fe421a89 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-3decefbc-a21c-466b-bf11-1ea7fe421a89 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:13 user nova-compute[75246]: WARNING nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-3decefbc-a21c-466b-bf11-1ea7fe421a89 for instance with vm_state building and task_state spawning.
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-b198a574-6fe0-47d1-90c2-98ffe1c7c1bc {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-b198a574-6fe0-47d1-90c2-98ffe1c7c1bc {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:13 user nova-compute[75246]: WARNING nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-b198a574-6fe0-47d1-90c2-98ffe1c7c1bc for instance with vm_state building and task_state spawning.
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-b198a574-6fe0-47d1-90c2-98ffe1c7c1bc {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-b198a574-6fe0-47d1-90c2-98ffe1c7c1bc {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:13 user nova-compute[75246]: WARNING nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-b198a574-6fe0-47d1-90c2-98ffe1c7c1bc for instance with vm_state building and task_state spawning.
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-1fcb1e63-1b0b-4c45-9fda-200b1fd719c5 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-1fcb1e63-1b0b-4c45-9fda-200b1fd719c5 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:13 user nova-compute[75246]: WARNING nova.compute.manager [req-5bad1600-f517-435f-8baf-2d741d5c3125 req-14955e54-12d4-4d80-b538-a823854bf44b service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-1fcb1e63-1b0b-4c45-9fda-200b1fd719c5 for instance with vm_state building and task_state spawning.
Nov 28 17:11:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.compute.manager [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:11:15 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Creating image(s)
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Did not create local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Ensure instance console log exists: /opt/stack/data/nova/instances/5c199841-2ce5-4f72-a3f1-6d6d0c746505/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Start _get_guest_xml network_info=[{"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'b9379923-57ec-4876-a213-e79a4abf6bec', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbXCyWfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5c199841-2ce5-4f72-a3f1-6d6d0c746505', 'attached_at': '', 'detached_at': '', 'volume_id': '705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3', 'serial': '705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:11:15 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:11:15 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbXCyWfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:11:15 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:11:15 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:11:15 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:11:15 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Instance spawned successfully.
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[82467c8f-28be-4590-bd1e-d07f7057f015]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:11:15 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef204ef-6ca6-43d1-8842-14e8b8115c3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3] added
Nov 28 17:11:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6506557-340f-4088-b155-b172d489a1b6]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fb8893-8496-4353-a3e4-d2c2a3932048]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbXCyWfJ {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbXCyWfJ" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[360c5fd7-202e-47df-97c2-c44aee521575]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BbXCyWfJ'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:15 user nova-compute[75246]: INFO nova.compute.manager [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Took 11.83 seconds to spawn the instance on the hypervisor.
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be46984-3f62-4d86-945a-5da0a917b598]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13e6cba-0a9b-44b5-a058-76b15580c9ca]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:15 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:11:15 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:11:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:15 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:11:15 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:11:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:15 user nova-compute[75246]: INFO nova.compute.manager [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Took 40.96 seconds to build instance.
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c94642e6-7fdb-4e21-96cc-68690e2b8651 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "8ae64996-670b-4179-9280-27fa7141a8d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.081s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7006094c-1512-4369-9135-e86b0adc4e99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3, portal: 172.16.0.220,3260]
Nov 28 17:11:15 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3, portal: 172.16.0.220,3260] successful.
Nov 28 17:11:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4168dc37-1ee6-4df9-9f51-49db28a8e418]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e3e8fd-6a6c-4fe2-9ab5-d33213649819]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:15 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:11:15 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:11:15 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:11:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:15 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:11:15 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:11:15 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:11:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[23131ab8-fb44-44af-97cc-6ff8caa59d73]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbXCyWfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-d3252716-d7fa-4794-9640-3f6c3b3d176c req-24a709b5-f7da-4bd7-98b6-cbc17151097e service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-1fcb1e63-1b0b-4c45-9fda-200b1fd719c5 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d3252716-d7fa-4794-9640-3f6c3b3d176c req-24a709b5-f7da-4bd7-98b6-cbc17151097e service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d3252716-d7fa-4794-9640-3f6c3b3d176c req-24a709b5-f7da-4bd7-98b6-cbc17151097e service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d3252716-d7fa-4794-9640-3f6c3b3d176c req-24a709b5-f7da-4bd7-98b6-cbc17151097e service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-d3252716-d7fa-4794-9640-3f6c3b3d176c req-24a709b5-f7da-4bd7-98b6-cbc17151097e service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-1fcb1e63-1b0b-4c45-9fda-200b1fd719c5 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:15 user nova-compute[75246]: WARNING nova.compute.manager [req-d3252716-d7fa-4794-9640-3f6c3b3d176c req-24a709b5-f7da-4bd7-98b6-cbc17151097e service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-1fcb1e63-1b0b-4c45-9fda-200b1fd719c5 for instance with vm_state active and task_state None.
Nov 28 17:11:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23730616335303761', 'path': '/dev/sde'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730616335303761', 'path': '/dev/sde'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:11:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-62421813',display_name='tempest-ServerActionsTestOtherA-server-62421813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-62421813',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5QoCu8z1J19YdF2KrIxtAcllUa+54ECbo+7UcXNC+vRRLTiAkI9KGg17d3KrbHvU7U2QxVzma0Ilz+ryH1d5iWfmR7mKkbwqDpkhmRExCuSVuBHZfoiX/4Pew1wkkhqw==',key_name='tempest-keypair-745476775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be06eee4e74a41b799f1df75ea55b955',ramdisk_id='',reservation_id='r-8k4f0rv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1554281978',owner_user_name='tempest-ServerActionsTestOtherA-1554281978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:11:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39d2eb0837eb4c729fe9ca2964cbe789',uuid=5c199841-2ce5-4f72-a3f1-6d6d0c746505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converting VIF {"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=3f3c2850-37c8-4c04-a0ae-588a394ac8d9,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3c2850-37') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG nova.objects.instance [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c199841-2ce5-4f72-a3f1-6d6d0c746505 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:11:16 user nova-compute[75246]:   <uuid>5c199841-2ce5-4f72-a3f1-6d6d0c746505</uuid>
Nov 28 17:11:16 user nova-compute[75246]:   <name>instance-0000001b</name>
Nov 28 17:11:16 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:11:16 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:11:16 user nova-compute[75246]:   <metadata>
Nov 28 17:11:16 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:11:16 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:11:16 user nova-compute[75246]:       <nova:name>tempest-ServerActionsTestOtherA-server-62421813</nova:name>
Nov 28 17:11:16 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:11:15</nova:creationTime>
Nov 28 17:11:16 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:11:16 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:11:16 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:11:16 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:11:16 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:11:16 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:11:16 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:11:16 user nova-compute[75246]:       <nova:owner>
Nov 28 17:11:16 user nova-compute[75246]:         <nova:user uuid="39d2eb0837eb4c729fe9ca2964cbe789">tempest-ServerActionsTestOtherA-1554281978-project-member</nova:user>
Nov 28 17:11:16 user nova-compute[75246]:         <nova:project uuid="be06eee4e74a41b799f1df75ea55b955">tempest-ServerActionsTestOtherA-1554281978</nova:project>
Nov 28 17:11:16 user nova-compute[75246]:       </nova:owner>
Nov 28 17:11:16 user nova-compute[75246]:       <nova:ports>
Nov 28 17:11:16 user nova-compute[75246]:         <nova:port uuid="3f3c2850-37c8-4c04-a0ae-588a394ac8d9">
Nov 28 17:11:16 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 17:11:16 user nova-compute[75246]:         </nova:port>
Nov 28 17:11:16 user nova-compute[75246]:       </nova:ports>
Nov 28 17:11:16 user nova-compute[75246]:     </nova:instance>
Nov 28 17:11:16 user nova-compute[75246]:   </metadata>
Nov 28 17:11:16 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:11:16 user nova-compute[75246]:     <system>
Nov 28 17:11:16 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:11:16 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:11:16 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:11:16 user nova-compute[75246]:       <entry name="serial">5c199841-2ce5-4f72-a3f1-6d6d0c746505</entry>
Nov 28 17:11:16 user nova-compute[75246]:       <entry name="uuid">5c199841-2ce5-4f72-a3f1-6d6d0c746505</entry>
Nov 28 17:11:16 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:11:16 user nova-compute[75246]:     </system>
Nov 28 17:11:16 user nova-compute[75246]:   </sysinfo>
Nov 28 17:11:16 user nova-compute[75246]:   <os>
Nov 28 17:11:16 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:11:16 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:11:16 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:11:16 user nova-compute[75246]:   </os>
Nov 28 17:11:16 user nova-compute[75246]:   <features>
Nov 28 17:11:16 user nova-compute[75246]:     <acpi/>
Nov 28 17:11:16 user nova-compute[75246]:     <apic/>
Nov 28 17:11:16 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:11:16 user nova-compute[75246]:   </features>
Nov 28 17:11:16 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:11:16 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:11:16 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:11:16 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:11:16 user nova-compute[75246]:   </clock>
Nov 28 17:11:16 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:11:16 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:11:16 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:11:16 user nova-compute[75246]:   </cpu>
Nov 28 17:11:16 user nova-compute[75246]:   <devices>
Nov 28 17:11:16 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:11:16 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:11:16 user nova-compute[75246]:       <source dev="/dev/sde"/>
Nov 28 17:11:16 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:11:16 user nova-compute[75246]:       <serial>705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3</serial>
Nov 28 17:11:16 user nova-compute[75246]:     </disk>
Nov 28 17:11:16 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:11:16 user nova-compute[75246]:       <mac address="fa:16:3e:a0:bb:83"/>
Nov 28 17:11:16 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:11:16 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:11:16 user nova-compute[75246]:       <target dev="tap3f3c2850-37"/>
Nov 28 17:11:16 user nova-compute[75246]:     </interface>
Nov 28 17:11:16 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:11:16 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/5c199841-2ce5-4f72-a3f1-6d6d0c746505/console.log" append="off"/>
Nov 28 17:11:16 user nova-compute[75246]:     </serial>
Nov 28 17:11:16 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:11:16 user nova-compute[75246]:     <video>
Nov 28 17:11:16 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:11:16 user nova-compute[75246]:     </video>
Nov 28 17:11:16 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:11:16 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:11:16 user nova-compute[75246]:     </rng>
Nov 28 17:11:16 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:11:16 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:11:16 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:11:16 user nova-compute[75246]:     </memballoon>
Nov 28 17:11:16 user nova-compute[75246]:   </devices>
Nov 28 17:11:16 user nova-compute[75246]: </domain>
Nov 28 17:11:16 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:11:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-62421813',display_name='tempest-ServerActionsTestOtherA-server-62421813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-62421813',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5QoCu8z1J19YdF2KrIxtAcllUa+54ECbo+7UcXNC+vRRLTiAkI9KGg17d3KrbHvU7U2QxVzma0Ilz+ryH1d5iWfmR7mKkbwqDpkhmRExCuSVuBHZfoiX/4Pew1wkkhqw==',key_name='tempest-keypair-745476775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be06eee4e74a41b799f1df75ea55b955',ramdisk_id='',reservation_id='r-8k4f0rv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1554281978',owner_user_name='tempest-ServerActionsTestOtherA-1554281978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:11:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39d2eb0837eb4c729fe9ca2964cbe789',uuid=5c199841-2ce5-4f72-a3f1-6d6d0c746505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converting VIF {"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=3f3c2850-37c8-4c04-a0ae-588a394ac8d9,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3c2850-37') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG os_vif [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=3f3c2850-37c8-4c04-a0ae-588a394ac8d9,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3c2850-37') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41d066ed-fc30-57ac-81c0-196056f08681', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f3c2850-37, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f3c2850-37, col_values=(('qos', UUID('9d000027-88b4-40eb-9f8f-ae9b93707dd4')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f3c2850-37, col_values=(('external_ids', {'iface-id': '3f3c2850-37c8-4c04-a0ae-588a394ac8d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:bb:83', 'vm-uuid': '5c199841-2ce5-4f72-a3f1-6d6d0c746505'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:16 user nova-compute[75246]: INFO os_vif [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=3f3c2850-37c8-4c04-a0ae-588a394ac8d9,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3c2850-37')
Nov 28 17:11:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] No VIF found with MAC fa:16:3e:a0:bb:83, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-1b8d3d32-3e47-4260-b06a-714ed5d55558 req-01027e77-1599-40f4-9aba-a46b0a384287 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-7895e4b8-0496-479c-8ccd-1de0613b1c19 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1b8d3d32-3e47-4260-b06a-714ed5d55558 req-01027e77-1599-40f4-9aba-a46b0a384287 service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1b8d3d32-3e47-4260-b06a-714ed5d55558 req-01027e77-1599-40f4-9aba-a46b0a384287 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1b8d3d32-3e47-4260-b06a-714ed5d55558 req-01027e77-1599-40f4-9aba-a46b0a384287 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-1b8d3d32-3e47-4260-b06a-714ed5d55558 req-01027e77-1599-40f4-9aba-a46b0a384287 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-7895e4b8-0496-479c-8ccd-1de0613b1c19 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:16 user nova-compute[75246]: WARNING nova.compute.manager [req-1b8d3d32-3e47-4260-b06a-714ed5d55558 req-01027e77-1599-40f4-9aba-a46b0a384287 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-7895e4b8-0496-479c-8ccd-1de0613b1c19 for instance with vm_state active and task_state None.
Nov 28 17:11:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-4f36ac2d-11d1-402c-9477-05679c2c06b4 req-b41c5a82-12c3-4240-abbe-8e59ddfc09e6 service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received event network-vif-plugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4f36ac2d-11d1-402c-9477-05679c2c06b4 req-b41c5a82-12c3-4240-abbe-8e59ddfc09e6 service nova] Acquiring lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4f36ac2d-11d1-402c-9477-05679c2c06b4 req-b41c5a82-12c3-4240-abbe-8e59ddfc09e6 service nova] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4f36ac2d-11d1-402c-9477-05679c2c06b4 req-b41c5a82-12c3-4240-abbe-8e59ddfc09e6 service nova] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-4f36ac2d-11d1-402c-9477-05679c2c06b4 req-b41c5a82-12c3-4240-abbe-8e59ddfc09e6 service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] No waiting events found dispatching network-vif-plugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:18 user nova-compute[75246]: WARNING nova.compute.manager [req-4f36ac2d-11d1-402c-9477-05679c2c06b4 req-b41c5a82-12c3-4240-abbe-8e59ddfc09e6 service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received unexpected event network-vif-plugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 for instance with vm_state building and task_state spawning.
Nov 28 17:11:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-c13c0964-1357-4a00-a2e9-6b5b92e5e68d req-0269e38f-8951-402c-99f6-50d47f0dedd2 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-7895e4b8-0496-479c-8ccd-1de0613b1c19 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c13c0964-1357-4a00-a2e9-6b5b92e5e68d req-0269e38f-8951-402c-99f6-50d47f0dedd2 service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c13c0964-1357-4a00-a2e9-6b5b92e5e68d req-0269e38f-8951-402c-99f6-50d47f0dedd2 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c13c0964-1357-4a00-a2e9-6b5b92e5e68d req-0269e38f-8951-402c-99f6-50d47f0dedd2 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-c13c0964-1357-4a00-a2e9-6b5b92e5e68d req-0269e38f-8951-402c-99f6-50d47f0dedd2 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-7895e4b8-0496-479c-8ccd-1de0613b1c19 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:18 user nova-compute[75246]: WARNING nova.compute.manager [req-c13c0964-1357-4a00-a2e9-6b5b92e5e68d req-0269e38f-8951-402c-99f6-50d47f0dedd2 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-7895e4b8-0496-479c-8ccd-1de0613b1c19 for instance with vm_state active and task_state None.
Nov 28 17:11:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-c13c0964-1357-4a00-a2e9-6b5b92e5e68d req-0269e38f-8951-402c-99f6-50d47f0dedd2 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-f31d8039-9a73-4288-813c-fb13de3d2a12 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c13c0964-1357-4a00-a2e9-6b5b92e5e68d req-0269e38f-8951-402c-99f6-50d47f0dedd2 service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c13c0964-1357-4a00-a2e9-6b5b92e5e68d req-0269e38f-8951-402c-99f6-50d47f0dedd2 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c13c0964-1357-4a00-a2e9-6b5b92e5e68d req-0269e38f-8951-402c-99f6-50d47f0dedd2 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-c13c0964-1357-4a00-a2e9-6b5b92e5e68d req-0269e38f-8951-402c-99f6-50d47f0dedd2 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-f31d8039-9a73-4288-813c-fb13de3d2a12 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:18 user nova-compute[75246]: WARNING nova.compute.manager [req-c13c0964-1357-4a00-a2e9-6b5b92e5e68d req-0269e38f-8951-402c-99f6-50d47f0dedd2 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-f31d8039-9a73-4288-813c-fb13de3d2a12 for instance with vm_state active and task_state None.
Nov 28 17:11:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-c13c0964-1357-4a00-a2e9-6b5b92e5e68d req-0269e38f-8951-402c-99f6-50d47f0dedd2 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-f31d8039-9a73-4288-813c-fb13de3d2a12 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c13c0964-1357-4a00-a2e9-6b5b92e5e68d req-0269e38f-8951-402c-99f6-50d47f0dedd2 service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c13c0964-1357-4a00-a2e9-6b5b92e5e68d req-0269e38f-8951-402c-99f6-50d47f0dedd2 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c13c0964-1357-4a00-a2e9-6b5b92e5e68d req-0269e38f-8951-402c-99f6-50d47f0dedd2 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-c13c0964-1357-4a00-a2e9-6b5b92e5e68d req-0269e38f-8951-402c-99f6-50d47f0dedd2 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-f31d8039-9a73-4288-813c-fb13de3d2a12 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:18 user nova-compute[75246]: WARNING nova.compute.manager [req-c13c0964-1357-4a00-a2e9-6b5b92e5e68d req-0269e38f-8951-402c-99f6-50d47f0dedd2 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-f31d8039-9a73-4288-813c-fb13de3d2a12 for instance with vm_state active and task_state None.
Nov 28 17:11:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-56b74041-3573-4ee7-9a51-91148b04402f req-fb401fa0-da14-4999-a908-e838b270647f service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received event network-vif-plugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-56b74041-3573-4ee7-9a51-91148b04402f req-fb401fa0-da14-4999-a908-e838b270647f service nova] Acquiring lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-56b74041-3573-4ee7-9a51-91148b04402f req-fb401fa0-da14-4999-a908-e838b270647f service nova] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-56b74041-3573-4ee7-9a51-91148b04402f req-fb401fa0-da14-4999-a908-e838b270647f service nova] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-56b74041-3573-4ee7-9a51-91148b04402f req-fb401fa0-da14-4999-a908-e838b270647f service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] No waiting events found dispatching network-vif-plugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:20 user nova-compute[75246]: WARNING nova.compute.manager [req-56b74041-3573-4ee7-9a51-91148b04402f req-fb401fa0-da14-4999-a908-e838b270647f service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received unexpected event network-vif-plugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 for instance with vm_state building and task_state spawning.
Nov 28 17:11:20 user nova-compute[75246]: DEBUG nova.compute.manager [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:11:20 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:11:20 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Instance spawned successfully.
Nov 28 17:11:20 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:11:20 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:20 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:20 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:20 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:20 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:20 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:20 user nova-compute[75246]: INFO nova.compute.manager [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 28 17:11:20 user nova-compute[75246]: DEBUG nova.compute.manager [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:11:20 user nova-compute[75246]: INFO nova.compute.manager [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Took 15.03 seconds to build instance.
Nov 28 17:11:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-05fe6b59-4e46-4aa8-8145-59d3c74734d2 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.168s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-7372e85d-65f5-4816-aa3a-e603ce963aae req-a6ff19d6-744f-44d7-be7b-fa79be22bee9 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Received event network-changed-26eaa437-c34e-4b6f-b907-e3083bc7b10a {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-7372e85d-65f5-4816-aa3a-e603ce963aae req-a6ff19d6-744f-44d7-be7b-fa79be22bee9 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Refreshing instance network info cache due to event network-changed-26eaa437-c34e-4b6f-b907-e3083bc7b10a. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:11:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7372e85d-65f5-4816-aa3a-e603ce963aae req-a6ff19d6-744f-44d7-be7b-fa79be22bee9 service nova] Acquiring lock "refresh_cache-aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:11:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7372e85d-65f5-4816-aa3a-e603ce963aae req-a6ff19d6-744f-44d7-be7b-fa79be22bee9 service nova] Acquired lock "refresh_cache-aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:11:20 user nova-compute[75246]: DEBUG nova.network.neutron [req-7372e85d-65f5-4816-aa3a-e603ce963aae req-a6ff19d6-744f-44d7-be7b-fa79be22bee9 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Refreshing network info cache for port 26eaa437-c34e-4b6f-b907-e3083bc7b10a {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:11:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:21 user nova-compute[75246]: DEBUG nova.network.neutron [req-7372e85d-65f5-4816-aa3a-e603ce963aae req-a6ff19d6-744f-44d7-be7b-fa79be22bee9 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Updated VIF entry in instance network info cache for port 26eaa437-c34e-4b6f-b907-e3083bc7b10a. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:11:21 user nova-compute[75246]: DEBUG nova.network.neutron [req-7372e85d-65f5-4816-aa3a-e603ce963aae req-a6ff19d6-744f-44d7-be7b-fa79be22bee9 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Updating instance_info_cache with network_info: [{"id": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "address": "fa:16:3e:75:a4:ec", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26eaa437-c3", "ovs_interfaceid": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:11:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7372e85d-65f5-4816-aa3a-e603ce963aae req-a6ff19d6-744f-44d7-be7b-fa79be22bee9 service nova] Releasing lock "refresh_cache-aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:11:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:22 user nova-compute[75246]: DEBUG nova.objects.instance [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lazy-loading 'flavor' on Instance uuid aa9ef0b8-3519-416a-b42c-cd953c4ddc0d {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:11:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:11:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:22 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:11:22 user nova-compute[75246]: INFO nova.compute.claims [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Claim successful on node user
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:23 user nova-compute[75246]: INFO nova.compute.manager [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Attaching volume 390e628d-d2d2-4b2a-b404-813e8186a20d to /dev/vdb
Nov 28 17:11:23 user nova-compute[75246]: DEBUG os_brick.utils [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fec662-cd30-42ce-b700-8c2f88d18992]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d5d9fb-33fc-4f7b-874a-d3f691f5f2c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b782ac85-5bfb-47b3-8531-9edc3ee351bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ec761c-245a-4397-8db3-5fbfa19a5f63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:11:23 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8da0fbc-88d4-4134-8dd8-3747c260f0b2]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG os_brick.utils [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Updating existing volume attachment record: f8ac7872-5c9b-4eb3-ab3e-47a28a772a0f {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG nova.compute.manager [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG nova.compute.manager [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG nova.network.neutron [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "0d952de1-8c78-4bea-853d-21ac4f979845" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "0d952de1-8c78-4bea-853d-21ac4f979845" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:23 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:11:23 user nova-compute[75246]: INFO nova.compute.manager [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Terminating instance
Nov 28 17:11:23 user nova-compute[75246]: DEBUG nova.compute.manager [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG nova.compute.manager [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:23 user nova-compute[75246]: INFO nova.virt.block_device [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Booting with volume snapshot d4ff9ac5-e96b-478a-9287-7e0483ba1370 at /dev/vda
Nov 28 17:11:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG nova.policy [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c334f73c5bf1473aadf865c8f032c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0eebdd39c54a74be8d2e0f9842b165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:11:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG nova.compute.manager [req-cd2381b6-9930-463d-898d-69e40a900828 req-680df37b-d659-40ea-859f-c0fb214026c8 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received event network-vif-unplugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cd2381b6-9930-463d-898d-69e40a900828 req-680df37b-d659-40ea-859f-c0fb214026c8 service nova] Acquiring lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cd2381b6-9930-463d-898d-69e40a900828 req-680df37b-d659-40ea-859f-c0fb214026c8 service nova] Lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cd2381b6-9930-463d-898d-69e40a900828 req-680df37b-d659-40ea-859f-c0fb214026c8 service nova] Lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG nova.compute.manager [req-cd2381b6-9930-463d-898d-69e40a900828 req-680df37b-d659-40ea-859f-c0fb214026c8 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] No waiting events found dispatching network-vif-unplugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG nova.compute.manager [req-cd2381b6-9930-463d-898d-69e40a900828 req-680df37b-d659-40ea-859f-c0fb214026c8 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received event network-vif-unplugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:11:24 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Instance destroyed successfully.
Nov 28 17:11:24 user nova-compute[75246]: DEBUG nova.objects.instance [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'resources' on Instance uuid 0d952de1-8c78-4bea-853d-21ac4f979845 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T17:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-278996386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-278996386',id=19,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/npncOA40T5UkpCTyoa9FE5URXN0CYEj19/p021hTQeiVdLEH7PgJXMG03aUYxg6AGun6gVIWPfrOtmZUotLJEBPXKB78yX8pcTgDSssDMf4QF1Q6mL0Cbl/SHy8/Bng==',key_name='tempest-keypair-1103265416',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd94665acd9a4448a1ad1350d71d8f72',ramdisk_id='',reservation_id='r-eelgg57i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726606277',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726606277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:09:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ed095223674edebcee82e4183c8ea0',uuid=0d952de1-8c78-4bea-853d-21ac4f979845,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converting VIF {"id": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "address": "fa:16:3e:4a:37:ae", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb7a52b-f2", "ovs_interfaceid": "ebb7a52b-f2f1-43e8-bea2-02a136b62aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:37:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebb7a52b-f2f1-43e8-bea2-02a136b62aa1,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb7a52b-f2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG os_vif [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:37:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebb7a52b-f2f1-43e8-bea2-02a136b62aa1,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb7a52b-f2') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebb7a52b-f2, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8eab0976-89f7-44a1-9ad5-66a2a1cdf41e) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:24 user nova-compute[75246]: INFO os_vif [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:37:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebb7a52b-f2f1-43e8-bea2-02a136b62aa1,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb7a52b-f2')
Nov 28 17:11:24 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Deleting instance files /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845_del
Nov 28 17:11:24 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Deletion of /opt/stack/data/nova/instances/0d952de1-8c78-4bea-853d-21ac4f979845_del complete
Nov 28 17:11:24 user nova-compute[75246]: INFO nova.compute.manager [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 28 17:11:24 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:11:24 user nova-compute[75246]: DEBUG nova.network.neutron [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Successfully created port: 64b4a9b1-d5e7-4a2b-966e-65fc3ecad898 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:11:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-e44d2596-30ff-436d-aaf8-aea2c95e910b req-c276e348-324c-4d99-88fe-027d2c90e04f service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received event network-vif-plugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e44d2596-30ff-436d-aaf8-aea2c95e910b req-c276e348-324c-4d99-88fe-027d2c90e04f service nova] Acquiring lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e44d2596-30ff-436d-aaf8-aea2c95e910b req-c276e348-324c-4d99-88fe-027d2c90e04f service nova] Lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e44d2596-30ff-436d-aaf8-aea2c95e910b req-c276e348-324c-4d99-88fe-027d2c90e04f service nova] Lock "0d952de1-8c78-4bea-853d-21ac4f979845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-e44d2596-30ff-436d-aaf8-aea2c95e910b req-c276e348-324c-4d99-88fe-027d2c90e04f service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] No waiting events found dispatching network-vif-plugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:26 user nova-compute[75246]: WARNING nova.compute.manager [req-e44d2596-30ff-436d-aaf8-aea2c95e910b req-c276e348-324c-4d99-88fe-027d2c90e04f service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received unexpected event network-vif-plugged-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 for instance with vm_state active and task_state deleting.
Nov 28 17:11:26 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:11:26 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Took 1.87 seconds to deallocate network for instance.
Nov 28 17:11:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-2299df50-510b-4080-bbc5-53560243cf89 req-875ca4ee-1e3e-4136-9b4a-83bda14dcf98 service nova] [instance: 0d952de1-8c78-4bea-853d-21ac4f979845] Received event network-vif-deleted-ebb7a52b-f2f1-43e8-bea2-02a136b62aa1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Successfully updated port: 64b4a9b1-d5e7-4a2b-966e-65fc3ecad898 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:11:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "refresh_cache-c9abccd6-b64d-4bbf-bdaf-3e3945b04413" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:11:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquired lock "refresh_cache-c9abccd6-b64d-4bbf-bdaf-3e3945b04413" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:11:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:11:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:11:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Updating instance_info_cache with network_info: [{"id": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "address": "fa:16:3e:4c:23:9f", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64b4a9b1-d5", "ovs_interfaceid": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:11:26 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:11:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Releasing lock "refresh_cache-c9abccd6-b64d-4bbf-bdaf-3e3945b04413" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:11:26 user nova-compute[75246]: DEBUG nova.compute.manager [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Instance network_info: |[{"id": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "address": "fa:16:3e:4c:23:9f", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64b4a9b1-d5", "ovs_interfaceid": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:11:26 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:11:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:27 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Deleted allocations for instance 0d952de1-8c78-4bea-853d-21ac4f979845
Nov 28 17:11:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-930de139-5095-49c4-95f4-b4c88e152bb9 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "0d952de1-8c78-4bea-853d-21ac4f979845" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.612s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:28 user nova-compute[75246]: DEBUG nova.compute.manager [req-4e16cbaa-8250-441e-885c-19933e6947f3 req-8b90a8d5-7fbd-451b-a6b9-8f371b85a1f1 service nova] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Received event network-changed-64b4a9b1-d5e7-4a2b-966e-65fc3ecad898 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:28 user nova-compute[75246]: DEBUG nova.compute.manager [req-4e16cbaa-8250-441e-885c-19933e6947f3 req-8b90a8d5-7fbd-451b-a6b9-8f371b85a1f1 service nova] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Refreshing instance network info cache due to event network-changed-64b4a9b1-d5e7-4a2b-966e-65fc3ecad898. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:11:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4e16cbaa-8250-441e-885c-19933e6947f3 req-8b90a8d5-7fbd-451b-a6b9-8f371b85a1f1 service nova] Acquiring lock "refresh_cache-c9abccd6-b64d-4bbf-bdaf-3e3945b04413" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:11:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4e16cbaa-8250-441e-885c-19933e6947f3 req-8b90a8d5-7fbd-451b-a6b9-8f371b85a1f1 service nova] Acquired lock "refresh_cache-c9abccd6-b64d-4bbf-bdaf-3e3945b04413" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:11:28 user nova-compute[75246]: DEBUG nova.network.neutron [req-4e16cbaa-8250-441e-885c-19933e6947f3 req-8b90a8d5-7fbd-451b-a6b9-8f371b85a1f1 service nova] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Refreshing network info cache for port 64b4a9b1-d5e7-4a2b-966e-65fc3ecad898 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG nova.network.neutron [req-4e16cbaa-8250-441e-885c-19933e6947f3 req-8b90a8d5-7fbd-451b-a6b9-8f371b85a1f1 service nova] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Updated VIF entry in instance network info cache for port 64b4a9b1-d5e7-4a2b-966e-65fc3ecad898. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG nova.network.neutron [req-4e16cbaa-8250-441e-885c-19933e6947f3 req-8b90a8d5-7fbd-451b-a6b9-8f371b85a1f1 service nova] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Updating instance_info_cache with network_info: [{"id": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "address": "fa:16:3e:4c:23:9f", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64b4a9b1-d5", "ovs_interfaceid": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4e16cbaa-8250-441e-885c-19933e6947f3 req-8b90a8d5-7fbd-451b-a6b9-8f371b85a1f1 service nova] Releasing lock "refresh_cache-c9abccd6-b64d-4bbf-bdaf-3e3945b04413" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG os_brick.utils [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[67671e2b-3d14-46ba-baf2-5b37ffbc3c8d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[23991ef3-cfbf-4052-a9d2-12af8063303b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c66e5a8-55b8-432e-a580-90af070b89ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcf68b5-96fa-43c0-b367-3e92c4fd1ae5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:11:29 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a381e2-09dc-4aee-9a70-60fdc39107eb]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG os_brick.utils [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Updating existing volume attachment record: c5a1d87d-df49-45e8-a7dd-18066b4f253a {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:11:29 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:11:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:30 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:11:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:11:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:11:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:11:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.264s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJesNDPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:11:32 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:11:32 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:11:32 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c62feb-e2b4-4bb9-a4c3-5bb02bf70aa9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:11:32 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6a73b3-92da-4558-b54c-5c25ee675837]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d] added
Nov 28 17:11:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fc10c7-b094-4356-9520-c249944ddc8e]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9da3c2-0219-4ca8-806c-d381bc47dfe1]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJesNDPV {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJesNDPV" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7594bf5e-aecc-4961-91df-54db466d9e3f]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yJesNDPV'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edb377e-67c2-4239-8e57-b18b93e7c29a]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[622a4edf-4f91-42d4-a2be-cd4e6ecd8ef2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:32 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:11:32 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:11:32 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:11:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:32 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:11:32 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:11:32 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:11:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed39f1e1-3fa0-41b5-96ef-9d4ccd5184ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d, portal: 172.16.0.220,3260]
Nov 28 17:11:32 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d, portal: 172.16.0.220,3260] successful.
Nov 28 17:11:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da9180d-cbf1-40fb-9ac4-42fb9c6e0e9e]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2341cc75-0b3c-4643-a2a5-17ded056cd2f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:32 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:11:32 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:11:32 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:11:32 user nova-compute[75246]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:11:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:32 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:11:32 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:11:32 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:11:32 user nova-compute[75246]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:11:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[988c7c85-f032-4945-a205-3b8f76194527]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJesNDPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:11:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.959s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:11:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] <== connect_volume: return (1961ms) {'type': 'block', 'scsi_wwn': '23466333830383436', 'path': '/dev/sdf'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:11:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466333830383436', 'path': '/dev/sdf'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:11:33 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:11:33 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:11:33 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=7729MB free_disk=25.442588806152344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:11:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:33 user nova-compute[75246]: DEBUG nova.objects.instance [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lazy-loading 'flavor' on Instance uuid aa9ef0b8-3519-416a-b42c-cd953c4ddc0d {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:11:34 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:11:34 user nova-compute[75246]:   <source dev="/dev/sdf"/>
Nov 28 17:11:34 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:11:34 user nova-compute[75246]:   <serial>390e628d-d2d2-4b2a-b404-813e8186a20d</serial>
Nov 28 17:11:34 user nova-compute[75246]: </disk>
Nov 28 17:11:34 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e1266470-c182-4c0c-a575-4c5043f54745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c94900af-f484-47bf-8627-8aa863334b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance aa9ef0b8-3519-416a-b42c-cd953c4ddc0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 36e65da9-4cc0-4d73-9e5d-e64520e08f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 8ae64996-670b-4179-9280-27fa7141a8d1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 0ed72d2a-ca9b-4b99-b422-86fa93af945c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 5c199841-2ce5-4f72-a3f1-6d6d0c746505 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c9abccd6-b64d-4bbf-bdaf-3e3945b04413 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] No VIF found with MAC fa:16:3e:75:a4:ec, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9c954a05-3ffc-4960-a46d-72d1ce20d4a3 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.582s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:35 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:11:35 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:11:35 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:11:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:35 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:11:35 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:11:35 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:11:35 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:11:35 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:11:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "bdbc9972-fa4b-4172-b540-1996af1b79fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "bdbc9972-fa4b-4172-b540-1996af1b79fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:38 user nova-compute[75246]: DEBUG nova.compute.manager [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:11:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:11:38 user nova-compute[75246]: INFO nova.compute.claims [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Claim successful on node user
Nov 28 17:11:39 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG nova.network.neutron [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:11:39 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:11:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG nova.policy [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03ae91a734974162a14d7b4c498c4b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d39dde859674409847b50613bcc608b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:11:39 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Creating image(s)
Nov 28 17:11:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdbc9972-fa4b-4172-b540-1996af1b79fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "/opt/stack/data/nova/instances/bdbc9972-fa4b-4172-b540-1996af1b79fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "/opt/stack/data/nova/instances/bdbc9972-fa4b-4172-b540-1996af1b79fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.177s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/bdbc9972-fa4b-4172-b540-1996af1b79fe/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/bdbc9972-fa4b-4172-b540-1996af1b79fe/disk 1073741824" returned: 0 in 0.064s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdbc9972-fa4b-4172-b540-1996af1b79fe/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdbc9972-fa4b-4172-b540-1996af1b79fe/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.network.neutron [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Successfully created port: ab3dd811-8f71-498f-85d6-56a5e421c06b {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdbc9972-fa4b-4172-b540-1996af1b79fe/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Cannot resize image /opt/stack/data/nova/instances/bdbc9972-fa4b-4172-b540-1996af1b79fe/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Ensure instance console log exists: /opt/stack/data/nova/instances/bdbc9972-fa4b-4172-b540-1996af1b79fe/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.compute.manager [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:11:40 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Creating image(s)
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Did not create local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Ensure instance console log exists: /opt/stack/data/nova/instances/c9abccd6-b64d-4bbf-bdaf-3e3945b04413/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Start _get_guest_xml network_info=[{"id": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "address": "fa:16:3e:4c:23:9f", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64b4a9b1-d5", "ovs_interfaceid": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'c5a1d87d-df49-45e8-a7dd-18066b4f253a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZKXsqxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c9abccd6-b64d-4bbf-bdaf-3e3945b04413', 'attached_at': '', 'detached_at': '', 'volume_id': '8989f807-4ecf-49b5-ab2f-ca0a32f283bf', 'serial': '8989f807-4ecf-49b5-ab2f-ca0a32f283bf'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:11:40 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:11:40 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZKXsqxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:11:40 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:11:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:11:40 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:11:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:11:40 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:11:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d476ba-9fc9-4df0-b484-d65e24d257a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:11:40 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5837eae-65db-494d-baa3-230adeee2bb0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf] added
Nov 28 17:11:40 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eddafd-8745-47b6-a81a-d4cf9448af27]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[635abdae-f55a-4467-8bd1-586b9f196c75]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oZKXsqxi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oZKXsqxi" returned: 0 in 0.030s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd928c7-591a-4d1a-9c55-f897a74ab0d0]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oZKXsqxi'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e915d535-6282-4912-aafe-a102c6ccd556]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd6146d-ba31-4f9f-bd3b-c22c54ca70d6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:41 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:11:41 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:11:41 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:11:41 user nova-compute[75246]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:11:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:41 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:11:41 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:11:41 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:11:41 user nova-compute[75246]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:11:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.network.neutron [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Successfully updated port: ab3dd811-8f71-498f-85d6-56a5e421c06b {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "refresh_cache-bdbc9972-fa4b-4172-b540-1996af1b79fe" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquired lock "refresh_cache-bdbc9972-fa4b-4172-b540-1996af1b79fe" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.network.neutron [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.compute.manager [req-cc08cd39-92e9-487a-955a-348b2f062efd req-342ac398-fa60-4905-af3d-737e30284165 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Received event network-changed-ab3dd811-8f71-498f-85d6-56a5e421c06b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.compute.manager [req-cc08cd39-92e9-487a-955a-348b2f062efd req-342ac398-fa60-4905-af3d-737e30284165 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Refreshing instance network info cache due to event network-changed-ab3dd811-8f71-498f-85d6-56a5e421c06b. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cc08cd39-92e9-487a-955a-348b2f062efd req-342ac398-fa60-4905-af3d-737e30284165 service nova] Acquiring lock "refresh_cache-bdbc9972-fa4b-4172-b540-1996af1b79fe" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7da3c04-e12e-4ea2-b216-2b5a62f94123]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf, portal: 172.16.0.220,3260]
Nov 28 17:11:41 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf, portal: 172.16.0.220,3260] successful.
Nov 28 17:11:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5abebe-f20f-4e5a-a735-cb87448a0c87]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.network.neutron [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2582b24d-3357-47df-8882-806252a326ca]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:41 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:11:41 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:11:41 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:11:41 user nova-compute[75246]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:11:41 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:11:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:11:41 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:11:41 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:11:41 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:11:41 user nova-compute[75246]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:11:41 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:11:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ae95ed-5d84-46f2-9765-9a07f6208196]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZKXsqxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.network.neutron [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Updating instance_info_cache with network_info: [{"id": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "address": "fa:16:3e:59:f5:33", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3dd811-8f", "ovs_interfaceid": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Releasing lock "refresh_cache-bdbc9972-fa4b-4172-b540-1996af1b79fe" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.compute.manager [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Instance network_info: |[{"id": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "address": "fa:16:3e:59:f5:33", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3dd811-8f", "ovs_interfaceid": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cc08cd39-92e9-487a-955a-348b2f062efd req-342ac398-fa60-4905-af3d-737e30284165 service nova] Acquired lock "refresh_cache-bdbc9972-fa4b-4172-b540-1996af1b79fe" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.network.neutron [req-cc08cd39-92e9-487a-955a-348b2f062efd req-342ac398-fa60-4905-af3d-737e30284165 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Refreshing network info cache for port ab3dd811-8f71-498f-85d6-56a5e421c06b {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Start _get_guest_xml network_info=[{"id": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "address": "fa:16:3e:59:f5:33", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3dd811-8f", "ovs_interfaceid": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:11:41 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:11:41 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-792904770',display_name='tempest-AttachVolumeNegativeTest-server-792904770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-792904770',id=29,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/JtoIHsBVXIkBPKzEvk81USdTum2tyl1Qnes3ZYE0R3SqPpbLleqWcW3BQ9rDWFErUVCmwAqeiUN9pEdQ4p0abMIqEH0F6tErT6oypoxh0FOUpQzveDL5SOw293Pt6KA==',key_name='tempest-keypair-1402857658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d39dde859674409847b50613bcc608b',ramdisk_id='',reservation_id='r-yua59xnx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-524813585',owner_user_name='tempest-AttachVolumeNegativeTest-524813585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ae91a734974162a14d7b4c498c4b8d',uuid=bdbc9972-fa4b-4172-b540-1996af1b79fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "address": "fa:16:3e:59:f5:33", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3dd811-8f", "ovs_interfaceid": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converting VIF {"id": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "address": "fa:16:3e:59:f5:33", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3dd811-8f", "ovs_interfaceid": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:f5:33,bridge_name='br-int',has_traffic_filtering=True,id=ab3dd811-8f71-498f-85d6-56a5e421c06b,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3dd811-8f') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.objects.instance [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lazy-loading 'pci_devices' on Instance uuid bdbc9972-fa4b-4172-b540-1996af1b79fe {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:11:41 user nova-compute[75246]:   <uuid>bdbc9972-fa4b-4172-b540-1996af1b79fe</uuid>
Nov 28 17:11:41 user nova-compute[75246]:   <name>instance-0000001d</name>
Nov 28 17:11:41 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:11:41 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:11:41 user nova-compute[75246]:   <metadata>
Nov 28 17:11:41 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:11:41 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:11:41 user nova-compute[75246]:       <nova:name>tempest-AttachVolumeNegativeTest-server-792904770</nova:name>
Nov 28 17:11:41 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:11:41</nova:creationTime>
Nov 28 17:11:41 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:11:41 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:11:41 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:11:41 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:11:41 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:11:41 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:11:41 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:11:41 user nova-compute[75246]:       <nova:owner>
Nov 28 17:11:41 user nova-compute[75246]:         <nova:user uuid="03ae91a734974162a14d7b4c498c4b8d">tempest-AttachVolumeNegativeTest-524813585-project-member</nova:user>
Nov 28 17:11:41 user nova-compute[75246]:         <nova:project uuid="9d39dde859674409847b50613bcc608b">tempest-AttachVolumeNegativeTest-524813585</nova:project>
Nov 28 17:11:41 user nova-compute[75246]:       </nova:owner>
Nov 28 17:11:41 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:11:41 user nova-compute[75246]:       <nova:ports>
Nov 28 17:11:41 user nova-compute[75246]:         <nova:port uuid="ab3dd811-8f71-498f-85d6-56a5e421c06b">
Nov 28 17:11:41 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 17:11:41 user nova-compute[75246]:         </nova:port>
Nov 28 17:11:41 user nova-compute[75246]:       </nova:ports>
Nov 28 17:11:41 user nova-compute[75246]:     </nova:instance>
Nov 28 17:11:41 user nova-compute[75246]:   </metadata>
Nov 28 17:11:41 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:11:41 user nova-compute[75246]:     <system>
Nov 28 17:11:41 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:11:41 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:11:41 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:11:41 user nova-compute[75246]:       <entry name="serial">bdbc9972-fa4b-4172-b540-1996af1b79fe</entry>
Nov 28 17:11:41 user nova-compute[75246]:       <entry name="uuid">bdbc9972-fa4b-4172-b540-1996af1b79fe</entry>
Nov 28 17:11:41 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:11:41 user nova-compute[75246]:     </system>
Nov 28 17:11:41 user nova-compute[75246]:   </sysinfo>
Nov 28 17:11:41 user nova-compute[75246]:   <os>
Nov 28 17:11:41 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:11:41 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:11:41 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:11:41 user nova-compute[75246]:   </os>
Nov 28 17:11:41 user nova-compute[75246]:   <features>
Nov 28 17:11:41 user nova-compute[75246]:     <acpi/>
Nov 28 17:11:41 user nova-compute[75246]:     <apic/>
Nov 28 17:11:41 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:11:41 user nova-compute[75246]:   </features>
Nov 28 17:11:41 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:11:41 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:11:41 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:11:41 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:11:41 user nova-compute[75246]:   </clock>
Nov 28 17:11:41 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:11:41 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:11:41 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:11:41 user nova-compute[75246]:   </cpu>
Nov 28 17:11:41 user nova-compute[75246]:   <devices>
Nov 28 17:11:41 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:11:41 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:11:41 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/bdbc9972-fa4b-4172-b540-1996af1b79fe/disk"/>
Nov 28 17:11:41 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:11:41 user nova-compute[75246]:     </disk>
Nov 28 17:11:41 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:11:41 user nova-compute[75246]:       <mac address="fa:16:3e:59:f5:33"/>
Nov 28 17:11:41 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:11:41 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:11:41 user nova-compute[75246]:       <target dev="tapab3dd811-8f"/>
Nov 28 17:11:41 user nova-compute[75246]:     </interface>
Nov 28 17:11:41 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:11:41 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/bdbc9972-fa4b-4172-b540-1996af1b79fe/console.log" append="off"/>
Nov 28 17:11:41 user nova-compute[75246]:     </serial>
Nov 28 17:11:41 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:11:41 user nova-compute[75246]:     <video>
Nov 28 17:11:41 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:11:41 user nova-compute[75246]:     </video>
Nov 28 17:11:41 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:11:41 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:11:41 user nova-compute[75246]:     </rng>
Nov 28 17:11:41 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:11:41 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:11:41 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:11:41 user nova-compute[75246]:     </memballoon>
Nov 28 17:11:41 user nova-compute[75246]:   </devices>
Nov 28 17:11:41 user nova-compute[75246]: </domain>
Nov 28 17:11:41 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-792904770',display_name='tempest-AttachVolumeNegativeTest-server-792904770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-792904770',id=29,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/JtoIHsBVXIkBPKzEvk81USdTum2tyl1Qnes3ZYE0R3SqPpbLleqWcW3BQ9rDWFErUVCmwAqeiUN9pEdQ4p0abMIqEH0F6tErT6oypoxh0FOUpQzveDL5SOw293Pt6KA==',key_name='tempest-keypair-1402857658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d39dde859674409847b50613bcc608b',ramdisk_id='',reservation_id='r-yua59xnx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-524813585',owner_user_name='tempest-AttachVolumeNegativeTest-524813585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ae91a734974162a14d7b4c498c4b8d',uuid=bdbc9972-fa4b-4172-b540-1996af1b79fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "address": "fa:16:3e:59:f5:33", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3dd811-8f", "ovs_interfaceid": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converting VIF {"id": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "address": "fa:16:3e:59:f5:33", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3dd811-8f", "ovs_interfaceid": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:f5:33,bridge_name='br-int',has_traffic_filtering=True,id=ab3dd811-8f71-498f-85d6-56a5e421c06b,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3dd811-8f') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG os_vif [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:f5:33,bridge_name='br-int',has_traffic_filtering=True,id=ab3dd811-8f71-498f-85d6-56a5e421c06b,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3dd811-8f') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9ecce4b-01ae-55b1-ae06-1502c725268b', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab3dd811-8f, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab3dd811-8f, col_values=(('qos', UUID('a6b40286-3d8b-43f4-9a2d-a57fad466a92')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab3dd811-8f, col_values=(('external_ids', {'iface-id': 'ab3dd811-8f71-498f-85d6-56a5e421c06b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:f5:33', 'vm-uuid': 'bdbc9972-fa4b-4172-b540-1996af1b79fe'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:41 user nova-compute[75246]: INFO os_vif [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:f5:33,bridge_name='br-int',has_traffic_filtering=True,id=ab3dd811-8f71-498f-85d6-56a5e421c06b,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3dd811-8f')
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] No VIF found with MAC fa:16:3e:59:f5:33, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.network.neutron [req-cc08cd39-92e9-487a-955a-348b2f062efd req-342ac398-fa60-4905-af3d-737e30284165 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Updated VIF entry in instance network info cache for port ab3dd811-8f71-498f-85d6-56a5e421c06b. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG nova.network.neutron [req-cc08cd39-92e9-487a-955a-348b2f062efd req-342ac398-fa60-4905-af3d-737e30284165 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Updating instance_info_cache with network_info: [{"id": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "address": "fa:16:3e:59:f5:33", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3dd811-8f", "ovs_interfaceid": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:11:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cc08cd39-92e9-487a-955a-348b2f062efd req-342ac398-fa60-4905-af3d-737e30284165 service nova] Releasing lock "refresh_cache-bdbc9972-fa4b-4172-b540-1996af1b79fe" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23138613339643839', 'path': '/dev/sdg'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138613339643839', 'path': '/dev/sdg'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1125403998',display_name='tempest-TestVolumeBootPattern-server-1125403998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1125403998',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe0eebdd39c54a74be8d2e0f9842b165',ramdisk_id='',reservation_id='r-m6oxezey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-389869337',owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:11:24Z,user_data=None,user_id='c334f73c5bf1473aadf865c8f032c0cb',uuid=c9abccd6-b64d-4bbf-bdaf-3e3945b04413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "address": "fa:16:3e:4c:23:9f", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64b4a9b1-d5", "ovs_interfaceid": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converting VIF {"id": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "address": "fa:16:3e:4c:23:9f", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64b4a9b1-d5", "ovs_interfaceid": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:23:9f,bridge_name='br-int',has_traffic_filtering=True,id=64b4a9b1-d5e7-4a2b-966e-65fc3ecad898,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64b4a9b1-d5') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG nova.objects.instance [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lazy-loading 'pci_devices' on Instance uuid c9abccd6-b64d-4bbf-bdaf-3e3945b04413 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:11:42 user nova-compute[75246]:   <uuid>c9abccd6-b64d-4bbf-bdaf-3e3945b04413</uuid>
Nov 28 17:11:42 user nova-compute[75246]:   <name>instance-0000001c</name>
Nov 28 17:11:42 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:11:42 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:11:42 user nova-compute[75246]:   <metadata>
Nov 28 17:11:42 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:11:42 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:11:42 user nova-compute[75246]:       <nova:name>tempest-TestVolumeBootPattern-server-1125403998</nova:name>
Nov 28 17:11:42 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:11:40</nova:creationTime>
Nov 28 17:11:42 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:11:42 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:11:42 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:11:42 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:11:42 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:11:42 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:11:42 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:11:42 user nova-compute[75246]:       <nova:owner>
Nov 28 17:11:42 user nova-compute[75246]:         <nova:user uuid="c334f73c5bf1473aadf865c8f032c0cb">tempest-TestVolumeBootPattern-389869337-project-member</nova:user>
Nov 28 17:11:42 user nova-compute[75246]:         <nova:project uuid="fe0eebdd39c54a74be8d2e0f9842b165">tempest-TestVolumeBootPattern-389869337</nova:project>
Nov 28 17:11:42 user nova-compute[75246]:       </nova:owner>
Nov 28 17:11:42 user nova-compute[75246]:       <nova:ports>
Nov 28 17:11:42 user nova-compute[75246]:         <nova:port uuid="64b4a9b1-d5e7-4a2b-966e-65fc3ecad898">
Nov 28 17:11:42 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 17:11:42 user nova-compute[75246]:         </nova:port>
Nov 28 17:11:42 user nova-compute[75246]:       </nova:ports>
Nov 28 17:11:42 user nova-compute[75246]:     </nova:instance>
Nov 28 17:11:42 user nova-compute[75246]:   </metadata>
Nov 28 17:11:42 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:11:42 user nova-compute[75246]:     <system>
Nov 28 17:11:42 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:11:42 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:11:42 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:11:42 user nova-compute[75246]:       <entry name="serial">c9abccd6-b64d-4bbf-bdaf-3e3945b04413</entry>
Nov 28 17:11:42 user nova-compute[75246]:       <entry name="uuid">c9abccd6-b64d-4bbf-bdaf-3e3945b04413</entry>
Nov 28 17:11:42 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:11:42 user nova-compute[75246]:     </system>
Nov 28 17:11:42 user nova-compute[75246]:   </sysinfo>
Nov 28 17:11:42 user nova-compute[75246]:   <os>
Nov 28 17:11:42 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:11:42 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:11:42 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:11:42 user nova-compute[75246]:   </os>
Nov 28 17:11:42 user nova-compute[75246]:   <features>
Nov 28 17:11:42 user nova-compute[75246]:     <acpi/>
Nov 28 17:11:42 user nova-compute[75246]:     <apic/>
Nov 28 17:11:42 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:11:42 user nova-compute[75246]:   </features>
Nov 28 17:11:42 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:11:42 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:11:42 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:11:42 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:11:42 user nova-compute[75246]:   </clock>
Nov 28 17:11:42 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:11:42 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:11:42 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:11:42 user nova-compute[75246]:   </cpu>
Nov 28 17:11:42 user nova-compute[75246]:   <devices>
Nov 28 17:11:42 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:11:42 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:11:42 user nova-compute[75246]:       <source dev="/dev/sdg"/>
Nov 28 17:11:42 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:11:42 user nova-compute[75246]:       <serial>8989f807-4ecf-49b5-ab2f-ca0a32f283bf</serial>
Nov 28 17:11:42 user nova-compute[75246]:     </disk>
Nov 28 17:11:42 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:11:42 user nova-compute[75246]:       <mac address="fa:16:3e:4c:23:9f"/>
Nov 28 17:11:42 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:11:42 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:11:42 user nova-compute[75246]:       <target dev="tap64b4a9b1-d5"/>
Nov 28 17:11:42 user nova-compute[75246]:     </interface>
Nov 28 17:11:42 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:11:42 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/c9abccd6-b64d-4bbf-bdaf-3e3945b04413/console.log" append="off"/>
Nov 28 17:11:42 user nova-compute[75246]:     </serial>
Nov 28 17:11:42 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:11:42 user nova-compute[75246]:     <video>
Nov 28 17:11:42 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:11:42 user nova-compute[75246]:     </video>
Nov 28 17:11:42 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:11:42 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:11:42 user nova-compute[75246]:     </rng>
Nov 28 17:11:42 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:11:42 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:11:42 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:11:42 user nova-compute[75246]:     </memballoon>
Nov 28 17:11:42 user nova-compute[75246]:   </devices>
Nov 28 17:11:42 user nova-compute[75246]: </domain>
Nov 28 17:11:42 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1125403998',display_name='tempest-TestVolumeBootPattern-server-1125403998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1125403998',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe0eebdd39c54a74be8d2e0f9842b165',ramdisk_id='',reservation_id='r-m6oxezey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-389869337',owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:11:24Z,user_data=None,user_id='c334f73c5bf1473aadf865c8f032c0cb',uuid=c9abccd6-b64d-4bbf-bdaf-3e3945b04413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "address": "fa:16:3e:4c:23:9f", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64b4a9b1-d5", "ovs_interfaceid": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converting VIF {"id": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "address": "fa:16:3e:4c:23:9f", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64b4a9b1-d5", "ovs_interfaceid": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:23:9f,bridge_name='br-int',has_traffic_filtering=True,id=64b4a9b1-d5e7-4a2b-966e-65fc3ecad898,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64b4a9b1-d5') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG os_vif [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:23:9f,bridge_name='br-int',has_traffic_filtering=True,id=64b4a9b1-d5e7-4a2b-966e-65fc3ecad898,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64b4a9b1-d5') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1faf4c70-d289-5ab6-bc77-7d26c947fd12', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64b4a9b1-d5, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64b4a9b1-d5, col_values=(('qos', UUID('3943a1e7-1f50-414b-a0b9-fe40a4dea194')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64b4a9b1-d5, col_values=(('external_ids', {'iface-id': '64b4a9b1-d5e7-4a2b-966e-65fc3ecad898', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:23:9f', 'vm-uuid': 'c9abccd6-b64d-4bbf-bdaf-3e3945b04413'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:42 user nova-compute[75246]: INFO os_vif [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:23:9f,bridge_name='br-int',has_traffic_filtering=True,id=64b4a9b1-d5e7-4a2b-966e-65fc3ecad898,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64b4a9b1-d5')
Nov 28 17:11:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:11:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] No VIF found with MAC fa:16:3e:4c:23:9f, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:11:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:43 user nova-compute[75246]: DEBUG nova.compute.manager [req-732f6eb7-61e6-4ab3-89f8-a85ce7dbb6e7 req-3d95c65e-fa59-46f4-ab92-ea0d70c65228 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Received event network-vif-plugged-ab3dd811-8f71-498f-85d6-56a5e421c06b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-732f6eb7-61e6-4ab3-89f8-a85ce7dbb6e7 req-3d95c65e-fa59-46f4-ab92-ea0d70c65228 service nova] Acquiring lock "bdbc9972-fa4b-4172-b540-1996af1b79fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-732f6eb7-61e6-4ab3-89f8-a85ce7dbb6e7 req-3d95c65e-fa59-46f4-ab92-ea0d70c65228 service nova] Lock "bdbc9972-fa4b-4172-b540-1996af1b79fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-732f6eb7-61e6-4ab3-89f8-a85ce7dbb6e7 req-3d95c65e-fa59-46f4-ab92-ea0d70c65228 service nova] Lock "bdbc9972-fa4b-4172-b540-1996af1b79fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:43 user nova-compute[75246]: DEBUG nova.compute.manager [req-732f6eb7-61e6-4ab3-89f8-a85ce7dbb6e7 req-3d95c65e-fa59-46f4-ab92-ea0d70c65228 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] No waiting events found dispatching network-vif-plugged-ab3dd811-8f71-498f-85d6-56a5e421c06b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:43 user nova-compute[75246]: WARNING nova.compute.manager [req-732f6eb7-61e6-4ab3-89f8-a85ce7dbb6e7 req-3d95c65e-fa59-46f4-ab92-ea0d70c65228 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Received unexpected event network-vif-plugged-ab3dd811-8f71-498f-85d6-56a5e421c06b for instance with vm_state building and task_state spawning.
Nov 28 17:11:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-ff9498f6-cc13-4d12-b5fd-a3ae3e80892e req-2fa6e86c-a24f-4ac8-96b3-58a3f6cfef0e service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Received event network-vif-plugged-ab3dd811-8f71-498f-85d6-56a5e421c06b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ff9498f6-cc13-4d12-b5fd-a3ae3e80892e req-2fa6e86c-a24f-4ac8-96b3-58a3f6cfef0e service nova] Acquiring lock "bdbc9972-fa4b-4172-b540-1996af1b79fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ff9498f6-cc13-4d12-b5fd-a3ae3e80892e req-2fa6e86c-a24f-4ac8-96b3-58a3f6cfef0e service nova] Lock "bdbc9972-fa4b-4172-b540-1996af1b79fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ff9498f6-cc13-4d12-b5fd-a3ae3e80892e req-2fa6e86c-a24f-4ac8-96b3-58a3f6cfef0e service nova] Lock "bdbc9972-fa4b-4172-b540-1996af1b79fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-ff9498f6-cc13-4d12-b5fd-a3ae3e80892e req-2fa6e86c-a24f-4ac8-96b3-58a3f6cfef0e service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] No waiting events found dispatching network-vif-plugged-ab3dd811-8f71-498f-85d6-56a5e421c06b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:45 user nova-compute[75246]: WARNING nova.compute.manager [req-ff9498f6-cc13-4d12-b5fd-a3ae3e80892e req-2fa6e86c-a24f-4ac8-96b3-58a3f6cfef0e service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Received unexpected event network-vif-plugged-ab3dd811-8f71-498f-85d6-56a5e421c06b for instance with vm_state building and task_state spawning.
Nov 28 17:11:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-ff9498f6-cc13-4d12-b5fd-a3ae3e80892e req-2fa6e86c-a24f-4ac8-96b3-58a3f6cfef0e service nova] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Received event network-vif-plugged-64b4a9b1-d5e7-4a2b-966e-65fc3ecad898 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ff9498f6-cc13-4d12-b5fd-a3ae3e80892e req-2fa6e86c-a24f-4ac8-96b3-58a3f6cfef0e service nova] Acquiring lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ff9498f6-cc13-4d12-b5fd-a3ae3e80892e req-2fa6e86c-a24f-4ac8-96b3-58a3f6cfef0e service nova] Lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ff9498f6-cc13-4d12-b5fd-a3ae3e80892e req-2fa6e86c-a24f-4ac8-96b3-58a3f6cfef0e service nova] Lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-ff9498f6-cc13-4d12-b5fd-a3ae3e80892e req-2fa6e86c-a24f-4ac8-96b3-58a3f6cfef0e service nova] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] No waiting events found dispatching network-vif-plugged-64b4a9b1-d5e7-4a2b-966e-65fc3ecad898 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:45 user nova-compute[75246]: WARNING nova.compute.manager [req-ff9498f6-cc13-4d12-b5fd-a3ae3e80892e req-2fa6e86c-a24f-4ac8-96b3-58a3f6cfef0e service nova] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Received unexpected event network-vif-plugged-64b4a9b1-d5e7-4a2b-966e-65fc3ecad898 for instance with vm_state building and task_state spawning.
Nov 28 17:11:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-ff9498f6-cc13-4d12-b5fd-a3ae3e80892e req-2fa6e86c-a24f-4ac8-96b3-58a3f6cfef0e service nova] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Received event network-vif-plugged-64b4a9b1-d5e7-4a2b-966e-65fc3ecad898 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ff9498f6-cc13-4d12-b5fd-a3ae3e80892e req-2fa6e86c-a24f-4ac8-96b3-58a3f6cfef0e service nova] Acquiring lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ff9498f6-cc13-4d12-b5fd-a3ae3e80892e req-2fa6e86c-a24f-4ac8-96b3-58a3f6cfef0e service nova] Lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ff9498f6-cc13-4d12-b5fd-a3ae3e80892e req-2fa6e86c-a24f-4ac8-96b3-58a3f6cfef0e service nova] Lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-ff9498f6-cc13-4d12-b5fd-a3ae3e80892e req-2fa6e86c-a24f-4ac8-96b3-58a3f6cfef0e service nova] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] No waiting events found dispatching network-vif-plugged-64b4a9b1-d5e7-4a2b-966e-65fc3ecad898 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:45 user nova-compute[75246]: WARNING nova.compute.manager [req-ff9498f6-cc13-4d12-b5fd-a3ae3e80892e req-2fa6e86c-a24f-4ac8-96b3-58a3f6cfef0e service nova] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Received unexpected event network-vif-plugged-64b4a9b1-d5e7-4a2b-966e-65fc3ecad898 for instance with vm_state building and task_state spawning.
Nov 28 17:11:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.compute.manager [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:11:46 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Instance spawned successfully.
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.compute.manager [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:11:46 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Instance spawned successfully.
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:11:46 user nova-compute[75246]: INFO nova.compute.manager [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Took 7.21 seconds to spawn the instance on the hypervisor.
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.compute.manager [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:11:46 user nova-compute[75246]: INFO nova.compute.manager [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Took 6.12 seconds to spawn the instance on the hypervisor.
Nov 28 17:11:46 user nova-compute[75246]: DEBUG nova.compute.manager [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:11:46 user nova-compute[75246]: INFO nova.compute.manager [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Took 23.96 seconds to build instance.
Nov 28 17:11:46 user nova-compute[75246]: INFO nova.compute.manager [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Took 8.30 seconds to build instance.
Nov 28 17:11:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1a1d3f50-396e-48dd-b6d8-393b1427541a tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.082s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-13708c32-4b3e-4914-891a-62c79b1faba4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "bdbc9972-fa4b-4172-b540-1996af1b79fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.524s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:55 user nova-compute[75246]: DEBUG nova.compute.manager [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:11:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:55 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:11:55 user nova-compute[75246]: INFO nova.compute.claims [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Claim successful on node user
Nov 28 17:11:55 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:11:55 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:11:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:55 user nova-compute[75246]: DEBUG nova.compute.manager [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:11:55 user nova-compute[75246]: DEBUG nova.compute.manager [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:11:55 user nova-compute[75246]: DEBUG nova.network.neutron [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:11:55 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:11:55 user nova-compute[75246]: DEBUG nova.compute.manager [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:11:55 user nova-compute[75246]: DEBUG nova.policy [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd16e9d549c1421ea573f21b2adee326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57cea906e44d0b99222b8a7ebcc3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG nova.compute.manager [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:11:56 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Creating image(s)
Nov 28 17:11:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "/opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "/opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "/opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.280s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.213s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG nova.network.neutron [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Successfully created port: ac842cb7-f241-4a68-bb18-9841f2e26ed0 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk 1073741824" returned: 0 in 0.069s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.175s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Checking if we can resize image /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:11:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Cannot resize image /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Ensure instance console log exists: /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.network.neutron [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Successfully updated port: ac842cb7-f241-4a68-bb18-9841f2e26ed0 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "refresh_cache-620ce71b-8ce0-492a-ac7e-72dd12987bfa" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquired lock "refresh_cache-620ce71b-8ce0-492a-ac7e-72dd12987bfa" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.network.neutron [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-91ed17db-eea3-457e-a271-5e3b967b1c15 req-787429cf-c766-4c87-ae70-0f5ea74d7d4d service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Received event network-changed-ac842cb7-f241-4a68-bb18-9841f2e26ed0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-91ed17db-eea3-457e-a271-5e3b967b1c15 req-787429cf-c766-4c87-ae70-0f5ea74d7d4d service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Refreshing instance network info cache due to event network-changed-ac842cb7-f241-4a68-bb18-9841f2e26ed0. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-91ed17db-eea3-457e-a271-5e3b967b1c15 req-787429cf-c766-4c87-ae70-0f5ea74d7d4d service nova] Acquiring lock "refresh_cache-620ce71b-8ce0-492a-ac7e-72dd12987bfa" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.network.neutron [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.network.neutron [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Updating instance_info_cache with network_info: [{"id": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "address": "fa:16:3e:6a:5d:8b", "network": {"id": "0fb12881-436f-4943-9a68-00e1b782cc8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-319021949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca57cea906e44d0b99222b8a7ebcc3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac842cb7-f2", "ovs_interfaceid": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Releasing lock "refresh_cache-620ce71b-8ce0-492a-ac7e-72dd12987bfa" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Instance network_info: |[{"id": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "address": "fa:16:3e:6a:5d:8b", "network": {"id": "0fb12881-436f-4943-9a68-00e1b782cc8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-319021949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca57cea906e44d0b99222b8a7ebcc3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac842cb7-f2", "ovs_interfaceid": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-91ed17db-eea3-457e-a271-5e3b967b1c15 req-787429cf-c766-4c87-ae70-0f5ea74d7d4d service nova] Acquired lock "refresh_cache-620ce71b-8ce0-492a-ac7e-72dd12987bfa" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.network.neutron [req-91ed17db-eea3-457e-a271-5e3b967b1c15 req-787429cf-c766-4c87-ae70-0f5ea74d7d4d service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Refreshing network info cache for port ac842cb7-f241-4a68-bb18-9841f2e26ed0 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Start _get_guest_xml network_info=[{"id": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "address": "fa:16:3e:6a:5d:8b", "network": {"id": "0fb12881-436f-4943-9a68-00e1b782cc8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-319021949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca57cea906e44d0b99222b8a7ebcc3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac842cb7-f2", "ovs_interfaceid": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:11:57 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:11:57 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:11:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1139541218',display_name='tempest-TestServerVolumeAttachmentScenario-server-1139541218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1139541218',id=30,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCedd/aOe/QHLQ6YdGcHXoFFfdTMZ1dbNux1Karb3lOEPBr5IDWlmKz8Deg32DmQqiepavZn0PF575jyYD+Ou3tf/ks/cJpvcKL/a7e1CGfNddCs1DiYEiaYsXO/iD+7Q==',key_name='tempest-keypair-1064130482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca57cea906e44d0b99222b8a7ebcc3a3',ramdisk_id='',reservation_id='r-ak61824c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-615546460',owner_user_name='tempest-TestServerVolumeAttachmentScenario-615546460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:11:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd16e9d549c1421ea573f21b2adee326',uuid=620ce71b-8ce0-492a-ac7e-72dd12987bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "address": "fa:16:3e:6a:5d:8b", "network": {"id": "0fb12881-436f-4943-9a68-00e1b782cc8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-319021949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca57cea906e44d0b99222b8a7ebcc3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac842cb7-f2", "ovs_interfaceid": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Converting VIF {"id": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "address": "fa:16:3e:6a:5d:8b", "network": {"id": "0fb12881-436f-4943-9a68-00e1b782cc8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-319021949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca57cea906e44d0b99222b8a7ebcc3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac842cb7-f2", "ovs_interfaceid": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5d:8b,bridge_name='br-int',has_traffic_filtering=True,id=ac842cb7-f241-4a68-bb18-9841f2e26ed0,network=Network(0fb12881-436f-4943-9a68-00e1b782cc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac842cb7-f2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.objects.instance [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lazy-loading 'pci_devices' on Instance uuid 620ce71b-8ce0-492a-ac7e-72dd12987bfa {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:11:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:11:57 user nova-compute[75246]:   <uuid>620ce71b-8ce0-492a-ac7e-72dd12987bfa</uuid>
Nov 28 17:11:57 user nova-compute[75246]:   <name>instance-0000001e</name>
Nov 28 17:11:57 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:11:57 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:11:57 user nova-compute[75246]:   <metadata>
Nov 28 17:11:57 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:11:57 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:11:57 user nova-compute[75246]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1139541218</nova:name>
Nov 28 17:11:57 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:11:57</nova:creationTime>
Nov 28 17:11:57 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:11:57 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:11:57 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:11:57 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:11:57 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:11:57 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:11:57 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:11:57 user nova-compute[75246]:       <nova:owner>
Nov 28 17:11:57 user nova-compute[75246]:         <nova:user uuid="fd16e9d549c1421ea573f21b2adee326">tempest-TestServerVolumeAttachmentScenario-615546460-project-member</nova:user>
Nov 28 17:11:57 user nova-compute[75246]:         <nova:project uuid="ca57cea906e44d0b99222b8a7ebcc3a3">tempest-TestServerVolumeAttachmentScenario-615546460</nova:project>
Nov 28 17:11:57 user nova-compute[75246]:       </nova:owner>
Nov 28 17:11:57 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:11:57 user nova-compute[75246]:       <nova:ports>
Nov 28 17:11:57 user nova-compute[75246]:         <nova:port uuid="ac842cb7-f241-4a68-bb18-9841f2e26ed0">
Nov 28 17:11:57 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 17:11:57 user nova-compute[75246]:         </nova:port>
Nov 28 17:11:57 user nova-compute[75246]:       </nova:ports>
Nov 28 17:11:57 user nova-compute[75246]:     </nova:instance>
Nov 28 17:11:57 user nova-compute[75246]:   </metadata>
Nov 28 17:11:57 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:11:57 user nova-compute[75246]:     <system>
Nov 28 17:11:57 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:11:57 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:11:57 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:11:57 user nova-compute[75246]:       <entry name="serial">620ce71b-8ce0-492a-ac7e-72dd12987bfa</entry>
Nov 28 17:11:57 user nova-compute[75246]:       <entry name="uuid">620ce71b-8ce0-492a-ac7e-72dd12987bfa</entry>
Nov 28 17:11:57 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:11:57 user nova-compute[75246]:     </system>
Nov 28 17:11:57 user nova-compute[75246]:   </sysinfo>
Nov 28 17:11:57 user nova-compute[75246]:   <os>
Nov 28 17:11:57 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:11:57 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:11:57 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:11:57 user nova-compute[75246]:   </os>
Nov 28 17:11:57 user nova-compute[75246]:   <features>
Nov 28 17:11:57 user nova-compute[75246]:     <acpi/>
Nov 28 17:11:57 user nova-compute[75246]:     <apic/>
Nov 28 17:11:57 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:11:57 user nova-compute[75246]:   </features>
Nov 28 17:11:57 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:11:57 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:11:57 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:11:57 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:11:57 user nova-compute[75246]:   </clock>
Nov 28 17:11:57 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:11:57 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:11:57 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:11:57 user nova-compute[75246]:   </cpu>
Nov 28 17:11:57 user nova-compute[75246]:   <devices>
Nov 28 17:11:57 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:11:57 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:11:57 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk"/>
Nov 28 17:11:57 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:11:57 user nova-compute[75246]:     </disk>
Nov 28 17:11:57 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:11:57 user nova-compute[75246]:       <mac address="fa:16:3e:6a:5d:8b"/>
Nov 28 17:11:57 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:11:57 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:11:57 user nova-compute[75246]:       <target dev="tapac842cb7-f2"/>
Nov 28 17:11:57 user nova-compute[75246]:     </interface>
Nov 28 17:11:57 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:11:57 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/console.log" append="off"/>
Nov 28 17:11:57 user nova-compute[75246]:     </serial>
Nov 28 17:11:57 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:11:57 user nova-compute[75246]:     <video>
Nov 28 17:11:57 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:11:57 user nova-compute[75246]:     </video>
Nov 28 17:11:57 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:11:57 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:11:57 user nova-compute[75246]:     </rng>
Nov 28 17:11:57 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:11:57 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:11:57 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:11:57 user nova-compute[75246]:     </memballoon>
Nov 28 17:11:57 user nova-compute[75246]:   </devices>
Nov 28 17:11:57 user nova-compute[75246]: </domain>
Nov 28 17:11:57 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:11:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1139541218',display_name='tempest-TestServerVolumeAttachmentScenario-server-1139541218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1139541218',id=30,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCedd/aOe/QHLQ6YdGcHXoFFfdTMZ1dbNux1Karb3lOEPBr5IDWlmKz8Deg32DmQqiepavZn0PF575jyYD+Ou3tf/ks/cJpvcKL/a7e1CGfNddCs1DiYEiaYsXO/iD+7Q==',key_name='tempest-keypair-1064130482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca57cea906e44d0b99222b8a7ebcc3a3',ramdisk_id='',reservation_id='r-ak61824c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-615546460',owner_user_name='tempest-TestServerVolumeAttachmentScenario-615546460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:11:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd16e9d549c1421ea573f21b2adee326',uuid=620ce71b-8ce0-492a-ac7e-72dd12987bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "address": "fa:16:3e:6a:5d:8b", "network": {"id": "0fb12881-436f-4943-9a68-00e1b782cc8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-319021949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca57cea906e44d0b99222b8a7ebcc3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac842cb7-f2", "ovs_interfaceid": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Converting VIF {"id": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "address": "fa:16:3e:6a:5d:8b", "network": {"id": "0fb12881-436f-4943-9a68-00e1b782cc8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-319021949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca57cea906e44d0b99222b8a7ebcc3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac842cb7-f2", "ovs_interfaceid": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5d:8b,bridge_name='br-int',has_traffic_filtering=True,id=ac842cb7-f241-4a68-bb18-9841f2e26ed0,network=Network(0fb12881-436f-4943-9a68-00e1b782cc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac842cb7-f2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG os_vif [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5d:8b,bridge_name='br-int',has_traffic_filtering=True,id=ac842cb7-f241-4a68-bb18-9841f2e26ed0,network=Network(0fb12881-436f-4943-9a68-00e1b782cc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac842cb7-f2') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '419003bd-0ee0-5caf-afd3-4e36ca54389c', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac842cb7-f2, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac842cb7-f2, col_values=(('qos', UUID('0597921c-4a0f-42b1-9e7e-ef3684ebcbcd')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac842cb7-f2, col_values=(('external_ids', {'iface-id': 'ac842cb7-f241-4a68-bb18-9841f2e26ed0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:5d:8b', 'vm-uuid': '620ce71b-8ce0-492a-ac7e-72dd12987bfa'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:58 user nova-compute[75246]: INFO os_vif [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5d:8b,bridge_name='br-int',has_traffic_filtering=True,id=ac842cb7-f241-4a68-bb18-9841f2e26ed0,network=Network(0fb12881-436f-4943-9a68-00e1b782cc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac842cb7-f2')
Nov 28 17:11:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] No VIF found with MAC fa:16:3e:6a:5d:8b, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG nova.network.neutron [req-91ed17db-eea3-457e-a271-5e3b967b1c15 req-787429cf-c766-4c87-ae70-0f5ea74d7d4d service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Updated VIF entry in instance network info cache for port ac842cb7-f241-4a68-bb18-9841f2e26ed0. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG nova.network.neutron [req-91ed17db-eea3-457e-a271-5e3b967b1c15 req-787429cf-c766-4c87-ae70-0f5ea74d7d4d service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Updating instance_info_cache with network_info: [{"id": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "address": "fa:16:3e:6a:5d:8b", "network": {"id": "0fb12881-436f-4943-9a68-00e1b782cc8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-319021949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca57cea906e44d0b99222b8a7ebcc3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac842cb7-f2", "ovs_interfaceid": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:11:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-91ed17db-eea3-457e-a271-5e3b967b1c15 req-787429cf-c766-4c87-ae70-0f5ea74d7d4d service nova] Releasing lock "refresh_cache-620ce71b-8ce0-492a-ac7e-72dd12987bfa" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:11:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:11:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-573d4005-7e88-4040-a9b2-1780e4fed743 req-553c9739-b67b-4eb1-8da6-fdab802322b5 service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Received event network-vif-plugged-ac842cb7-f241-4a68-bb18-9841f2e26ed0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:11:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-573d4005-7e88-4040-a9b2-1780e4fed743 req-553c9739-b67b-4eb1-8da6-fdab802322b5 service nova] Acquiring lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:11:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-573d4005-7e88-4040-a9b2-1780e4fed743 req-553c9739-b67b-4eb1-8da6-fdab802322b5 service nova] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:11:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-573d4005-7e88-4040-a9b2-1780e4fed743 req-553c9739-b67b-4eb1-8da6-fdab802322b5 service nova] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:11:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-573d4005-7e88-4040-a9b2-1780e4fed743 req-553c9739-b67b-4eb1-8da6-fdab802322b5 service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] No waiting events found dispatching network-vif-plugged-ac842cb7-f241-4a68-bb18-9841f2e26ed0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:11:59 user nova-compute[75246]: WARNING nova.compute.manager [req-573d4005-7e88-4040-a9b2-1780e4fed743 req-553c9739-b67b-4eb1-8da6-fdab802322b5 service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Received unexpected event network-vif-plugged-ac842cb7-f241-4a68-bb18-9841f2e26ed0 for instance with vm_state building and task_state spawning.
Nov 28 17:12:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:01 user nova-compute[75246]: DEBUG nova.compute.manager [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:12:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:12:01 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Instance spawned successfully.
Nov 28 17:12:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:12:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-43a0119f-86db-4d55-a776-dab080b99e8c req-84cbeccf-8755-415a-8f9e-3d13b09c9b2c service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Received event network-vif-plugged-ac842cb7-f241-4a68-bb18-9841f2e26ed0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-43a0119f-86db-4d55-a776-dab080b99e8c req-84cbeccf-8755-415a-8f9e-3d13b09c9b2c service nova] Acquiring lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-43a0119f-86db-4d55-a776-dab080b99e8c req-84cbeccf-8755-415a-8f9e-3d13b09c9b2c service nova] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-43a0119f-86db-4d55-a776-dab080b99e8c req-84cbeccf-8755-415a-8f9e-3d13b09c9b2c service nova] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-43a0119f-86db-4d55-a776-dab080b99e8c req-84cbeccf-8755-415a-8f9e-3d13b09c9b2c service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] No waiting events found dispatching network-vif-plugged-ac842cb7-f241-4a68-bb18-9841f2e26ed0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:01 user nova-compute[75246]: WARNING nova.compute.manager [req-43a0119f-86db-4d55-a776-dab080b99e8c req-84cbeccf-8755-415a-8f9e-3d13b09c9b2c service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Received unexpected event network-vif-plugged-ac842cb7-f241-4a68-bb18-9841f2e26ed0 for instance with vm_state building and task_state spawning.
Nov 28 17:12:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:12:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:12:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:12:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:12:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:12:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:12:01 user nova-compute[75246]: INFO nova.compute.manager [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 28 17:12:01 user nova-compute[75246]: DEBUG nova.compute.manager [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:12:01 user nova-compute[75246]: INFO nova.compute.manager [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Took 6.58 seconds to build instance.
Nov 28 17:12:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fcfea94a-cd34-415b-8d05-f7ba47ba04b0 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.682s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:04 user nova-compute[75246]: DEBUG nova.objects.instance [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lazy-loading 'flavor' on Instance uuid 36e65da9-4cc0-4d73-9e5d-e64520e08f34 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:12:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:05 user nova-compute[75246]: INFO nova.compute.manager [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Attaching volume e6996356-1723-436e-b213-9f94003fa05a to /dev/vdb
Nov 28 17:12:05 user nova-compute[75246]: DEBUG os_brick.utils [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[267564d6-3f44-491b-8523-97989664cc0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdc9db8-b53e-46f5-8f83-c6cf86f37361]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dab353-df46-475c-b75b-e97e2c99030a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8008a9b-9c6f-494c-a7ef-9a463b9b7e39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:12:05 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:12:05 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[597fb6c5-d62b-4b7b-afa1-fcebc9ce5877]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG os_brick.utils [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:12:05 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Updating existing volume attachment record: 74ff2881-ddbf-4734-899a-a2c22ddae11e {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:12:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:12 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:12:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ythHnuOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:12:12 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:12:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:12:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:12:12 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:12:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:12:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:12:12 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:12:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[98de24aa-c009-41df-9f8a-ef46cd2085ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:12:12 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:12:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d528f1d-7002-476d-94e3-541655c09c2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a] added
Nov 28 17:12:13 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[656421b9-c5f5-4886-b73c-9b302794ccd7]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5770e50-7416-4773-9c5c-4dfd701fef47]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ythHnuOW {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ythHnuOW" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[882bb969-d540-4dba-9798-25201e86618c]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ythHnuOW'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5e4a7c-e68d-4fd8-a4d2-10f24b31f24c]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e525a188-b6df-4a29-8cea-63b761f1f367]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:12:13 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:12:13 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7844a980-3753-43e9-980e-5e8d2681cf05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a, portal: 172.16.0.220,3260]
Nov 28 17:12:13 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a, portal: 172.16.0.220,3260] successful.
Nov 28 17:12:13 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabba64f-cc47-4d2e-a5f5-f3c74ede94a2]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce7eed5-dac1-42ac-a30e-8dc45e81e7fe]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:12:13 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:12:13 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:12:13 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] HCTL ('39', '-', '-', 0) found on session 32 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aa1209-8c0a-41ab-acc9-60022d262281]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Searching for a device in session 32 and hctl ['39', '*', '*', 0] yield: None {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:12:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:14 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Searching for a device in session 32 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:12:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ythHnuOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:12:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:12:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26666313331343231', 'path': '/dev/sdh'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:12:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666313331343231', 'path': '/dev/sdh'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:12:14 user nova-compute[75246]: DEBUG nova.objects.instance [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lazy-loading 'flavor' on Instance uuid 36e65da9-4cc0-4d73-9e5d-e64520e08f34 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:12:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:12:14 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:12:14 user nova-compute[75246]:   <source dev="/dev/sdh"/>
Nov 28 17:12:14 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:12:14 user nova-compute[75246]:   <serial>e6996356-1723-436e-b213-9f94003fa05a</serial>
Nov 28 17:12:14 user nova-compute[75246]: </disk>
Nov 28 17:12:14 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:12:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:12:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:12:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] No VIF found with MAC fa:16:3e:74:a8:07, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:12:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-416edb58-9ac8-4ff7-a78d-76b102925140 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.890s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "90829136-472b-4c45-9607-c28433d05f56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:12:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:16 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:12:16 user nova-compute[75246]: INFO nova.compute.claims [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Claim successful on node user
Nov 28 17:12:16 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:12:16 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:12:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:12:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:12:16 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:12:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:12:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:12:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:12:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:12:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Creating image(s)
Nov 28 17:12:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "/opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "/opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "/opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:16 user nova-compute[75246]: DEBUG nova.policy [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b79c4440e4734a2f82b08de54ed61737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60768e53b1e3414cb05eaaf23d382493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:12:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.169s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk 1073741824" returned: 0 in 0.045s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.186s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Successfully created port: 5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Cannot resize image /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Ensure instance console log exists: /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:17 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:12:17 user nova-compute[75246]: INFO nova.compute.claims [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Claim successful on node user
Nov 28 17:12:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Successfully updated port: 5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquired lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.615s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-0b38ff87-f066-4dc5-a2b8-72d61218f519 req-f4527a76-3f26-47bb-91a4-d786b99b6b51 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received event network-changed-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-0b38ff87-f066-4dc5-a2b8-72d61218f519 req-f4527a76-3f26-47bb-91a4-d786b99b6b51 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Refreshing instance network info cache due to event network-changed-5f6b2b48-5c6d-4528-95dd-e7eb24780e37. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0b38ff87-f066-4dc5-a2b8-72d61218f519 req-f4527a76-3f26-47bb-91a4-d786b99b6b51 service nova] Acquiring lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:12:18 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:12:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-edf9062a-1f6c-43c8-8f92-621b2499f953 req-5a4466de-1b46-4ea0-b8ca-5bf54045bb4c service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received event network-changed-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-edf9062a-1f6c-43c8-8f92-621b2499f953 req-5a4466de-1b46-4ea0-b8ca-5bf54045bb4c service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Refreshing instance network info cache due to event network-changed-cadf851f-d826-43fb-984d-4f15cafa5f64. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-edf9062a-1f6c-43c8-8f92-621b2499f953 req-5a4466de-1b46-4ea0-b8ca-5bf54045bb4c service nova] Acquiring lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-edf9062a-1f6c-43c8-8f92-621b2499f953 req-5a4466de-1b46-4ea0-b8ca-5bf54045bb4c service nova] Acquired lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG nova.network.neutron [req-edf9062a-1f6c-43c8-8f92-621b2499f953 req-5a4466de-1b46-4ea0-b8ca-5bf54045bb4c service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Refreshing network info cache for port cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG nova.policy [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0ed095223674edebcee82e4183c8ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd94665acd9a4448a1ad1350d71d8f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:12:18 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Creating image(s)
Nov 28 17:12:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "/opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "/opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.186s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Updating instance_info_cache with network_info: [{"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Releasing lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Instance network_info: |[{"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0b38ff87-f066-4dc5-a2b8-72d61218f519 req-f4527a76-3f26-47bb-91a4-d786b99b6b51 service nova] Acquired lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.network.neutron [req-0b38ff87-f066-4dc5-a2b8-72d61218f519 req-f4527a76-3f26-47bb-91a4-d786b99b6b51 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Refreshing network info cache for port 5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Start _get_guest_xml network_info=[{"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:12:19 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:12:19 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:12:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-904390000',display_name='tempest-ServerRescueNegativeTestJSON-server-904390000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-904390000',id=31,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZ87kIt1XgMGQQZuF6spI0RsdOfKq7otrdj2C3YZOeKitq4qaVEU4L/6TIfjjxxs5HbyoYdyOZFRxRzbLaO4PpN3Qz0YtRnNy3kiitPSO/VFgmaSMKcNRkWPgRAD8B1HQ==',key_name='tempest-keypair-929323611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60768e53b1e3414cb05eaaf23d382493',ramdisk_id='',reservation_id='r-x1gqpe35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-220335783',owner_user_name='tempest-ServerRescueNegativeTestJSON-220335783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:12:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b79c4440e4734a2f82b08de54ed61737',uuid=90829136-472b-4c45-9607-c28433d05f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converting VIF {"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:7d:4a,bridge_name='br-int',has_traffic_filtering=True,id=5f6b2b48-5c6d-4528-95dd-e7eb24780e37,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6b2b48-5c') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.objects.instance [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'pci_devices' on Instance uuid 90829136-472b-4c45-9607-c28433d05f56 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:12:19 user nova-compute[75246]:   <uuid>90829136-472b-4c45-9607-c28433d05f56</uuid>
Nov 28 17:12:19 user nova-compute[75246]:   <name>instance-0000001f</name>
Nov 28 17:12:19 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:12:19 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:12:19 user nova-compute[75246]:   <metadata>
Nov 28 17:12:19 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:12:19 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:12:19 user nova-compute[75246]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-904390000</nova:name>
Nov 28 17:12:19 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:12:19</nova:creationTime>
Nov 28 17:12:19 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:12:19 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:12:19 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:12:19 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:12:19 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:12:19 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:12:19 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:12:19 user nova-compute[75246]:       <nova:owner>
Nov 28 17:12:19 user nova-compute[75246]:         <nova:user uuid="b79c4440e4734a2f82b08de54ed61737">tempest-ServerRescueNegativeTestJSON-220335783-project-member</nova:user>
Nov 28 17:12:19 user nova-compute[75246]:         <nova:project uuid="60768e53b1e3414cb05eaaf23d382493">tempest-ServerRescueNegativeTestJSON-220335783</nova:project>
Nov 28 17:12:19 user nova-compute[75246]:       </nova:owner>
Nov 28 17:12:19 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:12:19 user nova-compute[75246]:       <nova:ports>
Nov 28 17:12:19 user nova-compute[75246]:         <nova:port uuid="5f6b2b48-5c6d-4528-95dd-e7eb24780e37">
Nov 28 17:12:19 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 17:12:19 user nova-compute[75246]:         </nova:port>
Nov 28 17:12:19 user nova-compute[75246]:       </nova:ports>
Nov 28 17:12:19 user nova-compute[75246]:     </nova:instance>
Nov 28 17:12:19 user nova-compute[75246]:   </metadata>
Nov 28 17:12:19 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:12:19 user nova-compute[75246]:     <system>
Nov 28 17:12:19 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:12:19 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:12:19 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:12:19 user nova-compute[75246]:       <entry name="serial">90829136-472b-4c45-9607-c28433d05f56</entry>
Nov 28 17:12:19 user nova-compute[75246]:       <entry name="uuid">90829136-472b-4c45-9607-c28433d05f56</entry>
Nov 28 17:12:19 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:12:19 user nova-compute[75246]:     </system>
Nov 28 17:12:19 user nova-compute[75246]:   </sysinfo>
Nov 28 17:12:19 user nova-compute[75246]:   <os>
Nov 28 17:12:19 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:12:19 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:12:19 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:12:19 user nova-compute[75246]:   </os>
Nov 28 17:12:19 user nova-compute[75246]:   <features>
Nov 28 17:12:19 user nova-compute[75246]:     <acpi/>
Nov 28 17:12:19 user nova-compute[75246]:     <apic/>
Nov 28 17:12:19 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:12:19 user nova-compute[75246]:   </features>
Nov 28 17:12:19 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:12:19 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:12:19 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:12:19 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:12:19 user nova-compute[75246]:   </clock>
Nov 28 17:12:19 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:12:19 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:12:19 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:12:19 user nova-compute[75246]:   </cpu>
Nov 28 17:12:19 user nova-compute[75246]:   <devices>
Nov 28 17:12:19 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:12:19 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:12:19 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk"/>
Nov 28 17:12:19 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:12:19 user nova-compute[75246]:     </disk>
Nov 28 17:12:19 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:12:19 user nova-compute[75246]:       <mac address="fa:16:3e:1a:7d:4a"/>
Nov 28 17:12:19 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:12:19 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:12:19 user nova-compute[75246]:       <target dev="tap5f6b2b48-5c"/>
Nov 28 17:12:19 user nova-compute[75246]:     </interface>
Nov 28 17:12:19 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:12:19 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/console.log" append="off"/>
Nov 28 17:12:19 user nova-compute[75246]:     </serial>
Nov 28 17:12:19 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:12:19 user nova-compute[75246]:     <video>
Nov 28 17:12:19 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:12:19 user nova-compute[75246]:     </video>
Nov 28 17:12:19 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:12:19 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:12:19 user nova-compute[75246]:     </rng>
Nov 28 17:12:19 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:12:19 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:12:19 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:12:19 user nova-compute[75246]:     </memballoon>
Nov 28 17:12:19 user nova-compute[75246]:   </devices>
Nov 28 17:12:19 user nova-compute[75246]: </domain>
Nov 28 17:12:19 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:12:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-904390000',display_name='tempest-ServerRescueNegativeTestJSON-server-904390000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-904390000',id=31,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZ87kIt1XgMGQQZuF6spI0RsdOfKq7otrdj2C3YZOeKitq4qaVEU4L/6TIfjjxxs5HbyoYdyOZFRxRzbLaO4PpN3Qz0YtRnNy3kiitPSO/VFgmaSMKcNRkWPgRAD8B1HQ==',key_name='tempest-keypair-929323611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60768e53b1e3414cb05eaaf23d382493',ramdisk_id='',reservation_id='r-x1gqpe35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-220335783',owner_user_name='tempest-ServerRescueNegativeTestJSON-220335783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:12:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b79c4440e4734a2f82b08de54ed61737',uuid=90829136-472b-4c45-9607-c28433d05f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converting VIF {"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:7d:4a,bridge_name='br-int',has_traffic_filtering=True,id=5f6b2b48-5c6d-4528-95dd-e7eb24780e37,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6b2b48-5c') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG os_vif [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:7d:4a,bridge_name='br-int',has_traffic_filtering=True,id=5f6b2b48-5c6d-4528-95dd-e7eb24780e37,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6b2b48-5c') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2602489-a686-507c-99ba-c8dc90cd1be1', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f6b2b48-5c, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f6b2b48-5c, col_values=(('qos', UUID('7abfbd25-ad67-4ce3-946a-48a2c4d73006')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f6b2b48-5c, col_values=(('external_ids', {'iface-id': '5f6b2b48-5c6d-4528-95dd-e7eb24780e37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:7d:4a', 'vm-uuid': '90829136-472b-4c45-9607-c28433d05f56'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:19 user nova-compute[75246]: INFO os_vif [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:7d:4a,bridge_name='br-int',has_traffic_filtering=True,id=5f6b2b48-5c6d-4528-95dd-e7eb24780e37,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6b2b48-5c')
Nov 28 17:12:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.216s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk 1073741824" returned: 0 in 0.058s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] No VIF found with MAC fa:16:3e:1a:7d:4a, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.network.neutron [req-edf9062a-1f6c-43c8-8f92-621b2499f953 req-5a4466de-1b46-4ea0-b8ca-5bf54045bb4c service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Updated VIF entry in instance network info cache for port cadf851f-d826-43fb-984d-4f15cafa5f64. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.network.neutron [req-edf9062a-1f6c-43c8-8f92-621b2499f953 req-5a4466de-1b46-4ea0-b8ca-5bf54045bb4c service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Updating instance_info_cache with network_info: [{"id": "cadf851f-d826-43fb-984d-4f15cafa5f64", "address": "fa:16:3e:74:a8:07", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadf851f-d8", "ovs_interfaceid": "cadf851f-d826-43fb-984d-4f15cafa5f64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-edf9062a-1f6c-43c8-8f92-621b2499f953 req-5a4466de-1b46-4ea0-b8ca-5bf54045bb4c service nova] Releasing lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.196s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Cannot resize image /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Ensure instance console log exists: /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:20 user nova-compute[75246]: DEBUG nova.network.neutron [req-0b38ff87-f066-4dc5-a2b8-72d61218f519 req-f4527a76-3f26-47bb-91a4-d786b99b6b51 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Updated VIF entry in instance network info cache for port 5f6b2b48-5c6d-4528-95dd-e7eb24780e37. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:12:20 user nova-compute[75246]: DEBUG nova.network.neutron [req-0b38ff87-f066-4dc5-a2b8-72d61218f519 req-f4527a76-3f26-47bb-91a4-d786b99b6b51 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Updating instance_info_cache with network_info: [{"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:12:20 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Successfully created port: 434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:12:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0b38ff87-f066-4dc5-a2b8-72d61218f519 req-f4527a76-3f26-47bb-91a4-d786b99b6b51 service nova] Releasing lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:12:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:20 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Successfully updated port: 434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:12:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:12:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquired lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:12:20 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:12:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-bfd1b2ad-4116-45f3-9551-e55c68e4b9b1 req-55fcd1a8-104e-4581-95f9-1694aa3665a5 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received event network-changed-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-bfd1b2ad-4116-45f3-9551-e55c68e4b9b1 req-55fcd1a8-104e-4581-95f9-1694aa3665a5 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Refreshing instance network info cache due to event network-changed-434dbbbd-947d-47c5-a794-4fee8690d835. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:12:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-bfd1b2ad-4116-45f3-9551-e55c68e4b9b1 req-55fcd1a8-104e-4581-95f9-1694aa3665a5 service nova] Acquiring lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:12:20 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.compute.manager [req-972dabbf-ba67-4735-9b44-0b2e7b96cd24 req-0ee7685b-dc91-45c9-8fb1-312669358e13 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received event network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-972dabbf-ba67-4735-9b44-0b2e7b96cd24 req-0ee7685b-dc91-45c9-8fb1-312669358e13 service nova] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-972dabbf-ba67-4735-9b44-0b2e7b96cd24 req-0ee7685b-dc91-45c9-8fb1-312669358e13 service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-972dabbf-ba67-4735-9b44-0b2e7b96cd24 req-0ee7685b-dc91-45c9-8fb1-312669358e13 service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.compute.manager [req-972dabbf-ba67-4735-9b44-0b2e7b96cd24 req-0ee7685b-dc91-45c9-8fb1-312669358e13 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] No waiting events found dispatching network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:21 user nova-compute[75246]: WARNING nova.compute.manager [req-972dabbf-ba67-4735-9b44-0b2e7b96cd24 req-0ee7685b-dc91-45c9-8fb1-312669358e13 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received unexpected event network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 for instance with vm_state building and task_state spawning.
Nov 28 17:12:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Updating instance_info_cache with network_info: [{"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Releasing lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Instance network_info: |[{"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-bfd1b2ad-4116-45f3-9551-e55c68e4b9b1 req-55fcd1a8-104e-4581-95f9-1694aa3665a5 service nova] Acquired lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.network.neutron [req-bfd1b2ad-4116-45f3-9551-e55c68e4b9b1 req-55fcd1a8-104e-4581-95f9-1694aa3665a5 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Refreshing network info cache for port 434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Start _get_guest_xml network_info=[{"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:12:21 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:12:21 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2130907667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2130907667',id=32,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkyQVU4+IKRbdT/9XXp3whOYOZpGrX/8I6qjmkWxKzuwGZbu6+LtoKJ1o0iUy0Plg/S1jnl5rqH3hbqK/R2kiB32pqva3FiYFAbn/9EY1INepDABzQQiQlwaAFWnxd6Tw==',key_name='tempest-keypair-1886774448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd94665acd9a4448a1ad1350d71d8f72',ramdisk_id='',reservation_id='r-3eim7bic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726606277',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726606277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:12:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ed095223674edebcee82e4183c8ea0',uuid=1d3f57d8-3580-4c42-8a4c-cef210e19eb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converting VIF {"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:db:6a,bridge_name='br-int',has_traffic_filtering=True,id=434dbbbd-947d-47c5-a794-4fee8690d835,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434dbbbd-94') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d3f57d8-3580-4c42-8a4c-cef210e19eb4 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:12:21 user nova-compute[75246]:   <uuid>1d3f57d8-3580-4c42-8a4c-cef210e19eb4</uuid>
Nov 28 17:12:21 user nova-compute[75246]:   <name>instance-00000020</name>
Nov 28 17:12:21 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:12:21 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:12:21 user nova-compute[75246]:   <metadata>
Nov 28 17:12:21 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:12:21 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:12:21 user nova-compute[75246]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2130907667</nova:name>
Nov 28 17:12:21 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:12:21</nova:creationTime>
Nov 28 17:12:21 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:12:21 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:12:21 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:12:21 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:12:21 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:12:21 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:12:21 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:12:21 user nova-compute[75246]:       <nova:owner>
Nov 28 17:12:21 user nova-compute[75246]:         <nova:user uuid="a0ed095223674edebcee82e4183c8ea0">tempest-AttachVolumeShelveTestJSON-1726606277-project-member</nova:user>
Nov 28 17:12:21 user nova-compute[75246]:         <nova:project uuid="cd94665acd9a4448a1ad1350d71d8f72">tempest-AttachVolumeShelveTestJSON-1726606277</nova:project>
Nov 28 17:12:21 user nova-compute[75246]:       </nova:owner>
Nov 28 17:12:21 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:12:21 user nova-compute[75246]:       <nova:ports>
Nov 28 17:12:21 user nova-compute[75246]:         <nova:port uuid="434dbbbd-947d-47c5-a794-4fee8690d835">
Nov 28 17:12:21 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 17:12:21 user nova-compute[75246]:         </nova:port>
Nov 28 17:12:21 user nova-compute[75246]:       </nova:ports>
Nov 28 17:12:21 user nova-compute[75246]:     </nova:instance>
Nov 28 17:12:21 user nova-compute[75246]:   </metadata>
Nov 28 17:12:21 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:12:21 user nova-compute[75246]:     <system>
Nov 28 17:12:21 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:12:21 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:12:21 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:12:21 user nova-compute[75246]:       <entry name="serial">1d3f57d8-3580-4c42-8a4c-cef210e19eb4</entry>
Nov 28 17:12:21 user nova-compute[75246]:       <entry name="uuid">1d3f57d8-3580-4c42-8a4c-cef210e19eb4</entry>
Nov 28 17:12:21 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:12:21 user nova-compute[75246]:     </system>
Nov 28 17:12:21 user nova-compute[75246]:   </sysinfo>
Nov 28 17:12:21 user nova-compute[75246]:   <os>
Nov 28 17:12:21 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:12:21 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:12:21 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:12:21 user nova-compute[75246]:   </os>
Nov 28 17:12:21 user nova-compute[75246]:   <features>
Nov 28 17:12:21 user nova-compute[75246]:     <acpi/>
Nov 28 17:12:21 user nova-compute[75246]:     <apic/>
Nov 28 17:12:21 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:12:21 user nova-compute[75246]:   </features>
Nov 28 17:12:21 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:12:21 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:12:21 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:12:21 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:12:21 user nova-compute[75246]:   </clock>
Nov 28 17:12:21 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:12:21 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:12:21 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:12:21 user nova-compute[75246]:   </cpu>
Nov 28 17:12:21 user nova-compute[75246]:   <devices>
Nov 28 17:12:21 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:12:21 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:12:21 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk"/>
Nov 28 17:12:21 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:12:21 user nova-compute[75246]:     </disk>
Nov 28 17:12:21 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:12:21 user nova-compute[75246]:       <mac address="fa:16:3e:24:db:6a"/>
Nov 28 17:12:21 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:12:21 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:12:21 user nova-compute[75246]:       <target dev="tap434dbbbd-94"/>
Nov 28 17:12:21 user nova-compute[75246]:     </interface>
Nov 28 17:12:21 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:12:21 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/console.log" append="off"/>
Nov 28 17:12:21 user nova-compute[75246]:     </serial>
Nov 28 17:12:21 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:12:21 user nova-compute[75246]:     <video>
Nov 28 17:12:21 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:12:21 user nova-compute[75246]:     </video>
Nov 28 17:12:21 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:12:21 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:12:21 user nova-compute[75246]:     </rng>
Nov 28 17:12:21 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:12:21 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:12:21 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:12:21 user nova-compute[75246]:     </memballoon>
Nov 28 17:12:21 user nova-compute[75246]:   </devices>
Nov 28 17:12:21 user nova-compute[75246]: </domain>
Nov 28 17:12:21 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2130907667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2130907667',id=32,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkyQVU4+IKRbdT/9XXp3whOYOZpGrX/8I6qjmkWxKzuwGZbu6+LtoKJ1o0iUy0Plg/S1jnl5rqH3hbqK/R2kiB32pqva3FiYFAbn/9EY1INepDABzQQiQlwaAFWnxd6Tw==',key_name='tempest-keypair-1886774448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd94665acd9a4448a1ad1350d71d8f72',ramdisk_id='',reservation_id='r-3eim7bic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726606277',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726606277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:12:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ed095223674edebcee82e4183c8ea0',uuid=1d3f57d8-3580-4c42-8a4c-cef210e19eb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converting VIF {"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:db:6a,bridge_name='br-int',has_traffic_filtering=True,id=434dbbbd-947d-47c5-a794-4fee8690d835,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434dbbbd-94') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG os_vif [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:db:6a,bridge_name='br-int',has_traffic_filtering=True,id=434dbbbd-947d-47c5-a794-4fee8690d835,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434dbbbd-94') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22722f50-7947-5208-86f6-d9a77adee9b5', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap434dbbbd-94, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap434dbbbd-94, col_values=(('qos', UUID('625b77ee-c67a-4208-9490-6233cda9b4ee')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap434dbbbd-94, col_values=(('external_ids', {'iface-id': '434dbbbd-947d-47c5-a794-4fee8690d835', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:db:6a', 'vm-uuid': '1d3f57d8-3580-4c42-8a4c-cef210e19eb4'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:21 user nova-compute[75246]: INFO os_vif [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:db:6a,bridge_name='br-int',has_traffic_filtering=True,id=434dbbbd-947d-47c5-a794-4fee8690d835,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434dbbbd-94')
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] No VIF found with MAC fa:16:3e:24:db:6a, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.network.neutron [req-bfd1b2ad-4116-45f3-9551-e55c68e4b9b1 req-55fcd1a8-104e-4581-95f9-1694aa3665a5 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Updated VIF entry in instance network info cache for port 434dbbbd-947d-47c5-a794-4fee8690d835. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG nova.network.neutron [req-bfd1b2ad-4116-45f3-9551-e55c68e4b9b1 req-55fcd1a8-104e-4581-95f9-1694aa3665a5 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Updating instance_info_cache with network_info: [{"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:12:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-bfd1b2ad-4116-45f3-9551-e55c68e4b9b1 req-55fcd1a8-104e-4581-95f9-1694aa3665a5 service nova] Releasing lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:12:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1fdaa5a7-e9f0-4969-8b73-b45c7e892b00 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1fdaa5a7-e9f0-4969-8b73-b45c7e892b00 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:22 user nova-compute[75246]: INFO nova.compute.manager [None req-1fdaa5a7-e9f0-4969-8b73-b45c7e892b00 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Rebooting instance
Nov 28 17:12:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1fdaa5a7-e9f0-4969-8b73-b45c7e892b00 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:12:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1fdaa5a7-e9f0-4969-8b73-b45c7e892b00 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquired lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:12:22 user nova-compute[75246]: DEBUG nova.network.neutron [None req-1fdaa5a7-e9f0-4969-8b73-b45c7e892b00 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:12:22 user nova-compute[75246]: DEBUG nova.network.neutron [None req-1fdaa5a7-e9f0-4969-8b73-b45c7e892b00 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Updating instance_info_cache with network_info: [{"id": "cadf851f-d826-43fb-984d-4f15cafa5f64", "address": "fa:16:3e:74:a8:07", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadf851f-d8", "ovs_interfaceid": "cadf851f-d826-43fb-984d-4f15cafa5f64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:12:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1fdaa5a7-e9f0-4969-8b73-b45c7e892b00 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Releasing lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:12:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-1fdaa5a7-e9f0-4969-8b73-b45c7e892b00 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:12:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received event network-changed-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Refreshing instance network info cache due to event network-changed-cadf851f-d826-43fb-984d-4f15cafa5f64. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] Acquiring lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] Acquired lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.network.neutron [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Refreshing network info cache for port cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:12:23 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 90829136-472b-4c45-9607-c28433d05f56] Instance spawned successfully.
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:23 user nova-compute[75246]: INFO nova.compute.manager [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Took 6.75 seconds to spawn the instance on the hypervisor.
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.network.neutron [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Updated VIF entry in instance network info cache for port cadf851f-d826-43fb-984d-4f15cafa5f64. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.network.neutron [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Updating instance_info_cache with network_info: [{"id": "cadf851f-d826-43fb-984d-4f15cafa5f64", "address": "fa:16:3e:74:a8:07", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadf851f-d8", "ovs_interfaceid": "cadf851f-d826-43fb-984d-4f15cafa5f64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] Releasing lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received event network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] No waiting events found dispatching network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:23 user nova-compute[75246]: WARNING nova.compute.manager [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received unexpected event network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 for instance with vm_state building and task_state spawning.
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received event network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] Acquiring lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] No waiting events found dispatching network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:23 user nova-compute[75246]: WARNING nova.compute.manager [req-12425c67-1f59-4f19-abea-2b1d8e8e8450 req-374dce33-caeb-428a-afb9-c3254376501f service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received unexpected event network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 for instance with vm_state building and task_state spawning.
Nov 28 17:12:23 user nova-compute[75246]: INFO nova.compute.manager [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Took 7.56 seconds to build instance.
Nov 28 17:12:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b238ad9-c82d-4d55-82fb-faf074fa70ef tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "90829136-472b-4c45-9607-c28433d05f56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.709s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:23 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-26904586-d191-4457-86c3-076af286bb68 req-55b2813b-0032-4871-8f12-a5e3be093125 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received event network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-26904586-d191-4457-86c3-076af286bb68 req-55b2813b-0032-4871-8f12-a5e3be093125 service nova] Acquiring lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-26904586-d191-4457-86c3-076af286bb68 req-55b2813b-0032-4871-8f12-a5e3be093125 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-26904586-d191-4457-86c3-076af286bb68 req-55b2813b-0032-4871-8f12-a5e3be093125 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-26904586-d191-4457-86c3-076af286bb68 req-55b2813b-0032-4871-8f12-a5e3be093125 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] No waiting events found dispatching network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:25 user nova-compute[75246]: WARNING nova.compute.manager [req-26904586-d191-4457-86c3-076af286bb68 req-55b2813b-0032-4871-8f12-a5e3be093125 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received unexpected event network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 for instance with vm_state building and task_state spawning.
Nov 28 17:12:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:25 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Instance spawned successfully.
Nov 28 17:12:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:25 user nova-compute[75246]: INFO nova.compute.manager [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Took 6.61 seconds to spawn the instance on the hypervisor.
Nov 28 17:12:25 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:12:25 user nova-compute[75246]: INFO nova.compute.manager [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Took 7.77 seconds to build instance.
Nov 28 17:12:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a778949-a140-40e5-bcd9-fab32056054f tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.879s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-18307773-0735-4972-9d25-4430cc80a5a2 req-95d3cc82-5510-486d-a3e2-fbeec2230706 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received event network-vif-unplugged-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-18307773-0735-4972-9d25-4430cc80a5a2 req-95d3cc82-5510-486d-a3e2-fbeec2230706 service nova] Acquiring lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-18307773-0735-4972-9d25-4430cc80a5a2 req-95d3cc82-5510-486d-a3e2-fbeec2230706 service nova] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-18307773-0735-4972-9d25-4430cc80a5a2 req-95d3cc82-5510-486d-a3e2-fbeec2230706 service nova] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-18307773-0735-4972-9d25-4430cc80a5a2 req-95d3cc82-5510-486d-a3e2-fbeec2230706 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] No waiting events found dispatching network-vif-unplugged-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:25 user nova-compute[75246]: WARNING nova.compute.manager [req-18307773-0735-4972-9d25-4430cc80a5a2 req-95d3cc82-5510-486d-a3e2-fbeec2230706 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received unexpected event network-vif-unplugged-cadf851f-d826-43fb-984d-4f15cafa5f64 for instance with vm_state active and task_state reboot_started.
Nov 28 17:12:25 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-1fdaa5a7-e9f0-4969-8b73-b45c7e892b00 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Instance shutdown successfully.
Nov 28 17:12:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:27 user nova-compute[75246]: DEBUG nova.compute.manager [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received event network-vif-plugged-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] Acquiring lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:27 user nova-compute[75246]: DEBUG nova.compute.manager [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] No waiting events found dispatching network-vif-plugged-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:27 user nova-compute[75246]: WARNING nova.compute.manager [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received unexpected event network-vif-plugged-cadf851f-d826-43fb-984d-4f15cafa5f64 for instance with vm_state active and task_state reboot_started.
Nov 28 17:12:27 user nova-compute[75246]: DEBUG nova.compute.manager [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-changed-204beaa6-93fe-477c-a9c6-9682ad9f95ef {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:27 user nova-compute[75246]: DEBUG nova.compute.manager [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Refreshing instance network info cache due to event network-changed-204beaa6-93fe-477c-a9c6-9682ad9f95ef. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:12:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] Acquiring lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:12:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] Acquired lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:12:27 user nova-compute[75246]: DEBUG nova.network.neutron [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Refreshing network info cache for port 204beaa6-93fe-477c-a9c6-9682ad9f95ef {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:12:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:28 user nova-compute[75246]: DEBUG nova.network.neutron [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Updated VIF entry in instance network info cache for port 204beaa6-93fe-477c-a9c6-9682ad9f95ef. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:12:28 user nova-compute[75246]: DEBUG nova.network.neutron [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Updating instance_info_cache with network_info: [{"id": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "address": "fa:16:3e:54:fe:1f", "network": {"id": "544b007d-d4e9-4bdf-b20a-0d680ffc4922", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1651046378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204beaa6-93", "ovs_interfaceid": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "address": "fa:16:3e:86:6c:fd", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7e4bce-23", "ovs_interfaceid": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "address": "fa:16:3e:84:ca:5e", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3decefbc-a2", "ovs_interfaceid": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "address": "fa:16:3e:7f:22:59", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb198a574-6f", "ovs_interfaceid": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "address": "fa:16:3e:c6:36:3f", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7895e4b8-04", "ovs_interfaceid": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f31d8039-9a73-4288-813c-fb13de3d2a12", "address": "fa:16:3e:7d:b9:0d", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31d8039-9a", "ovs_interfaceid": "f31d8039-9a73-4288-813c-fb13de3d2a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "address": "fa:16:3e:5c:ef:c4", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcb1e63-1b", "ovs_interfaceid": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:12:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] Releasing lock "refresh_cache-8ae64996-670b-4179-9280-27fa7141a8d1" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:12:28 user nova-compute[75246]: DEBUG nova.compute.manager [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received event network-vif-plugged-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] Acquiring lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:28 user nova-compute[75246]: DEBUG nova.compute.manager [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] No waiting events found dispatching network-vif-plugged-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:28 user nova-compute[75246]: WARNING nova.compute.manager [req-e7f6a8d5-f8f5-46ba-967b-b90f50f1b914 req-50d9d835-fade-4328-a3f1-6956b5dd8eb0 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received unexpected event network-vif-plugged-cadf851f-d826-43fb-984d-4f15cafa5f64 for instance with vm_state active and task_state reboot_started.
Nov 28 17:12:29 user nova-compute[75246]: DEBUG nova.compute.manager [req-f390d7f1-aac4-4bab-b8c1-a99f8657f609 req-1f861c67-52b1-4f91-8fb9-bc9bb58bc668 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received event network-vif-plugged-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f390d7f1-aac4-4bab-b8c1-a99f8657f609 req-1f861c67-52b1-4f91-8fb9-bc9bb58bc668 service nova] Acquiring lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f390d7f1-aac4-4bab-b8c1-a99f8657f609 req-1f861c67-52b1-4f91-8fb9-bc9bb58bc668 service nova] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f390d7f1-aac4-4bab-b8c1-a99f8657f609 req-1f861c67-52b1-4f91-8fb9-bc9bb58bc668 service nova] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:29 user nova-compute[75246]: DEBUG nova.compute.manager [req-f390d7f1-aac4-4bab-b8c1-a99f8657f609 req-1f861c67-52b1-4f91-8fb9-bc9bb58bc668 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] No waiting events found dispatching network-vif-plugged-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:29 user nova-compute[75246]: WARNING nova.compute.manager [req-f390d7f1-aac4-4bab-b8c1-a99f8657f609 req-1f861c67-52b1-4f91-8fb9-bc9bb58bc668 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received unexpected event network-vif-plugged-cadf851f-d826-43fb-984d-4f15cafa5f64 for instance with vm_state active and task_state reboot_started.
Nov 28 17:12:29 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Instance running successfully.
Nov 28 17:12:29 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-1fdaa5a7-e9f0-4969-8b73-b45c7e892b00 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Instance soft rebooted successfully.
Nov 28 17:12:29 user nova-compute[75246]: DEBUG nova.compute.manager [None req-1fdaa5a7-e9f0-4969-8b73-b45c7e892b00 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:12:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1fdaa5a7-e9f0-4969-8b73-b45c7e892b00 tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.687s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "8ae64996-670b-4179-9280-27fa7141a8d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:29 user nova-compute[75246]: INFO nova.compute.manager [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Terminating instance
Nov 28 17:12:29 user nova-compute[75246]: DEBUG nova.compute.manager [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:12:29 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-62ce8ad2-828a-49d0-a28a-ae110273ffb9 req-29f2e955-24f3-4924-a1af-8b05b95f113d service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-unplugged-204beaa6-93fe-477c-a9c6-9682ad9f95ef {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-62ce8ad2-828a-49d0-a28a-ae110273ffb9 req-29f2e955-24f3-4924-a1af-8b05b95f113d service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-62ce8ad2-828a-49d0-a28a-ae110273ffb9 req-29f2e955-24f3-4924-a1af-8b05b95f113d service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-62ce8ad2-828a-49d0-a28a-ae110273ffb9 req-29f2e955-24f3-4924-a1af-8b05b95f113d service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-62ce8ad2-828a-49d0-a28a-ae110273ffb9 req-29f2e955-24f3-4924-a1af-8b05b95f113d service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-unplugged-204beaa6-93fe-477c-a9c6-9682ad9f95ef {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-62ce8ad2-828a-49d0-a28a-ae110273ffb9 req-29f2e955-24f3-4924-a1af-8b05b95f113d service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-unplugged-204beaa6-93fe-477c-a9c6-9682ad9f95ef for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:30 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG nova.compute.manager [req-6f64e251-cbac-4826-bba6-f79ae9f82b7e req-eef8a0f8-d7f4-419b-b7a4-2f93265bf650 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-unplugged-7895e4b8-0496-479c-8ccd-1de0613b1c19 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6f64e251-cbac-4826-bba6-f79ae9f82b7e req-eef8a0f8-d7f4-419b-b7a4-2f93265bf650 service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6f64e251-cbac-4826-bba6-f79ae9f82b7e req-eef8a0f8-d7f4-419b-b7a4-2f93265bf650 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6f64e251-cbac-4826-bba6-f79ae9f82b7e req-eef8a0f8-d7f4-419b-b7a4-2f93265bf650 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.012s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG nova.compute.manager [req-6f64e251-cbac-4826-bba6-f79ae9f82b7e req-eef8a0f8-d7f4-419b-b7a4-2f93265bf650 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-unplugged-7895e4b8-0496-479c-8ccd-1de0613b1c19 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG nova.compute.manager [req-6f64e251-cbac-4826-bba6-f79ae9f82b7e req-eef8a0f8-d7f4-419b-b7a4-2f93265bf650 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-unplugged-7895e4b8-0496-479c-8ccd-1de0613b1c19 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG nova.compute.manager [req-6f64e251-cbac-4826-bba6-f79ae9f82b7e req-eef8a0f8-d7f4-419b-b7a4-2f93265bf650 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-7895e4b8-0496-479c-8ccd-1de0613b1c19 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6f64e251-cbac-4826-bba6-f79ae9f82b7e req-eef8a0f8-d7f4-419b-b7a4-2f93265bf650 service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6f64e251-cbac-4826-bba6-f79ae9f82b7e req-eef8a0f8-d7f4-419b-b7a4-2f93265bf650 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6f64e251-cbac-4826-bba6-f79ae9f82b7e req-eef8a0f8-d7f4-419b-b7a4-2f93265bf650 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG nova.compute.manager [req-6f64e251-cbac-4826-bba6-f79ae9f82b7e req-eef8a0f8-d7f4-419b-b7a4-2f93265bf650 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-7895e4b8-0496-479c-8ccd-1de0613b1c19 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:31 user nova-compute[75246]: WARNING nova.compute.manager [req-6f64e251-cbac-4826-bba6-f79ae9f82b7e req-eef8a0f8-d7f4-419b-b7a4-2f93265bf650 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-7895e4b8-0496-479c-8ccd-1de0613b1c19 for instance with vm_state active and task_state deleting.
Nov 28 17:12:31 user nova-compute[75246]: DEBUG nova.compute.manager [req-6f64e251-cbac-4826-bba6-f79ae9f82b7e req-eef8a0f8-d7f4-419b-b7a4-2f93265bf650 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-unplugged-f31d8039-9a73-4288-813c-fb13de3d2a12 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6f64e251-cbac-4826-bba6-f79ae9f82b7e req-eef8a0f8-d7f4-419b-b7a4-2f93265bf650 service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6f64e251-cbac-4826-bba6-f79ae9f82b7e req-eef8a0f8-d7f4-419b-b7a4-2f93265bf650 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6f64e251-cbac-4826-bba6-f79ae9f82b7e req-eef8a0f8-d7f4-419b-b7a4-2f93265bf650 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG nova.compute.manager [req-6f64e251-cbac-4826-bba6-f79ae9f82b7e req-eef8a0f8-d7f4-419b-b7a4-2f93265bf650 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-unplugged-f31d8039-9a73-4288-813c-fb13de3d2a12 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG nova.compute.manager [req-6f64e251-cbac-4826-bba6-f79ae9f82b7e req-eef8a0f8-d7f4-419b-b7a4-2f93265bf650 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-unplugged-f31d8039-9a73-4288-813c-fb13de3d2a12 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:12:31 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Instance destroyed successfully.
Nov 28 17:12:31 user nova-compute[75246]: DEBUG nova.objects.instance [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lazy-loading 'resources' on Instance uuid 8ae64996-670b-4179-9280-27fa7141a8d1 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:12:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "address": "fa:16:3e:54:fe:1f", "network": {"id": "544b007d-d4e9-4bdf-b20a-0d680ffc4922", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1651046378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204beaa6-93", "ovs_interfaceid": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "address": "fa:16:3e:54:fe:1f", "network": {"id": "544b007d-d4e9-4bdf-b20a-0d680ffc4922", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1651046378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204beaa6-93", "ovs_interfaceid": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:fe:1f,bridge_name='br-int',has_traffic_filtering=True,id=204beaa6-93fe-477c-a9c6-9682ad9f95ef,network=Network(544b007d-d4e9-4bdf-b20a-0d680ffc4922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204beaa6-93') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG os_vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:fe:1f,bridge_name='br-int',has_traffic_filtering=True,id=204beaa6-93fe-477c-a9c6-9682ad9f95ef,network=Network(544b007d-d4e9-4bdf-b20a-0d680ffc4922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204beaa6-93') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap204beaa6-93, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9832d146-b4c1-4cec-bc2b-4bfacd12b94f) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: INFO os_vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:fe:1f,bridge_name='br-int',has_traffic_filtering=True,id=204beaa6-93fe-477c-a9c6-9682ad9f95ef,network=Network(544b007d-d4e9-4bdf-b20a-0d680ffc4922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204beaa6-93')
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "address": "fa:16:3e:86:6c:fd", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7e4bce-23", "ovs_interfaceid": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "address": "fa:16:3e:86:6c:fd", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7e4bce-23", "ovs_interfaceid": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:6c:fd,bridge_name='br-int',has_traffic_filtering=True,id=bd7e4bce-235e-41c2-88c5-b042af4b50bf,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd7e4bce-23') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG os_vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:6c:fd,bridge_name='br-int',has_traffic_filtering=True,id=bd7e4bce-235e-41c2-88c5-b042af4b50bf,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd7e4bce-23') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd7e4bce-23, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9865e1fd-21fb-49c7-b5b5-4806629d488c) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: INFO os_vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:6c:fd,bridge_name='br-int',has_traffic_filtering=True,id=bd7e4bce-235e-41c2-88c5-b042af4b50bf,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd7e4bce-23')
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "address": "fa:16:3e:84:ca:5e", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3decefbc-a2", "ovs_interfaceid": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "address": "fa:16:3e:84:ca:5e", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3decefbc-a2", "ovs_interfaceid": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ca:5e,bridge_name='br-int',has_traffic_filtering=True,id=3decefbc-a21c-466b-bf11-1ea7fe421a89,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3decefbc-a2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG os_vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ca:5e,bridge_name='br-int',has_traffic_filtering=True,id=3decefbc-a21c-466b-bf11-1ea7fe421a89,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3decefbc-a2') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3decefbc-a2, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a521146-0f7d-406f-a002-04cf08ee36b2) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: INFO os_vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ca:5e,bridge_name='br-int',has_traffic_filtering=True,id=3decefbc-a21c-466b-bf11-1ea7fe421a89,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3decefbc-a2')
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "address": "fa:16:3e:7f:22:59", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb198a574-6f", "ovs_interfaceid": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "address": "fa:16:3e:7f:22:59", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb198a574-6f", "ovs_interfaceid": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:22:59,bridge_name='br-int',has_traffic_filtering=True,id=b198a574-6fe0-47d1-90c2-98ffe1c7c1bc,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb198a574-6f') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG os_vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:22:59,bridge_name='br-int',has_traffic_filtering=True,id=b198a574-6fe0-47d1-90c2-98ffe1c7c1bc,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb198a574-6f') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb198a574-6f, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12187eb2-9498-4d8c-881f-a9cd2d7a4cc9) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: INFO os_vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:22:59,bridge_name='br-int',has_traffic_filtering=True,id=b198a574-6fe0-47d1-90c2-98ffe1c7c1bc,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb198a574-6f')
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "address": "fa:16:3e:c6:36:3f", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7895e4b8-04", "ovs_interfaceid": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "address": "fa:16:3e:c6:36:3f", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7895e4b8-04", "ovs_interfaceid": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:36:3f,bridge_name='br-int',has_traffic_filtering=True,id=7895e4b8-0496-479c-8ccd-1de0613b1c19,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7895e4b8-04') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG os_vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:36:3f,bridge_name='br-int',has_traffic_filtering=True,id=7895e4b8-0496-479c-8ccd-1de0613b1c19,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7895e4b8-04') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7895e4b8-04, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-204beaa6-93fe-477c-a9c6-9682ad9f95ef {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-204beaa6-93fe-477c-a9c6-9682ad9f95ef {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:32 user nova-compute[75246]: WARNING nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-204beaa6-93fe-477c-a9c6-9682ad9f95ef for instance with vm_state active and task_state deleting.
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-unplugged-bd7e4bce-235e-41c2-88c5-b042af4b50bf {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-unplugged-bd7e4bce-235e-41c2-88c5-b042af4b50bf {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-unplugged-bd7e4bce-235e-41c2-88c5-b042af4b50bf for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-bd7e4bce-235e-41c2-88c5-b042af4b50bf {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-bd7e4bce-235e-41c2-88c5-b042af4b50bf {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:32 user nova-compute[75246]: WARNING nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-bd7e4bce-235e-41c2-88c5-b042af4b50bf for instance with vm_state active and task_state deleting.
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-unplugged-3decefbc-a21c-466b-bf11-1ea7fe421a89 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-unplugged-3decefbc-a21c-466b-bf11-1ea7fe421a89 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-unplugged-3decefbc-a21c-466b-bf11-1ea7fe421a89 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-3decefbc-a21c-466b-bf11-1ea7fe421a89 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-3decefbc-a21c-466b-bf11-1ea7fe421a89 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:32 user nova-compute[75246]: WARNING nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-3decefbc-a21c-466b-bf11-1ea7fe421a89 for instance with vm_state active and task_state deleting.
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-unplugged-b198a574-6fe0-47d1-90c2-98ffe1c7c1bc {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-unplugged-b198a574-6fe0-47d1-90c2-98ffe1c7c1bc {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-unplugged-b198a574-6fe0-47d1-90c2-98ffe1c7c1bc for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-b198a574-6fe0-47d1-90c2-98ffe1c7c1bc {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-b198a574-6fe0-47d1-90c2-98ffe1c7c1bc {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:32 user nova-compute[75246]: WARNING nova.compute.manager [req-710e7540-526d-4a3e-b18c-3bb5ba2ec9a3 req-67a8119e-9827-41b7-9226-571b5ca43267 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-b198a574-6fe0-47d1-90c2-98ffe1c7c1bc for instance with vm_state active and task_state deleting.
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2ea469b-a96b-4287-a27d-4b912f40cd4c) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: INFO os_vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:36:3f,bridge_name='br-int',has_traffic_filtering=True,id=7895e4b8-0496-479c-8ccd-1de0613b1c19,network=Network(5c4656c9-a955-400a-afa4-786678aa89e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7895e4b8-04')
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f31d8039-9a73-4288-813c-fb13de3d2a12", "address": "fa:16:3e:7d:b9:0d", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31d8039-9a", "ovs_interfaceid": "f31d8039-9a73-4288-813c-fb13de3d2a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "f31d8039-9a73-4288-813c-fb13de3d2a12", "address": "fa:16:3e:7d:b9:0d", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31d8039-9a", "ovs_interfaceid": "f31d8039-9a73-4288-813c-fb13de3d2a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=f31d8039-9a73-4288-813c-fb13de3d2a12,network=Network(5322f285-a4cc-4a45-a4f6-8b97dca86962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31d8039-9a') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG os_vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=f31d8039-9a73-4288-813c-fb13de3d2a12,network=Network(5322f285-a4cc-4a45-a4f6-8b97dca86962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31d8039-9a') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf31d8039-9a, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=179d1a16-06fe-4ce5-9d27-0ccbaa30e49d) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: INFO os_vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=f31d8039-9a73-4288-813c-fb13de3d2a12,network=Network(5322f285-a4cc-4a45-a4f6-8b97dca86962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf31d8039-9a')
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T17:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101189537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101189537',id=25,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkTI1pTpv7J14YqHDwPPxD87+0piTpZgK3U/ETK6/ls41ROnjB040J/k14IuBdaGHVFBpI2m3n2MG8KmBlqDSVSgb+1M4ior4MrjL58GYwAdO0ymUcBg8xutqwVgGPHlg==',key_name='tempest-keypair-1373218613',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e3144ba262d42ac98ac03dc7052e8ae',ramdisk_id='',reservation_id='r-c40byu72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1843849941',owner_user_name='tempest-TaggedBootDevicesTest-1843849941-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9da5fcd6e6e24f0aaddfbeb5ad34cb17',uuid=8ae64996-670b-4179-9280-27fa7141a8d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "address": "fa:16:3e:5c:ef:c4", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcb1e63-1b", "ovs_interfaceid": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converting VIF {"id": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "address": "fa:16:3e:5c:ef:c4", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fcb1e63-1b", "ovs_interfaceid": "1fcb1e63-1b0b-4c45-9fda-200b1fd719c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ef:c4,bridge_name='br-int',has_traffic_filtering=True,id=1fcb1e63-1b0b-4c45-9fda-200b1fd719c5,network=Network(5322f285-a4cc-4a45-a4f6-8b97dca86962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fcb1e63-1b') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG os_vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ef:c4,bridge_name='br-int',has_traffic_filtering=True,id=1fcb1e63-1b0b-4c45-9fda-200b1fd719c5,network=Network(5322f285-a4cc-4a45-a4f6-8b97dca86962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fcb1e63-1b') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fcb1e63-1b, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=718b80f0-8904-4ee0-b562-7f7abb033718) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:12:32 user nova-compute[75246]: INFO os_vif [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ef:c4,bridge_name='br-int',has_traffic_filtering=True,id=1fcb1e63-1b0b-4c45-9fda-200b1fd719c5,network=Network(5322f285-a4cc-4a45-a4f6-8b97dca86962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fcb1e63-1b')
Nov 28 17:12:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdICwYHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:12:32 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:12:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a7bfcd-4995-4679-9e20-06f6dbd5b6b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:12:32 user nova-compute[75246]: No targets found.
Nov 28 17:12:32 user nova-compute[75246]: iSNS:
Nov 28 17:12:32 user nova-compute[75246]: No targets found.
Nov 28 17:12:32 user nova-compute[75246]: STATIC:
Nov 28 17:12:32 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95
Nov 28 17:12:32 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:12:32 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:12:32 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b
Nov 28 17:12:32 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:12:32 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:12:32 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9
Nov 28 17:12:32 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:12:32 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:12:32 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf
Nov 28 17:12:32 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:12:32 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:12:32 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a
Nov 28 17:12:32 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:12:32 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:12:32 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3
Nov 28 17:12:32 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:12:32 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:12:32 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d
Nov 28 17:12:32 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:12:32 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:12:32 user nova-compute[75246]: FIRMWARE:
Nov 28 17:12:32 user nova-compute[75246]: No targets found.
Nov 28 17:12:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:12:32 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:12:32 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbda36d-74d0-47d6-9050-01ecfa5e8103]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9673834-2334-4fa3-be9d-a46d4e415470]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:12:32 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:12:32 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:12:32 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:12:32 user nova-compute[75246]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:12:32 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:12:32 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:12:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:12:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b (non-flash)
Nov 28 17:12:32 user nova-compute[75246]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:12:32 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:12:32 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:12:32 user nova-compute[75246]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:12:32 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:12:32 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:12:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d8136ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b'): ({'sdb'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Removing single pathed devices sdb {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.047s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ed8162-6b9d-4fd4-bee7-8fdb050f066e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[644914a1-21bd-4b72-9468-5704669fa64c]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Flushing IO for device /dev/sdb {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a849bde-2c70-41c3-bffb-3bab8db3f53f]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ece6a5f-9fba-47c0-92da-86f51eb2003f]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87ca777-a752-4bb4-bc9a-72067d3aad0a]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --logout" returned: 0 in 0.105s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e936d83-7d8c-4969-94ed-97d63d5a34e1]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b, portal: 172.16.0.220,3260]
Nov 28 17:12:33 user nova-compute[75246]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b, portal: 172.16.0.220,3260] successful.
Nov 28 17:12:33 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc02ace1-85f5-476c-8300-f15e2555272b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[947657f5-33d2-4d7a-957f-009cb4860e45]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.489s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] <== disconnect_volume: return (492ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XSquVioC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:12:33 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b543bc0-0a2e-4d0a-88ef-3255d46b6568]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:12:33 user nova-compute[75246]: No targets found.
Nov 28 17:12:33 user nova-compute[75246]: iSNS:
Nov 28 17:12:33 user nova-compute[75246]: No targets found.
Nov 28 17:12:33 user nova-compute[75246]: STATIC:
Nov 28 17:12:33 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95
Nov 28 17:12:33 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:12:33 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:12:33 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9
Nov 28 17:12:33 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:12:33 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:12:33 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf
Nov 28 17:12:33 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:12:33 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:12:33 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a
Nov 28 17:12:33 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:12:33 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:12:33 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3
Nov 28 17:12:33 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:12:33 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:12:33 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d
Nov 28 17:12:33 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:12:33 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:12:33 user nova-compute[75246]: FIRMWARE:
Nov 28 17:12:33 user nova-compute[75246]: No targets found.
Nov 28 17:12:33 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:12:33 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:12:33 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3485a3-2ffa-4040-865e-e39daa9e3e83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34196f9-543e-484a-8b11-43077e67c66e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:12:33 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:12:33 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:12:33 user nova-compute[75246]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:12:33 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:12:33 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:12:33 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 (non-flash)
Nov 28 17:12:33 user nova-compute[75246]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:12:33 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:12:33 user nova-compute[75246]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:12:33 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:12:33 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:12:33 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d8136ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9'): ({'sdc'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Removing single pathed devices sdc {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4610187e-354a-4ea8-9dc4-2a2eff25d6fc]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a11df6-049f-48ca-a8db-2a03327adf84]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Flushing IO for device /dev/sdc {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a0dc0c-5617-4c59-8282-a5281b7c3d3b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8d9b73-d135-4d2d-8959-49027a1cb4ac]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9994d747-0f09-4a4b-8242-f33c69532c76]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdbc9972-fa4b-4172-b540-1996af1b79fe/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a01b7e-b172-461a-ba7d-382960eddd92]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9, portal: 172.16.0.220,3260]
Nov 28 17:12:33 user nova-compute[75246]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9, portal: 172.16.0.220,3260] successful.
Nov 28 17:12:33 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6e8e13-9a7b-4372-9027-7fe6e58641e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2eab15-8a6f-4140-a7ed-4242bb4415fd]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] <== disconnect_volume: return (371ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvLTdmUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:12:33 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e9e32f-9a7c-483d-b5f0-18ce57636b2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:12:33 user nova-compute[75246]: No targets found.
Nov 28 17:12:33 user nova-compute[75246]: iSNS:
Nov 28 17:12:33 user nova-compute[75246]: No targets found.
Nov 28 17:12:33 user nova-compute[75246]: STATIC:
Nov 28 17:12:33 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95
Nov 28 17:12:33 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:12:33 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:12:33 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf
Nov 28 17:12:33 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:12:33 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:12:33 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a
Nov 28 17:12:33 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:12:33 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:12:33 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3
Nov 28 17:12:33 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:12:33 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:12:33 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d
Nov 28 17:12:33 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:12:33 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:12:33 user nova-compute[75246]: FIRMWARE:
Nov 28 17:12:33 user nova-compute[75246]: No targets found.
Nov 28 17:12:33 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:12:33 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:12:33 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b74ef13-63dc-4bdb-b743-ec44475f3b92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f96bc19-1308-4b94-9196-5af90ab5eb15]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:12:33 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:12:33 user nova-compute[75246]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:12:33 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:12:33 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:12:33 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 (non-flash)
Nov 28 17:12:33 user nova-compute[75246]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:12:33 user nova-compute[75246]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:12:33 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:12:33 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:12:33 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d8136ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95'): ({'sdd'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Removing single pathed devices sdd {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdbc9972-fa4b-4172-b540-1996af1b79fe/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdbc9972-fa4b-4172-b540-1996af1b79fe/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3895580e-b519-4044-92a9-0df5f3bcf230]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a5799c-ce45-4bb3-922d-af6b053e5077]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Flushing IO for device /dev/sdd {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[778483a6-310e-4083-a22c-bd4433d62c4d]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:12:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-e14a32df-8653-4bf7-a821-51cd4b98f925 req-53e26503-46b9-4bc9-b20f-44a38002f3d8 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-f31d8039-9a73-4288-813c-fb13de3d2a12 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e14a32df-8653-4bf7-a821-51cd4b98f925 req-53e26503-46b9-4bc9-b20f-44a38002f3d8 service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e14a32df-8653-4bf7-a821-51cd4b98f925 req-53e26503-46b9-4bc9-b20f-44a38002f3d8 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e14a32df-8653-4bf7-a821-51cd4b98f925 req-53e26503-46b9-4bc9-b20f-44a38002f3d8 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-e14a32df-8653-4bf7-a821-51cd4b98f925 req-53e26503-46b9-4bc9-b20f-44a38002f3d8 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-f31d8039-9a73-4288-813c-fb13de3d2a12 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:34 user nova-compute[75246]: WARNING nova.compute.manager [req-e14a32df-8653-4bf7-a821-51cd4b98f925 req-53e26503-46b9-4bc9-b20f-44a38002f3d8 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-f31d8039-9a73-4288-813c-fb13de3d2a12 for instance with vm_state active and task_state deleting.
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[698ca60a-44cd-4990-a27b-966fb768548e]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[196d5988-4c1a-4ebb-a646-a8775f0e119b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdbc9972-fa4b-4172-b540-1996af1b79fe/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88fea6c-de29-436b-bacc-b2236bcb8ec9]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95, portal: 172.16.0.220,3260]
Nov 28 17:12:34 user nova-compute[75246]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95, portal: 172.16.0.220,3260] successful.
Nov 28 17:12:34 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cece48-a518-4bf3-b1e6-8d98ecb74b95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[107771eb-ac8f-4eb9-92d7-14f7f7a8eda2]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] <== disconnect_volume: return (429ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:12:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Deleting instance files /opt/stack/data/nova/instances/8ae64996-670b-4179-9280-27fa7141a8d1_del
Nov 28 17:12:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Deletion of /opt/stack/data/nova/instances/8ae64996-670b-4179-9280-27fa7141a8d1_del complete
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:34 user nova-compute[75246]: INFO nova.compute.manager [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Took 4.41 seconds to destroy the instance on the hypervisor.
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-88dee474-1328-4b44-8b82-9847c204f213 req-94e16a83-c7e2-494a-9513-f79cc5a46045 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-unplugged-1fcb1e63-1b0b-4c45-9fda-200b1fd719c5 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-88dee474-1328-4b44-8b82-9847c204f213 req-94e16a83-c7e2-494a-9513-f79cc5a46045 service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-88dee474-1328-4b44-8b82-9847c204f213 req-94e16a83-c7e2-494a-9513-f79cc5a46045 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-88dee474-1328-4b44-8b82-9847c204f213 req-94e16a83-c7e2-494a-9513-f79cc5a46045 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-88dee474-1328-4b44-8b82-9847c204f213 req-94e16a83-c7e2-494a-9513-f79cc5a46045 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-unplugged-1fcb1e63-1b0b-4c45-9fda-200b1fd719c5 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-88dee474-1328-4b44-8b82-9847c204f213 req-94e16a83-c7e2-494a-9513-f79cc5a46045 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-unplugged-1fcb1e63-1b0b-4c45-9fda-200b1fd719c5 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-88dee474-1328-4b44-8b82-9847c204f213 req-94e16a83-c7e2-494a-9513-f79cc5a46045 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-plugged-1fcb1e63-1b0b-4c45-9fda-200b1fd719c5 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-88dee474-1328-4b44-8b82-9847c204f213 req-94e16a83-c7e2-494a-9513-f79cc5a46045 service nova] Acquiring lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-88dee474-1328-4b44-8b82-9847c204f213 req-94e16a83-c7e2-494a-9513-f79cc5a46045 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-88dee474-1328-4b44-8b82-9847c204f213 req-94e16a83-c7e2-494a-9513-f79cc5a46045 service nova] Lock "8ae64996-670b-4179-9280-27fa7141a8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-88dee474-1328-4b44-8b82-9847c204f213 req-94e16a83-c7e2-494a-9513-f79cc5a46045 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] No waiting events found dispatching network-vif-plugged-1fcb1e63-1b0b-4c45-9fda-200b1fd719c5 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:12:34 user nova-compute[75246]: WARNING nova.compute.manager [req-88dee474-1328-4b44-8b82-9847c204f213 req-94e16a83-c7e2-494a-9513-f79cc5a46045 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received unexpected event network-vif-plugged-1fcb1e63-1b0b-4c45-9fda-200b1fd719c5 for instance with vm_state active and task_state deleting.
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:34 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Error from libvirt while getting description of instance-00000019: [Error Code 42] Domain not found: no domain with matching uuid '8ae64996-670b-4179-9280-27fa7141a8d1' (instance-00000019): libvirt.libvirtError: Domain not found: no domain with matching uuid '8ae64996-670b-4179-9280-27fa7141a8d1' (instance-00000019)
Nov 28 17:12:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:12:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:12:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-a6725e42-1e09-45e4-a77b-ccdf6a57a383 req-48417a25-d448-4f85-9319-c60aa942ceb6 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-deleted-1fcb1e63-1b0b-4c45-9fda-200b1fd719c5 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:36 user nova-compute[75246]: INFO nova.compute.manager [req-a6725e42-1e09-45e4-a77b-ccdf6a57a383 req-48417a25-d448-4f85-9319-c60aa942ceb6 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Neutron deleted interface 1fcb1e63-1b0b-4c45-9fda-200b1fd719c5; detaching it from the instance and deleting it from the info cache
Nov 28 17:12:36 user nova-compute[75246]: DEBUG nova.network.neutron [req-a6725e42-1e09-45e4-a77b-ccdf6a57a383 req-48417a25-d448-4f85-9319-c60aa942ceb6 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Updating instance_info_cache with network_info: [{"id": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "address": "fa:16:3e:54:fe:1f", "network": {"id": "544b007d-d4e9-4bdf-b20a-0d680ffc4922", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1651046378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204beaa6-93", "ovs_interfaceid": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "address": "fa:16:3e:86:6c:fd", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7e4bce-23", "ovs_interfaceid": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "address": "fa:16:3e:84:ca:5e", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3decefbc-a2", "ovs_interfaceid": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "address": "fa:16:3e:7f:22:59", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb198a574-6f", "ovs_interfaceid": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "address": "fa:16:3e:c6:36:3f", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7895e4b8-04", "ovs_interfaceid": "7895e4b8-0496-479c-8ccd-1de0613b1c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f31d8039-9a73-4288-813c-fb13de3d2a12", "address": "fa:16:3e:7d:b9:0d", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31d8039-9a", "ovs_interfaceid": "f31d8039-9a73-4288-813c-fb13de3d2a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:12:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-a6725e42-1e09-45e4-a77b-ccdf6a57a383 req-48417a25-d448-4f85-9319-c60aa942ceb6 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Detach interface failed, port_id=1fcb1e63-1b0b-4c45-9fda-200b1fd719c5, reason: Instance 8ae64996-670b-4179-9280-27fa7141a8d1 could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:12:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-a6725e42-1e09-45e4-a77b-ccdf6a57a383 req-48417a25-d448-4f85-9319-c60aa942ceb6 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-deleted-7895e4b8-0496-479c-8ccd-1de0613b1c19 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:36 user nova-compute[75246]: INFO nova.compute.manager [req-a6725e42-1e09-45e4-a77b-ccdf6a57a383 req-48417a25-d448-4f85-9319-c60aa942ceb6 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Neutron deleted interface 7895e4b8-0496-479c-8ccd-1de0613b1c19; detaching it from the instance and deleting it from the info cache
Nov 28 17:12:36 user nova-compute[75246]: DEBUG nova.network.neutron [req-a6725e42-1e09-45e4-a77b-ccdf6a57a383 req-48417a25-d448-4f85-9319-c60aa942ceb6 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Updating instance_info_cache with network_info: [{"id": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "address": "fa:16:3e:54:fe:1f", "network": {"id": "544b007d-d4e9-4bdf-b20a-0d680ffc4922", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1651046378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204beaa6-93", "ovs_interfaceid": "204beaa6-93fe-477c-a9c6-9682ad9f95ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "address": "fa:16:3e:86:6c:fd", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7e4bce-23", "ovs_interfaceid": "bd7e4bce-235e-41c2-88c5-b042af4b50bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "address": "fa:16:3e:84:ca:5e", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3decefbc-a2", "ovs_interfaceid": "3decefbc-a21c-466b-bf11-1ea7fe421a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "address": "fa:16:3e:7f:22:59", "network": {"id": "5c4656c9-a955-400a-afa4-786678aa89e1", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326087120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb198a574-6f", "ovs_interfaceid": "b198a574-6fe0-47d1-90c2-98ffe1c7c1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f31d8039-9a73-4288-813c-fb13de3d2a12", "address": "fa:16:3e:7d:b9:0d", "network": {"id": "5322f285-a4cc-4a45-a4f6-8b97dca86962", "bridge": "br-int", "label": "tempest-device-tagging-net2-1629956377", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e3144ba262d42ac98ac03dc7052e8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf31d8039-9a", "ovs_interfaceid": "f31d8039-9a73-4288-813c-fb13de3d2a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:12:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG nova.compute.manager [req-a6725e42-1e09-45e4-a77b-ccdf6a57a383 req-48417a25-d448-4f85-9319-c60aa942ceb6 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Detach interface failed, port_id=7895e4b8-0496-479c-8ccd-1de0613b1c19, reason: Instance 8ae64996-670b-4179-9280-27fa7141a8d1 could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:12:37 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:12:37 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:12:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=7221MB free_disk=25.36807632446289GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e1266470-c182-4c0c-a575-4c5043f54745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c94900af-f484-47bf-8627-8aa863334b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance aa9ef0b8-3519-416a-b42c-cd953c4ddc0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 36e65da9-4cc0-4d73-9e5d-e64520e08f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 8ae64996-670b-4179-9280-27fa7141a8d1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 0ed72d2a-ca9b-4b99-b422-86fa93af945c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 5c199841-2ce5-4f72-a3f1-6d6d0c746505 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c9abccd6-b64d-4bbf-bdaf-3e3945b04413 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance bdbc9972-fa4b-4172-b540-1996af1b79fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 620ce71b-8ce0-492a-ac7e-72dd12987bfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 90829136-472b-4c45-9607-c28433d05f56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 1d3f57d8-3580-4c42-8a4c-cef210e19eb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:37 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:12:38 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:12:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:12:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.697s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:38 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:12:38 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Took 4.05 seconds to deallocate network for instance.
Nov 28 17:12:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-511cd1a5-1b71-47e9-81e6-d67ccb3ca7e9 req-cf211a63-043e-41c1-a5b9-bf5e2798de21 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-deleted-f31d8039-9a73-4288-813c-fb13de3d2a12 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-511cd1a5-1b71-47e9-81e6-d67ccb3ca7e9 req-cf211a63-043e-41c1-a5b9-bf5e2798de21 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-deleted-b198a574-6fe0-47d1-90c2-98ffe1c7c1bc {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-511cd1a5-1b71-47e9-81e6-d67ccb3ca7e9 req-cf211a63-043e-41c1-a5b9-bf5e2798de21 service nova] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Received event network-vif-deleted-204beaa6-93fe-477c-a9c6-9682ad9f95ef {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:12:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:12:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:12:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Skipping network cache update for instance because it is being deleted. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 28 17:12:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:12:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:12:39 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:12:39 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lazy-loading 'info_cache' on Instance uuid e1266470-c182-4c0c-a575-4c5043f54745 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:12:39 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Updating instance_info_cache with network_info: [{"id": "459bf491-d464-42b1-be6c-282af882a38d", "address": "fa:16:3e:4f:20:c2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459bf491-d4", "ovs_interfaceid": "459bf491-d464-42b1-be6c-282af882a38d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:12:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:12:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:12:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:12:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:12:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:12:40 user nova-compute[75246]: INFO nova.compute.manager [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] [instance: 8ae64996-670b-4179-9280-27fa7141a8d1] Took 2.56 seconds to detach 3 volumes for instance.
Nov 28 17:12:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:41 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:12:41 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:12:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:41 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Deleted allocations for instance 8ae64996-670b-4179-9280-27fa7141a8d1
Nov 28 17:12:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12e42da0-9cd2-4edb-a286-e96d3ae94b96 tempest-TaggedBootDevicesTest-1843849941 tempest-TaggedBootDevicesTest-1843849941-project-member] Lock "8ae64996-670b-4179-9280-27fa7141a8d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.617s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:56 user nova-compute[75246]: DEBUG nova.compute.manager [req-66d9561f-6f4a-474b-9ff3-c6ee1dd99d42 req-c92e853b-142a-4401-ba5f-2d0789bd8310 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Received event network-changed-1e7e447d-e8b6-4a5e-893a-dd06e8818b24 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:56 user nova-compute[75246]: DEBUG nova.compute.manager [req-66d9561f-6f4a-474b-9ff3-c6ee1dd99d42 req-c92e853b-142a-4401-ba5f-2d0789bd8310 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Refreshing instance network info cache due to event network-changed-1e7e447d-e8b6-4a5e-893a-dd06e8818b24. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:12:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-66d9561f-6f4a-474b-9ff3-c6ee1dd99d42 req-c92e853b-142a-4401-ba5f-2d0789bd8310 service nova] Acquiring lock "refresh_cache-0ed72d2a-ca9b-4b99-b422-86fa93af945c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:12:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-66d9561f-6f4a-474b-9ff3-c6ee1dd99d42 req-c92e853b-142a-4401-ba5f-2d0789bd8310 service nova] Acquired lock "refresh_cache-0ed72d2a-ca9b-4b99-b422-86fa93af945c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:12:56 user nova-compute[75246]: DEBUG nova.network.neutron [req-66d9561f-6f4a-474b-9ff3-c6ee1dd99d42 req-c92e853b-142a-4401-ba5f-2d0789bd8310 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Refreshing network info cache for port 1e7e447d-e8b6-4a5e-893a-dd06e8818b24 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:12:57 user nova-compute[75246]: DEBUG nova.network.neutron [req-66d9561f-6f4a-474b-9ff3-c6ee1dd99d42 req-c92e853b-142a-4401-ba5f-2d0789bd8310 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Updated VIF entry in instance network info cache for port 1e7e447d-e8b6-4a5e-893a-dd06e8818b24. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:12:57 user nova-compute[75246]: DEBUG nova.network.neutron [req-66d9561f-6f4a-474b-9ff3-c6ee1dd99d42 req-c92e853b-142a-4401-ba5f-2d0789bd8310 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Updating instance_info_cache with network_info: [{"id": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "address": "fa:16:3e:ef:e7:23", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e447d-e8", "ovs_interfaceid": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:12:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-66d9561f-6f4a-474b-9ff3-c6ee1dd99d42 req-c92e853b-142a-4401-ba5f-2d0789bd8310 service nova] Releasing lock "refresh_cache-0ed72d2a-ca9b-4b99-b422-86fa93af945c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:12:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG nova.objects.instance [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lazy-loading 'flavor' on Instance uuid 0ed72d2a-ca9b-4b99-b422-86fa93af945c {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG nova.compute.manager [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Stashing vm_state: active {{(pid=75246) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:12:58 user nova-compute[75246]: INFO nova.compute.manager [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Attaching volume d7423ede-a02d-448e-87cf-04bf8a20a122 to /dev/vdb
Nov 28 17:12:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:12:58 user nova-compute[75246]: INFO nova.compute.claims [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Claim successful on node user
Nov 28 17:12:58 user nova-compute[75246]: INFO nova.compute.resource_tracker [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Updating resource usage from migration 3a0acfc8-ebd0-4c9e-8eb8-a289b4345e05
Nov 28 17:12:58 user nova-compute[75246]: DEBUG os_brick.utils [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[754297be-241b-4708-a59d-4ea955ef2c44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca49935f-e88b-4772-8625-524ca75443d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd32766-78d4-469b-9764-3f53c7ba6281]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a860857-a9e5-4faf-af62-a9c11506a020]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:12:58 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[886de6b0-644e-45d7-af0d-ca501343b228]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG os_brick.utils [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Updating existing volume attachment record: 08af9d12-46a5-4f69-9a90-4f18affab5bf {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG nova.compute.manager [req-2fccfbd4-2f2b-432d-b29c-82bbbba3f932 req-c0fc54ba-9b2f-4fcc-b47e-7db2f37def28 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Received event network-changed-459bf491-d464-42b1-be6c-282af882a38d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG nova.compute.manager [req-2fccfbd4-2f2b-432d-b29c-82bbbba3f932 req-c0fc54ba-9b2f-4fcc-b47e-7db2f37def28 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Refreshing instance network info cache due to event network-changed-459bf491-d464-42b1-be6c-282af882a38d. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2fccfbd4-2f2b-432d-b29c-82bbbba3f932 req-c0fc54ba-9b2f-4fcc-b47e-7db2f37def28 service nova] Acquiring lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2fccfbd4-2f2b-432d-b29c-82bbbba3f932 req-c0fc54ba-9b2f-4fcc-b47e-7db2f37def28 service nova] Acquired lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG nova.network.neutron [req-2fccfbd4-2f2b-432d-b29c-82bbbba3f932 req-c0fc54ba-9b2f-4fcc-b47e-7db2f37def28 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Refreshing network info cache for port 459bf491-d464-42b1-be6c-282af882a38d {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.530s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:12:58 user nova-compute[75246]: INFO nova.compute.manager [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Migrating
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquired lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:12:58 user nova-compute[75246]: DEBUG nova.network.neutron [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:12:59 user nova-compute[75246]: DEBUG nova.network.neutron [req-2fccfbd4-2f2b-432d-b29c-82bbbba3f932 req-c0fc54ba-9b2f-4fcc-b47e-7db2f37def28 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Updated VIF entry in instance network info cache for port 459bf491-d464-42b1-be6c-282af882a38d. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:12:59 user nova-compute[75246]: DEBUG nova.network.neutron [req-2fccfbd4-2f2b-432d-b29c-82bbbba3f932 req-c0fc54ba-9b2f-4fcc-b47e-7db2f37def28 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Updating instance_info_cache with network_info: [{"id": "459bf491-d464-42b1-be6c-282af882a38d", "address": "fa:16:3e:4f:20:c2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459bf491-d4", "ovs_interfaceid": "459bf491-d464-42b1-be6c-282af882a38d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:12:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2fccfbd4-2f2b-432d-b29c-82bbbba3f932 req-c0fc54ba-9b2f-4fcc-b47e-7db2f37def28 service nova] Releasing lock "refresh_cache-e1266470-c182-4c0c-a575-4c5043f54745" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:12:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-2fccfbd4-2f2b-432d-b29c-82bbbba3f932 req-c0fc54ba-9b2f-4fcc-b47e-7db2f37def28 service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received event network-changed-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:12:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-2fccfbd4-2f2b-432d-b29c-82bbbba3f932 req-c0fc54ba-9b2f-4fcc-b47e-7db2f37def28 service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Refreshing instance network info cache due to event network-changed-3f3c2850-37c8-4c04-a0ae-588a394ac8d9. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:12:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2fccfbd4-2f2b-432d-b29c-82bbbba3f932 req-c0fc54ba-9b2f-4fcc-b47e-7db2f37def28 service nova] Acquiring lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:12:59 user nova-compute[75246]: DEBUG nova.network.neutron [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Updating instance_info_cache with network_info: [{"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:12:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Releasing lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:12:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2fccfbd4-2f2b-432d-b29c-82bbbba3f932 req-c0fc54ba-9b2f-4fcc-b47e-7db2f37def28 service nova] Acquired lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:12:59 user nova-compute[75246]: DEBUG nova.network.neutron [req-2fccfbd4-2f2b-432d-b29c-82bbbba3f932 req-c0fc54ba-9b2f-4fcc-b47e-7db2f37def28 service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Refreshing network info cache for port 3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:12:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Starting migrate_disk_and_power_off {{(pid=75246) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 28 17:12:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:12:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-f38c4644-9350-4a76-93a8-b788b161f89a req-24ec1a6d-edba-4358-8c0a-319a612588ad service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received event network-vif-unplugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f38c4644-9350-4a76-93a8-b788b161f89a req-24ec1a6d-edba-4358-8c0a-319a612588ad service nova] Acquiring lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f38c4644-9350-4a76-93a8-b788b161f89a req-24ec1a6d-edba-4358-8c0a-319a612588ad service nova] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f38c4644-9350-4a76-93a8-b788b161f89a req-24ec1a6d-edba-4358-8c0a-319a612588ad service nova] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-f38c4644-9350-4a76-93a8-b788b161f89a req-24ec1a6d-edba-4358-8c0a-319a612588ad service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] No waiting events found dispatching network-vif-unplugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:13:00 user nova-compute[75246]: WARNING nova.compute.manager [req-f38c4644-9350-4a76-93a8-b788b161f89a req-24ec1a6d-edba-4358-8c0a-319a612588ad service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received unexpected event network-vif-unplugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 for instance with vm_state active and task_state resize_migrating.
Nov 28 17:13:00 user nova-compute[75246]: DEBUG nova.network.neutron [req-2fccfbd4-2f2b-432d-b29c-82bbbba3f932 req-c0fc54ba-9b2f-4fcc-b47e-7db2f37def28 service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Updated VIF entry in instance network info cache for port 3f3c2850-37c8-4c04-a0ae-588a394ac8d9. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG nova.network.neutron [req-2fccfbd4-2f2b-432d-b29c-82bbbba3f932 req-c0fc54ba-9b2f-4fcc-b47e-7db2f37def28 service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Updating instance_info_cache with network_info: [{"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2fccfbd4-2f2b-432d-b29c-82bbbba3f932 req-c0fc54ba-9b2f-4fcc-b47e-7db2f37def28 service nova] Releasing lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:13:00 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Instance destroyed successfully.
Nov 28 17:13:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:11:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-62421813',display_name='tempest-ServerActionsTestOtherA-server-62421813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-62421813',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5QoCu8z1J19YdF2KrIxtAcllUa+54ECbo+7UcXNC+vRRLTiAkI9KGg17d3KrbHvU7U2QxVzma0Ilz+ryH1d5iWfmR7mKkbwqDpkhmRExCuSVuBHZfoiX/4Pew1wkkhqw==',key_name='tempest-keypair-745476775',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:11:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='be06eee4e74a41b799f1df75ea55b955',ramdisk_id='',reservation_id='r-8k4f0rv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1554281978',owner_user_name='tempest-ServerActionsTestOtherA-1554281978-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:12:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39d2eb0837eb4c729fe9ca2964cbe789',uuid=5c199841-2ce5-4f72-a3f1-6d6d0c746505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-852273520-network", "vif_mac": "fa:16:3e:a0:bb:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converting VIF {"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-852273520-network", "vif_mac": "fa:16:3e:a0:bb:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=3f3c2850-37c8-4c04-a0ae-588a394ac8d9,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3c2850-37') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_vif [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=3f3c2850-37c8-4c04-a0ae-588a394ac8d9,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3c2850-37') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f3c2850-37, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d000027-88b4-40eb-9f8f-ae9b93707dd4) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:13:00 user nova-compute[75246]: INFO os_vif [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=3f3c2850-37c8-4c04-a0ae-588a394ac8d9,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3c2850-37')
Nov 28 17:13:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbXCyWfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:13:00 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac428b7-d40f-45ad-94bd-856ded6f100c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:13:00 user nova-compute[75246]: No targets found.
Nov 28 17:13:00 user nova-compute[75246]: iSNS:
Nov 28 17:13:00 user nova-compute[75246]: No targets found.
Nov 28 17:13:00 user nova-compute[75246]: STATIC:
Nov 28 17:13:00 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf
Nov 28 17:13:00 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:13:00 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:13:00 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a
Nov 28 17:13:00 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:13:00 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:13:00 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3
Nov 28 17:13:00 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:13:00 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:13:00 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d
Nov 28 17:13:00 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:13:00 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:13:00 user nova-compute[75246]: FIRMWARE:
Nov 28 17:13:00 user nova-compute[75246]: No targets found.
Nov 28 17:13:00 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:13:00 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:13:00 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[520d5cb4-09ca-49d4-8fd9-c7ebe510dac7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4f4f8b-6ce0-4d9f-9087-10dfaf33689a]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:13:00 user nova-compute[75246]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:13:00 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:13:00 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:13:00 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:13:00 user nova-compute[75246]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:13:00 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:13:00 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:13:00 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d81376d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3'): ({'sde'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Removing single pathed devices sde {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.144s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[694319a5-7fb4-4692-bf33-5f18e962c5f6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1db8b45-fcf5-4788-b3da-57f04432185a]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Flushing IO for device /dev/sde {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd43900-8d73-44b2-ba5e-3f107c33adc5]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1484013d-4f54-4e70-98ce-2df2b2bcf7ef]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] SCSI volumes sde have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cacf530-10ab-4778-b303-087158b168f0]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cb98e2-f0d5-454a-bb6e-8d8011a7b784]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3, portal: 172.16.0.220,3260]
Nov 28 17:13:00 user nova-compute[75246]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3, portal: 172.16.0.220,3260] successful.
Nov 28 17:13:00 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58d3a94-ce0c-472e-b082-8b303474432b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] <== disconnect_volume: return (432ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:13:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:13:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-136beaa9-138e-4b0b-a8e5-25c925710dae req-1836975e-a2aa-4f80-a20c-9d8c58fdce8e service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received event network-vif-plugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:13:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-136beaa9-138e-4b0b-a8e5-25c925710dae req-1836975e-a2aa-4f80-a20c-9d8c58fdce8e service nova] Acquiring lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-136beaa9-138e-4b0b-a8e5-25c925710dae req-1836975e-a2aa-4f80-a20c-9d8c58fdce8e service nova] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-136beaa9-138e-4b0b-a8e5-25c925710dae req-1836975e-a2aa-4f80-a20c-9d8c58fdce8e service nova] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-136beaa9-138e-4b0b-a8e5-25c925710dae req-1836975e-a2aa-4f80-a20c-9d8c58fdce8e service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] No waiting events found dispatching network-vif-plugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:13:02 user nova-compute[75246]: WARNING nova.compute.manager [req-136beaa9-138e-4b0b-a8e5-25c925710dae req-1836975e-a2aa-4f80-a20c-9d8c58fdce8e service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received unexpected event network-vif-plugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 for instance with vm_state active and task_state resize_migrating.
Nov 28 17:13:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG nova.network.neutron [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Port 3f3c2850-37c8-4c04-a0ae-588a394ac8d9 binding to destination host user is already ACTIVE {{(pid=75246) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquired lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG nova.network.neutron [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKWCsYbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:13:06 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:13:06 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:13:06 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fee8753-d137-49b0-9831-4e77a4045645]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:13:06 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[787f5cd6-2624-450e-85cf-fdd20a67dae2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122] added
Nov 28 17:13:06 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d275e417-0050-4a05-b975-9e24c4320ed5]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52659e2-ffcb-46dd-9063-b3c88d8094d4]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pKWCsYbA {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pKWCsYbA" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fa4f23-c6d8-4ed8-bb5a-c55967ebab77]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pKWCsYbA'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d0aa64-617f-4aff-aa23-8a93b911ec53]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c50a0a-21f8-4da4-99b2-84580a5f5da2]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:13:06 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:13:06 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:13:06 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:13:06 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:13:06 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:13:06 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9961b877-886f-402c-896d-a20d3e68bce0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122, portal: 172.16.0.220,3260]
Nov 28 17:13:06 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122, portal: 172.16.0.220,3260] successful.
Nov 28 17:13:06 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2cf4d6-5b56-44db-8b16-bc5704506c38]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b6aae0-1f21-4389-8c23-aa87a9893f4f]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:13:06 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:13:06 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:13:06 user nova-compute[75246]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 (non-flash)
Nov 28 17:13:06 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:13:06 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:13:06 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:13:06 user nova-compute[75246]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 (non-flash)
Nov 28 17:13:06 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d065024-e5ce-43c7-b24f-8e2aca25fb5f]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKWCsYbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG nova.network.neutron [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Updating instance_info_cache with network_info: [{"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Releasing lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.utils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c5ee70-7dec-4655-ac3c-a2b83fcbc1b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eced6ab-815d-45cc-87f9-ba4ea4bf927f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93a5131-5df8-495f-99d9-602b7a97975c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a71c94-9752-4247-83e0-702a24a6187a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:13:06 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:13:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee84b90-86ad-4407-b49a-0febe60fe1f4]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:13:06 user nova-compute[75246]: DEBUG os_brick.utils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:13:07 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:13:07 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26631613637333863', 'path': '/dev/sdb'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:13:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631613637333863', 'path': '/dev/sdb'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:13:07 user nova-compute[75246]: DEBUG nova.objects.instance [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lazy-loading 'flavor' on Instance uuid 0ed72d2a-ca9b-4b99-b422-86fa93af945c {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:13:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:13:07 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:13:07 user nova-compute[75246]:   <source dev="/dev/sdb"/>
Nov 28 17:13:07 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:13:07 user nova-compute[75246]:   <serial>d7423ede-a02d-448e-87cf-04bf8a20a122</serial>
Nov 28 17:13:07 user nova-compute[75246]: </disk>
Nov 28 17:13:07 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:13:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:13:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:13:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] No VIF found with MAC fa:16:3e:ef:e7:23, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:13:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12210f74-07e0-4d03-b4cf-3d9f2cf71e46 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.011s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:10 user nova-compute[75246]: INFO nova.compute.manager [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Detaching volume d7423ede-a02d-448e-87cf-04bf8a20a122
Nov 28 17:13:10 user nova-compute[75246]: INFO nova.virt.block_device [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Attempting to driver detach volume d7423ede-a02d-448e-87cf-04bf8a20a122 from mountpoint /dev/vdb
Nov 28 17:13:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Attempting to detach device vdb from instance 0ed72d2a-ca9b-4b99-b422-86fa93af945c from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:13:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:13:10 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:13:10 user nova-compute[75246]:   <source dev="/dev/sdb"/>
Nov 28 17:13:10 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:13:10 user nova-compute[75246]:   <serial>d7423ede-a02d-448e-87cf-04bf8a20a122</serial>
Nov 28 17:13:10 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:13:10 user nova-compute[75246]: </disk>
Nov 28 17:13:10 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:13:11 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Successfully detached device vdb from instance 0ed72d2a-ca9b-4b99-b422-86fa93af945c from the persistent domain config.
Nov 28 17:13:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ed72d2a-ca9b-4b99-b422-86fa93af945c from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:13:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:13:11 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:13:11 user nova-compute[75246]:   <source dev="/dev/sdb"/>
Nov 28 17:13:11 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:13:11 user nova-compute[75246]:   <serial>d7423ede-a02d-448e-87cf-04bf8a20a122</serial>
Nov 28 17:13:11 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:13:11 user nova-compute[75246]: </disk>
Nov 28 17:13:11 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:13:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ed72d2a-ca9b-4b99-b422-86fa93af945c {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:13:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:13 user nova-compute[75246]: INFO nova.compute.manager [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Terminating instance
Nov 28 17:13:13 user nova-compute[75246]: DEBUG nova.compute.manager [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:13:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-18b52257-e270-4b07-92f4-e2840b01ba2e req-d73ecad8-f864-4df3-afeb-e43bd56e2e35 service nova] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Received event network-vif-unplugged-64b4a9b1-d5e7-4a2b-966e-65fc3ecad898 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:13:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-18b52257-e270-4b07-92f4-e2840b01ba2e req-d73ecad8-f864-4df3-afeb-e43bd56e2e35 service nova] Acquiring lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-18b52257-e270-4b07-92f4-e2840b01ba2e req-d73ecad8-f864-4df3-afeb-e43bd56e2e35 service nova] Lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-18b52257-e270-4b07-92f4-e2840b01ba2e req-d73ecad8-f864-4df3-afeb-e43bd56e2e35 service nova] Lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-18b52257-e270-4b07-92f4-e2840b01ba2e req-d73ecad8-f864-4df3-afeb-e43bd56e2e35 service nova] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] No waiting events found dispatching network-vif-unplugged-64b4a9b1-d5e7-4a2b-966e-65fc3ecad898 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:13:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-18b52257-e270-4b07-92f4-e2840b01ba2e req-d73ecad8-f864-4df3-afeb-e43bd56e2e35 service nova] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Received event network-vif-unplugged-64b4a9b1-d5e7-4a2b-966e-65fc3ecad898 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:13:14 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Instance destroyed successfully.
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.objects.instance [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lazy-loading 'resources' on Instance uuid c9abccd6-b64d-4bbf-bdaf-3e3945b04413 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1125403998',display_name='tempest-TestVolumeBootPattern-server-1125403998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1125403998',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:11:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe0eebdd39c54a74be8d2e0f9842b165',ramdisk_id='',reservation_id='r-m6oxezey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-389869337',owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:11:47Z,user_data=None,user_id='c334f73c5bf1473aadf865c8f032c0cb',uuid=c9abccd6-b64d-4bbf-bdaf-3e3945b04413,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "address": "fa:16:3e:4c:23:9f", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64b4a9b1-d5", "ovs_interfaceid": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converting VIF {"id": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "address": "fa:16:3e:4c:23:9f", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64b4a9b1-d5", "ovs_interfaceid": "64b4a9b1-d5e7-4a2b-966e-65fc3ecad898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:23:9f,bridge_name='br-int',has_traffic_filtering=True,id=64b4a9b1-d5e7-4a2b-966e-65fc3ecad898,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64b4a9b1-d5') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_vif [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:23:9f,bridge_name='br-int',has_traffic_filtering=True,id=64b4a9b1-d5e7-4a2b-966e-65fc3ecad898,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64b4a9b1-d5') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64b4a9b1-d5, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3943a1e7-1f50-414b-a0b9-fe40a4dea194) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:14 user nova-compute[75246]: INFO os_vif [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:23:9f,bridge_name='br-int',has_traffic_filtering=True,id=64b4a9b1-d5e7-4a2b-966e-65fc3ecad898,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64b4a9b1-d5')
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZKXsqxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:13:14 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cdda97-e555-4779-9148-a785b6b7b9ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:13:14 user nova-compute[75246]: No targets found.
Nov 28 17:13:14 user nova-compute[75246]: iSNS:
Nov 28 17:13:14 user nova-compute[75246]: No targets found.
Nov 28 17:13:14 user nova-compute[75246]: STATIC:
Nov 28 17:13:14 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf
Nov 28 17:13:14 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:13:14 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:13:14 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122
Nov 28 17:13:14 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:13:14 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:13:14 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a
Nov 28 17:13:14 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:13:14 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:13:14 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d
Nov 28 17:13:14 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:13:14 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:13:14 user nova-compute[75246]: FIRMWARE:
Nov 28 17:13:14 user nova-compute[75246]: No targets found.
Nov 28 17:13:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:13:14 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:13:14 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dab9d71-2424-4bfa-a867-33089b7cadb4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ea27bf-80d8-4fc5-845d-230549b9974a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:13:14 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:13:14 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:13:14 user nova-compute[75246]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 (non-flash)
Nov 28 17:13:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:13:14 user nova-compute[75246]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf (non-flash)
Nov 28 17:13:14 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:13:14 user nova-compute[75246]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 (non-flash)
Nov 28 17:13:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d8135240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf'): ({'sdg'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Removing single pathed devices sdg {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4860985-2a1d-4f44-bb85-7affc56946eb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c399af-ab1d-4da6-9fdf-524b5ef5cdbb]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Flushing IO for device /dev/sdg {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[042a5a25-39f3-4bc6-9f9f-fa421291ae89]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[241c70f2-a354-4a8a-a255-93ac22830bc8]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] SCSI volumes sdg have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Starting finish_migration {{(pid=75246) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Instance directory exists: not creating {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 17:13:14 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Creating image(s)
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Did not create local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Ensure instance console log exists: /opt/stack/data/nova/instances/5c199841-2ce5-4f72-a3f1-6d6d0c746505/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Start _get_guest_xml network_info=[{"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-852273520-network", "vif_mac": "fa:16:3e:a0:bb:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '89cc1ff1-793c-4177-94f7-510aaf8de282', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbXCyWfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5c199841-2ce5-4f72-a3f1-6d6d0c746505', 'attached_at': '2023-11-28T17:13:14.000000', 'detached_at': '', 'volume_id': '705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3', 'serial': '705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6ea68a-e5f3-491e-94b2-ae4c0451ee2b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:13:14 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbXCyWfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:13:14 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b7cb3b-f86e-474c-a1e9-bf1544773d0d]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf, portal: 172.16.0.220,3260]
Nov 28 17:13:14 user nova-compute[75246]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf, portal: 172.16.0.220,3260] successful.
Nov 28 17:13:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8989f807-4ecf-49b5-ab2f-ca0a32f283bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f25713-37e0-48b2-b729-5ca8f604fb43]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] <== disconnect_volume: return (310ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:13:14 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Deleting instance files /opt/stack/data/nova/instances/c9abccd6-b64d-4bbf-bdaf-3e3945b04413_del
Nov 28 17:13:14 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Deletion of /opt/stack/data/nova/instances/c9abccd6-b64d-4bbf-bdaf-3e3945b04413_del complete
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.040s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:13:14 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:13:14 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4469610c-722f-4e95-89cd-68e338dee18a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:13:14 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff33e6db-e773-4c8c-92bc-632413200b3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3] added
Nov 28 17:13:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: INFO nova.compute.manager [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[018e34c6-5ff2-4413-892d-fbd4380d7e7d]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0819f132-6b07-4a68-8693-6505ae1807f7]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbXCyWfJ {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbXCyWfJ" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e25487-8299-4822-af6a-cfbcf04a66c7]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BbXCyWfJ'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f039a1-b6b9-4cd8-9b2c-4db88cc1c117]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[af850f35-2d51-4e17-a8ac-ed9aa82e7f3a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:13:14 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:13:14 user nova-compute[75246]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 (non-flash)
Nov 28 17:13:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:13:14 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:13:14 user nova-compute[75246]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 (non-flash)
Nov 28 17:13:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0edef4b-c062-421c-af24-88a2f04bd421]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3, portal: 172.16.0.220,3260]
Nov 28 17:13:14 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3, portal: 172.16.0.220,3260] successful.
Nov 28 17:13:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc619849-8714-41eb-bdca-094e679185ad]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4694b466-619a-4ace-994e-f502bd356528]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:13:14 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:13:14 user nova-compute[75246]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 (non-flash)
Nov 28 17:13:14 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:13:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:13:14 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:13:14 user nova-compute[75246]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 (non-flash)
Nov 28 17:13:14 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:13:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba4bffd-af3f-4ce8-b712-c9b10aabcacc]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:13:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbXCyWfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:13:15 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:13:15 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Took 1.13 seconds to deallocate network for instance.
Nov 28 17:13:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-ecbdecb7-eaa2-4ed7-9b9c-2e9f109f3b3a req-0bfe567b-51f5-46e3-a842-1ab33b6712e9 service nova] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Received event network-vif-deleted-64b4a9b1-d5e7-4a2b-966e-65fc3ecad898 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:13:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-640a981b-ef41-47d8-a689-968a7fa80220 req-13bc71d2-9e4c-4990-8831-c9767cd79cee service nova] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Received event network-vif-plugged-64b4a9b1-d5e7-4a2b-966e-65fc3ecad898 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:13:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-640a981b-ef41-47d8-a689-968a7fa80220 req-13bc71d2-9e4c-4990-8831-c9767cd79cee service nova] Acquiring lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-640a981b-ef41-47d8-a689-968a7fa80220 req-13bc71d2-9e4c-4990-8831-c9767cd79cee service nova] Lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-640a981b-ef41-47d8-a689-968a7fa80220 req-13bc71d2-9e4c-4990-8831-c9767cd79cee service nova] Lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-640a981b-ef41-47d8-a689-968a7fa80220 req-13bc71d2-9e4c-4990-8831-c9767cd79cee service nova] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] No waiting events found dispatching network-vif-plugged-64b4a9b1-d5e7-4a2b-966e-65fc3ecad898 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:13:15 user nova-compute[75246]: WARNING nova.compute.manager [req-640a981b-ef41-47d8-a689-968a7fa80220 req-13bc71d2-9e4c-4990-8831-c9767cd79cee service nova] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Received unexpected event network-vif-plugged-64b4a9b1-d5e7-4a2b-966e-65fc3ecad898 for instance with vm_state active and task_state deleting.
Nov 28 17:13:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:13:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23730616335303761', 'path': '/dev/sdc'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:13:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730616335303761', 'path': '/dev/sdc'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:13:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:11:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-62421813',display_name='tempest-ServerActionsTestOtherA-server-62421813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-62421813',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5QoCu8z1J19YdF2KrIxtAcllUa+54ECbo+7UcXNC+vRRLTiAkI9KGg17d3KrbHvU7U2QxVzma0Ilz+ryH1d5iWfmR7mKkbwqDpkhmRExCuSVuBHZfoiX/4Pew1wkkhqw==',key_name='tempest-keypair-745476775',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:11:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='be06eee4e74a41b799f1df75ea55b955',ramdisk_id='',reservation_id='r-8k4f0rv1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1554281978',owner_user_name='tempest-ServerActionsTestOtherA-1554281978-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:13:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39d2eb0837eb4c729fe9ca2964cbe789',uuid=5c199841-2ce5-4f72-a3f1-6d6d0c746505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-852273520-network", "vif_mac": "fa:16:3e:a0:bb:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:13:15 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converting VIF {"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-852273520-network", "vif_mac": "fa:16:3e:a0:bb:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:13:15 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=3f3c2850-37c8-4c04-a0ae-588a394ac8d9,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3c2850-37') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:13:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:13:15 user nova-compute[75246]:   <uuid>5c199841-2ce5-4f72-a3f1-6d6d0c746505</uuid>
Nov 28 17:13:15 user nova-compute[75246]:   <name>instance-0000001b</name>
Nov 28 17:13:15 user nova-compute[75246]:   <memory>2097152</memory>
Nov 28 17:13:15 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:13:15 user nova-compute[75246]:   <metadata>
Nov 28 17:13:15 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:13:15 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:13:15 user nova-compute[75246]:       <nova:name>tempest-ServerActionsTestOtherA-server-62421813</nova:name>
Nov 28 17:13:15 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:13:14</nova:creationTime>
Nov 28 17:13:15 user nova-compute[75246]:       <nova:flavor name="m1.small">
Nov 28 17:13:15 user nova-compute[75246]:         <nova:memory>2048</nova:memory>
Nov 28 17:13:15 user nova-compute[75246]:         <nova:disk>20</nova:disk>
Nov 28 17:13:15 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:13:15 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:13:15 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:13:15 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:13:15 user nova-compute[75246]:       <nova:owner>
Nov 28 17:13:15 user nova-compute[75246]:         <nova:user uuid="39d2eb0837eb4c729fe9ca2964cbe789">tempest-ServerActionsTestOtherA-1554281978-project-member</nova:user>
Nov 28 17:13:15 user nova-compute[75246]:         <nova:project uuid="be06eee4e74a41b799f1df75ea55b955">tempest-ServerActionsTestOtherA-1554281978</nova:project>
Nov 28 17:13:15 user nova-compute[75246]:       </nova:owner>
Nov 28 17:13:15 user nova-compute[75246]:       <nova:ports>
Nov 28 17:13:15 user nova-compute[75246]:         <nova:port uuid="3f3c2850-37c8-4c04-a0ae-588a394ac8d9">
Nov 28 17:13:15 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 17:13:15 user nova-compute[75246]:         </nova:port>
Nov 28 17:13:15 user nova-compute[75246]:       </nova:ports>
Nov 28 17:13:15 user nova-compute[75246]:     </nova:instance>
Nov 28 17:13:15 user nova-compute[75246]:   </metadata>
Nov 28 17:13:15 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:13:15 user nova-compute[75246]:     <system>
Nov 28 17:13:15 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:13:15 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:13:15 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:13:15 user nova-compute[75246]:       <entry name="serial">5c199841-2ce5-4f72-a3f1-6d6d0c746505</entry>
Nov 28 17:13:15 user nova-compute[75246]:       <entry name="uuid">5c199841-2ce5-4f72-a3f1-6d6d0c746505</entry>
Nov 28 17:13:15 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:13:15 user nova-compute[75246]:     </system>
Nov 28 17:13:15 user nova-compute[75246]:   </sysinfo>
Nov 28 17:13:15 user nova-compute[75246]:   <os>
Nov 28 17:13:15 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:13:15 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:13:15 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:13:15 user nova-compute[75246]:   </os>
Nov 28 17:13:15 user nova-compute[75246]:   <features>
Nov 28 17:13:15 user nova-compute[75246]:     <acpi/>
Nov 28 17:13:15 user nova-compute[75246]:     <apic/>
Nov 28 17:13:15 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:13:15 user nova-compute[75246]:   </features>
Nov 28 17:13:15 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:13:15 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:13:15 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:13:15 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:13:15 user nova-compute[75246]:   </clock>
Nov 28 17:13:15 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:13:15 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:13:15 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:13:15 user nova-compute[75246]:   </cpu>
Nov 28 17:13:15 user nova-compute[75246]:   <devices>
Nov 28 17:13:15 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:13:15 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:13:15 user nova-compute[75246]:       <source dev="/dev/sdc"/>
Nov 28 17:13:15 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:13:15 user nova-compute[75246]:       <serial>705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3</serial>
Nov 28 17:13:15 user nova-compute[75246]:     </disk>
Nov 28 17:13:15 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:13:15 user nova-compute[75246]:       <mac address="fa:16:3e:a0:bb:83"/>
Nov 28 17:13:15 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:13:15 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:13:15 user nova-compute[75246]:       <target dev="tap3f3c2850-37"/>
Nov 28 17:13:15 user nova-compute[75246]:     </interface>
Nov 28 17:13:15 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:13:15 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/5c199841-2ce5-4f72-a3f1-6d6d0c746505/console.log" append="off"/>
Nov 28 17:13:15 user nova-compute[75246]:     </serial>
Nov 28 17:13:15 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:13:15 user nova-compute[75246]:     <video>
Nov 28 17:13:15 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:13:15 user nova-compute[75246]:     </video>
Nov 28 17:13:15 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:13:15 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:13:15 user nova-compute[75246]:     </rng>
Nov 28 17:13:15 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:13:15 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:13:15 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:13:15 user nova-compute[75246]:     </memballoon>
Nov 28 17:13:15 user nova-compute[75246]:   </devices>
Nov 28 17:13:15 user nova-compute[75246]: </domain>
Nov 28 17:13:15 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:11:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-62421813',display_name='tempest-ServerActionsTestOtherA-server-62421813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-62421813',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5QoCu8z1J19YdF2KrIxtAcllUa+54ECbo+7UcXNC+vRRLTiAkI9KGg17d3KrbHvU7U2QxVzma0Ilz+ryH1d5iWfmR7mKkbwqDpkhmRExCuSVuBHZfoiX/4Pew1wkkhqw==',key_name='tempest-keypair-745476775',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:11:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='be06eee4e74a41b799f1df75ea55b955',ramdisk_id='',reservation_id='r-8k4f0rv1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1554281978',owner_user_name='tempest-ServerActionsTestOtherA-1554281978-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:13:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39d2eb0837eb4c729fe9ca2964cbe789',uuid=5c199841-2ce5-4f72-a3f1-6d6d0c746505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-852273520-network", "vif_mac": "fa:16:3e:a0:bb:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converting VIF {"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-852273520-network", "vif_mac": "fa:16:3e:a0:bb:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=3f3c2850-37c8-4c04-a0ae-588a394ac8d9,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3c2850-37') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG os_vif [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=3f3c2850-37c8-4c04-a0ae-588a394ac8d9,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3c2850-37') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41d066ed-fc30-57ac-81c0-196056f08681', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f3c2850-37, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f3c2850-37, col_values=(('qos', UUID('8aa94a78-1cf0-4243-ad73-267c7c10daba')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f3c2850-37, col_values=(('external_ids', {'iface-id': '3f3c2850-37c8-4c04-a0ae-588a394ac8d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:bb:83', 'vm-uuid': '5c199841-2ce5-4f72-a3f1-6d6d0c746505'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:16 user nova-compute[75246]: INFO os_vif [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=3f3c2850-37c8-4c04-a0ae-588a394ac8d9,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3c2850-37')
Nov 28 17:13:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] No VIF found with MAC fa:16:3e:a0:bb:83, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:13:16 user nova-compute[75246]: INFO nova.compute.manager [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Took 0.80 seconds to detach 1 volumes for instance.
Nov 28 17:13:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: c9abccd6-b64d-4bbf-bdaf-3e3945b04413] Deleting volume: 8989f807-4ecf-49b5-ab2f-ca0a32f283bf {{(pid=75246) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:17 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:13:17 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:13:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:17 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Deleted allocations for instance c9abccd6-b64d-4bbf-bdaf-3e3945b04413
Nov 28 17:13:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-57589569-4488-4790-ae02-5f009dde7a88 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "c9abccd6-b64d-4bbf-bdaf-3e3945b04413" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.758s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-74261870-b5dd-49e4-bd23-56dcdde44ad3 req-d6ddb1de-541d-4f88-9bd8-552c6c2e4195 service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received event network-vif-plugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:13:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-74261870-b5dd-49e4-bd23-56dcdde44ad3 req-d6ddb1de-541d-4f88-9bd8-552c6c2e4195 service nova] Acquiring lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-74261870-b5dd-49e4-bd23-56dcdde44ad3 req-d6ddb1de-541d-4f88-9bd8-552c6c2e4195 service nova] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-74261870-b5dd-49e4-bd23-56dcdde44ad3 req-d6ddb1de-541d-4f88-9bd8-552c6c2e4195 service nova] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-74261870-b5dd-49e4-bd23-56dcdde44ad3 req-d6ddb1de-541d-4f88-9bd8-552c6c2e4195 service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] No waiting events found dispatching network-vif-plugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:13:17 user nova-compute[75246]: WARNING nova.compute.manager [req-74261870-b5dd-49e4-bd23-56dcdde44ad3 req-d6ddb1de-541d-4f88-9bd8-552c6c2e4195 service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received unexpected event network-vif-plugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 for instance with vm_state active and task_state resize_finish.
Nov 28 17:13:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-74261870-b5dd-49e4-bd23-56dcdde44ad3 req-d6ddb1de-541d-4f88-9bd8-552c6c2e4195 service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received event network-vif-plugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:13:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-74261870-b5dd-49e4-bd23-56dcdde44ad3 req-d6ddb1de-541d-4f88-9bd8-552c6c2e4195 service nova] Acquiring lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-74261870-b5dd-49e4-bd23-56dcdde44ad3 req-d6ddb1de-541d-4f88-9bd8-552c6c2e4195 service nova] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-74261870-b5dd-49e4-bd23-56dcdde44ad3 req-d6ddb1de-541d-4f88-9bd8-552c6c2e4195 service nova] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-74261870-b5dd-49e4-bd23-56dcdde44ad3 req-d6ddb1de-541d-4f88-9bd8-552c6c2e4195 service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] No waiting events found dispatching network-vif-plugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:13:17 user nova-compute[75246]: WARNING nova.compute.manager [req-74261870-b5dd-49e4-bd23-56dcdde44ad3 req-d6ddb1de-541d-4f88-9bd8-552c6c2e4195 service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received unexpected event network-vif-plugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 for instance with vm_state active and task_state resize_finish.
Nov 28 17:13:19 user nova-compute[75246]: DEBUG nova.compute.manager [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:13:19 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Instance running successfully.
Nov 28 17:13:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Failed to set time: agent not configured {{(pid=75246) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 28 17:13:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-09309dfe-5403-4d4a-9d16-0aa25d25c212 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] finish_migration finished successfully. {{(pid=75246) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 28 17:13:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:25 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:13:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:29 user nova-compute[75246]: DEBUG nova.compute.manager [req-63be3eee-a1ac-4364-8878-122626142513 req-c91e58ae-72af-4688-8cda-a7dd484dc5d1 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Received event network-changed-ab3dd811-8f71-498f-85d6-56a5e421c06b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:13:29 user nova-compute[75246]: DEBUG nova.compute.manager [req-63be3eee-a1ac-4364-8878-122626142513 req-c91e58ae-72af-4688-8cda-a7dd484dc5d1 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Refreshing instance network info cache due to event network-changed-ab3dd811-8f71-498f-85d6-56a5e421c06b. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:13:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-63be3eee-a1ac-4364-8878-122626142513 req-c91e58ae-72af-4688-8cda-a7dd484dc5d1 service nova] Acquiring lock "refresh_cache-bdbc9972-fa4b-4172-b540-1996af1b79fe" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:13:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-63be3eee-a1ac-4364-8878-122626142513 req-c91e58ae-72af-4688-8cda-a7dd484dc5d1 service nova] Acquired lock "refresh_cache-bdbc9972-fa4b-4172-b540-1996af1b79fe" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:13:29 user nova-compute[75246]: DEBUG nova.network.neutron [req-63be3eee-a1ac-4364-8878-122626142513 req-c91e58ae-72af-4688-8cda-a7dd484dc5d1 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Refreshing network info cache for port ab3dd811-8f71-498f-85d6-56a5e421c06b {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:13:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "bdbc9972-fa4b-4172-b540-1996af1b79fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "bdbc9972-fa4b-4172-b540-1996af1b79fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "bdbc9972-fa4b-4172-b540-1996af1b79fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "bdbc9972-fa4b-4172-b540-1996af1b79fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "bdbc9972-fa4b-4172-b540-1996af1b79fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:29 user nova-compute[75246]: INFO nova.compute.manager [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Terminating instance
Nov 28 17:13:29 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG nova.network.neutron [req-63be3eee-a1ac-4364-8878-122626142513 req-c91e58ae-72af-4688-8cda-a7dd484dc5d1 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Updated VIF entry in instance network info cache for port ab3dd811-8f71-498f-85d6-56a5e421c06b. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG nova.network.neutron [req-63be3eee-a1ac-4364-8878-122626142513 req-c91e58ae-72af-4688-8cda-a7dd484dc5d1 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Updating instance_info_cache with network_info: [{"id": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "address": "fa:16:3e:59:f5:33", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3dd811-8f", "ovs_interfaceid": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-63be3eee-a1ac-4364-8878-122626142513 req-c91e58ae-72af-4688-8cda-a7dd484dc5d1 service nova] Releasing lock "refresh_cache-bdbc9972-fa4b-4172-b540-1996af1b79fe" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-788cb098-20a0-4f7b-951f-20155e7370ae req-622c3702-b2ff-43bd-9341-77ba7b4cb6b7 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Received event network-vif-unplugged-ab3dd811-8f71-498f-85d6-56a5e421c06b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-788cb098-20a0-4f7b-951f-20155e7370ae req-622c3702-b2ff-43bd-9341-77ba7b4cb6b7 service nova] Acquiring lock "bdbc9972-fa4b-4172-b540-1996af1b79fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-788cb098-20a0-4f7b-951f-20155e7370ae req-622c3702-b2ff-43bd-9341-77ba7b4cb6b7 service nova] Lock "bdbc9972-fa4b-4172-b540-1996af1b79fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-788cb098-20a0-4f7b-951f-20155e7370ae req-622c3702-b2ff-43bd-9341-77ba7b4cb6b7 service nova] Lock "bdbc9972-fa4b-4172-b540-1996af1b79fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-788cb098-20a0-4f7b-951f-20155e7370ae req-622c3702-b2ff-43bd-9341-77ba7b4cb6b7 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] No waiting events found dispatching network-vif-unplugged-ab3dd811-8f71-498f-85d6-56a5e421c06b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-788cb098-20a0-4f7b-951f-20155e7370ae req-622c3702-b2ff-43bd-9341-77ba7b4cb6b7 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Received event network-vif-unplugged-ab3dd811-8f71-498f-85d6-56a5e421c06b for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:30 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Instance destroyed successfully.
Nov 28 17:13:30 user nova-compute[75246]: DEBUG nova.objects.instance [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lazy-loading 'resources' on Instance uuid bdbc9972-fa4b-4172-b540-1996af1b79fe {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-792904770',display_name='tempest-AttachVolumeNegativeTest-server-792904770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-792904770',id=29,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/JtoIHsBVXIkBPKzEvk81USdTum2tyl1Qnes3ZYE0R3SqPpbLleqWcW3BQ9rDWFErUVCmwAqeiUN9pEdQ4p0abMIqEH0F6tErT6oypoxh0FOUpQzveDL5SOw293Pt6KA==',key_name='tempest-keypair-1402857658',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:11:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d39dde859674409847b50613bcc608b',ramdisk_id='',reservation_id='r-yua59xnx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-524813585',owner_user_name='tempest-AttachVolumeNegativeTest-524813585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:11:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ae91a734974162a14d7b4c498c4b8d',uuid=bdbc9972-fa4b-4172-b540-1996af1b79fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "address": "fa:16:3e:59:f5:33", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3dd811-8f", "ovs_interfaceid": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converting VIF {"id": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "address": "fa:16:3e:59:f5:33", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3dd811-8f", "ovs_interfaceid": "ab3dd811-8f71-498f-85d6-56a5e421c06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:f5:33,bridge_name='br-int',has_traffic_filtering=True,id=ab3dd811-8f71-498f-85d6-56a5e421c06b,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3dd811-8f') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG os_vif [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:f5:33,bridge_name='br-int',has_traffic_filtering=True,id=ab3dd811-8f71-498f-85d6-56a5e421c06b,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3dd811-8f') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab3dd811-8f, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6b40286-3d8b-43f4-9a2d-a57fad466a92) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:13:30 user nova-compute[75246]: INFO os_vif [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:f5:33,bridge_name='br-int',has_traffic_filtering=True,id=ab3dd811-8f71-498f-85d6-56a5e421c06b,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3dd811-8f')
Nov 28 17:13:30 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Deleting instance files /opt/stack/data/nova/instances/bdbc9972-fa4b-4172-b540-1996af1b79fe_del
Nov 28 17:13:30 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Deletion of /opt/stack/data/nova/instances/bdbc9972-fa4b-4172-b540-1996af1b79fe_del complete
Nov 28 17:13:30 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:13:31 user nova-compute[75246]: INFO nova.compute.manager [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:31 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0ed72d2a-ca9b-4b99-b422-86fa93af945c is timed out.
Nov 28 17:13:31 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Successfully detached device vdb from instance 0ed72d2a-ca9b-4b99-b422-86fa93af945c from the live domain config.
Nov 28 17:13:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKWCsYbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:13:31 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[76481939-3deb-46ef-a1d0-4528ead3a625]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:13:31 user nova-compute[75246]: No targets found.
Nov 28 17:13:31 user nova-compute[75246]: iSNS:
Nov 28 17:13:31 user nova-compute[75246]: No targets found.
Nov 28 17:13:31 user nova-compute[75246]: STATIC:
Nov 28 17:13:31 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122
Nov 28 17:13:31 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:13:31 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:13:31 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a
Nov 28 17:13:31 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:13:31 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:13:31 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3
Nov 28 17:13:31 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:13:31 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:13:31 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d
Nov 28 17:13:31 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:13:31 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:13:31 user nova-compute[75246]: FIRMWARE:
Nov 28 17:13:31 user nova-compute[75246]: No targets found.
Nov 28 17:13:31 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:13:31 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:13:31 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51a9eb6-2ff3-43fa-8b4f-83095516d2f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca19bf9-e78d-4aec-93ab-7ca07d21788d]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:13:31 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:13:31 user nova-compute[75246]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 (non-flash)
Nov 28 17:13:31 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:13:31 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:13:31 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:13:31 user nova-compute[75246]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 (non-flash)
Nov 28 17:13:31 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:13:31 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4b8774310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122'): ({'sdb'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Removing single pathed devices sdb {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d33f1a-fd35-4404-95d4-b5cf1945efdd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87297ed-7a74-441a-98e8-7798e6738029]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Flushing IO for device /dev/sdb {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[985d6c7e-88cc-48f7-9f51-106f79608167]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2e5ad7-6e97-45fe-973c-338c62d6e398]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[356aeaa3-59eb-4c8b-a6a0-b8936af66a11]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2c96d4-3912-4fa6-ae5d-6ea9775e1731]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122, portal: 172.16.0.220,3260]
Nov 28 17:13:31 user nova-compute[75246]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122, portal: 172.16.0.220,3260] successful.
Nov 28 17:13:31 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7423ede-a02d-448e-87cf-04bf8a20a122 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3281fc-42c3-4ce7-8119-54fda4aa53a8]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] <== disconnect_volume: return (365ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:13:31 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-3bd65ed1-5f73-47c9-8b7a-864d893fbbde req-11abc957-9638-4cd8-9772-8588d5478e53 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Received event network-vif-deleted-ab3dd811-8f71-498f-85d6-56a5e421c06b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:13:32 user nova-compute[75246]: INFO nova.compute.manager [req-3bd65ed1-5f73-47c9-8b7a-864d893fbbde req-11abc957-9638-4cd8-9772-8588d5478e53 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Neutron deleted interface ab3dd811-8f71-498f-85d6-56a5e421c06b; detaching it from the instance and deleting it from the info cache
Nov 28 17:13:32 user nova-compute[75246]: DEBUG nova.network.neutron [req-3bd65ed1-5f73-47c9-8b7a-864d893fbbde req-11abc957-9638-4cd8-9772-8588d5478e53 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:13:32 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Took 1.15 seconds to deallocate network for instance.
Nov 28 17:13:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-3bd65ed1-5f73-47c9-8b7a-864d893fbbde req-11abc957-9638-4cd8-9772-8588d5478e53 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Detach interface failed, port_id=ab3dd811-8f71-498f-85d6-56a5e421c06b, reason: Instance bdbc9972-fa4b-4172-b540-1996af1b79fe could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-58a4aba1-a814-4533-95b3-1d54984753f8 req-9ca9347f-9661-4782-bb52-4f6745b07160 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Received event network-vif-plugged-ab3dd811-8f71-498f-85d6-56a5e421c06b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-58a4aba1-a814-4533-95b3-1d54984753f8 req-9ca9347f-9661-4782-bb52-4f6745b07160 service nova] Acquiring lock "bdbc9972-fa4b-4172-b540-1996af1b79fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-58a4aba1-a814-4533-95b3-1d54984753f8 req-9ca9347f-9661-4782-bb52-4f6745b07160 service nova] Lock "bdbc9972-fa4b-4172-b540-1996af1b79fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-58a4aba1-a814-4533-95b3-1d54984753f8 req-9ca9347f-9661-4782-bb52-4f6745b07160 service nova] Lock "bdbc9972-fa4b-4172-b540-1996af1b79fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-58a4aba1-a814-4533-95b3-1d54984753f8 req-9ca9347f-9661-4782-bb52-4f6745b07160 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] No waiting events found dispatching network-vif-plugged-ab3dd811-8f71-498f-85d6-56a5e421c06b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:13:32 user nova-compute[75246]: WARNING nova.compute.manager [req-58a4aba1-a814-4533-95b3-1d54984753f8 req-9ca9347f-9661-4782-bb52-4f6745b07160 service nova] [instance: bdbc9972-fa4b-4172-b540-1996af1b79fe] Received unexpected event network-vif-plugged-ab3dd811-8f71-498f-85d6-56a5e421c06b for instance with vm_state deleted and task_state None.
Nov 28 17:13:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG nova.objects.instance [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lazy-loading 'flavor' on Instance uuid 0ed72d2a-ca9b-4b99-b422-86fa93af945c {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fc51d3d8-516a-4237-940b-45445fa2a609 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.679s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:32 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Deleted allocations for instance bdbc9972-fa4b-4172-b540-1996af1b79fe
Nov 28 17:13:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2759202e-c7f5-47ed-84b1-0f9f304e27e4 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "bdbc9972-fa4b-4172-b540-1996af1b79fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.114s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:13:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:13:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:13:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:36 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:13:36 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:13:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=7247MB free_disk=25.32891082763672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Applying migration context for instance 5c199841-2ce5-4f72-a3f1-6d6d0c746505 as it has an incoming, in-progress migration 3a0acfc8-ebd0-4c9e-8eb8-a289b4345e05. Migration status is finished {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 17:13:36 user nova-compute[75246]: INFO nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Updating resource usage from migration 3a0acfc8-ebd0-4c9e-8eb8-a289b4345e05
Nov 28 17:13:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e1266470-c182-4c0c-a575-4c5043f54745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c94900af-f484-47bf-8627-8aa863334b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance aa9ef0b8-3519-416a-b42c-cd953c4ddc0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 36e65da9-4cc0-4d73-9e5d-e64520e08f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 0ed72d2a-ca9b-4b99-b422-86fa93af945c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 620ce71b-8ce0-492a-ac7e-72dd12987bfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 90829136-472b-4c45-9607-c28433d05f56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 1d3f57d8-3580-4c42-8a4c-cef210e19eb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Migration 3a0acfc8-ebd0-4c9e-8eb8-a289b4345e05 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 5c199841-2ce5-4f72-a3f1-6d6d0c746505 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:13:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:13:37 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:13:37 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:13:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:13:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:38 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:13:38 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:13:38 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:13:38 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:13:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:13:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:13:38 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: c94900af-f484-47bf-8627-8aa863334b63] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:13:39 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: c94900af-f484-47bf-8627-8aa863334b63] Updating instance_info_cache with network_info: [{"id": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "address": "fa:16:3e:e3:8a:cb", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dca6bfe-f1", "ovs_interfaceid": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:13:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:13:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: c94900af-f484-47bf-8627-8aa863334b63] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:13:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:13:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:13:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:13:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:13:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-f06a7e82-657e-4c96-ab9e-0b3425a766a6 req-1cd9aefd-98c0-4853-b21b-e87186033276 service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Received event network-changed-ac842cb7-f241-4a68-bb18-9841f2e26ed0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:13:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-f06a7e82-657e-4c96-ab9e-0b3425a766a6 req-1cd9aefd-98c0-4853-b21b-e87186033276 service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Refreshing instance network info cache due to event network-changed-ac842cb7-f241-4a68-bb18-9841f2e26ed0. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:13:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f06a7e82-657e-4c96-ab9e-0b3425a766a6 req-1cd9aefd-98c0-4853-b21b-e87186033276 service nova] Acquiring lock "refresh_cache-620ce71b-8ce0-492a-ac7e-72dd12987bfa" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:13:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f06a7e82-657e-4c96-ab9e-0b3425a766a6 req-1cd9aefd-98c0-4853-b21b-e87186033276 service nova] Acquired lock "refresh_cache-620ce71b-8ce0-492a-ac7e-72dd12987bfa" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:13:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-f06a7e82-657e-4c96-ab9e-0b3425a766a6 req-1cd9aefd-98c0-4853-b21b-e87186033276 service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Refreshing network info cache for port ac842cb7-f241-4a68-bb18-9841f2e26ed0 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:13:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-f06a7e82-657e-4c96-ab9e-0b3425a766a6 req-1cd9aefd-98c0-4853-b21b-e87186033276 service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Updated VIF entry in instance network info cache for port ac842cb7-f241-4a68-bb18-9841f2e26ed0. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:13:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-f06a7e82-657e-4c96-ab9e-0b3425a766a6 req-1cd9aefd-98c0-4853-b21b-e87186033276 service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Updating instance_info_cache with network_info: [{"id": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "address": "fa:16:3e:6a:5d:8b", "network": {"id": "0fb12881-436f-4943-9a68-00e1b782cc8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-319021949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca57cea906e44d0b99222b8a7ebcc3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac842cb7-f2", "ovs_interfaceid": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:13:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f06a7e82-657e-4c96-ab9e-0b3425a766a6 req-1cd9aefd-98c0-4853-b21b-e87186033276 service nova] Releasing lock "refresh_cache-620ce71b-8ce0-492a-ac7e-72dd12987bfa" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:13:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:46 user nova-compute[75246]: DEBUG nova.objects.instance [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lazy-loading 'flavor' on Instance uuid 620ce71b-8ce0-492a-ac7e-72dd12987bfa {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:47 user nova-compute[75246]: INFO nova.compute.manager [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Attaching volume cf9c2de4-53e1-4251-b2c3-49e6365bd7fa to /dev/vdb
Nov 28 17:13:47 user nova-compute[75246]: DEBUG os_brick.utils [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[908e8cf3-41e2-48db-9b86-bfa29a74f906]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb0c187-cddb-4b78-99c1-cca33a1ae10b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b96943-f855-4686-989f-d875bf173e55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9ed133-77fa-4a5b-b81a-6d7296813b56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:13:47 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:13:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c2d72d-1f12-44e2-bf74-d7745a2ce244]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG os_brick.utils [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:13:47 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Updating existing volume attachment record: 1e038e27-c426-4551-a548-7d035e0adf6e {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:13:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "894da7a3-9c67-417e-b0f4-306335a533e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "894da7a3-9c67-417e-b0f4-306335a533e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:52 user nova-compute[75246]: DEBUG nova.compute.manager [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:13:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:52 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:13:52 user nova-compute[75246]: INFO nova.compute.claims [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Claim successful on node user
Nov 28 17:13:52 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:13:52 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:13:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:52 user nova-compute[75246]: DEBUG nova.compute.manager [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:13:52 user nova-compute[75246]: DEBUG nova.compute.manager [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:13:52 user nova-compute[75246]: DEBUG nova.network.neutron [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:13:52 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:13:52 user nova-compute[75246]: DEBUG nova.compute.manager [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:13:52 user nova-compute[75246]: DEBUG nova.policy [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af8b6c3f092547dbbf3debe96c594590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec5bcef3e2441fba30b593c13d5516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG nova.compute.manager [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:13:53 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Creating image(s)
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "/opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "/opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "/opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.170s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk 1073741824" returned: 0 in 0.061s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG nova.network.neutron [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Successfully created port: 003f5480-4452-4891-8713-532403877f31 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Checking if we can resize image /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Cannot resize image /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Ensure instance console log exists: /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.network.neutron [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Successfully updated port: 003f5480-4452-4891-8713-532403877f31 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "refresh_cache-894da7a3-9c67-417e-b0f4-306335a533e6" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquired lock "refresh_cache-894da7a3-9c67-417e-b0f4-306335a533e6" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.network.neutron [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.compute.manager [req-3bbf9109-0740-4959-b81b-0bc39957e25a req-000c5ba2-8c0b-4004-8add-75ae7edf4802 service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Received event network-changed-003f5480-4452-4891-8713-532403877f31 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.compute.manager [req-3bbf9109-0740-4959-b81b-0bc39957e25a req-000c5ba2-8c0b-4004-8add-75ae7edf4802 service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Refreshing instance network info cache due to event network-changed-003f5480-4452-4891-8713-532403877f31. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3bbf9109-0740-4959-b81b-0bc39957e25a req-000c5ba2-8c0b-4004-8add-75ae7edf4802 service nova] Acquiring lock "refresh_cache-894da7a3-9c67-417e-b0f4-306335a533e6" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.network.neutron [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLJHgbUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:13:54 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:13:54 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:13:54 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a5a706-f338-49b1-b1c3-6ca28760c5db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:13:54 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.network.neutron [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Updating instance_info_cache with network_info: [{"id": "003f5480-4452-4891-8713-532403877f31", "address": "fa:16:3e:8d:b0:79", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap003f5480-44", "ovs_interfaceid": "003f5480-4452-4891-8713-532403877f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a5cbaf-2bde-4476-963b-6a19d4094ddd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa] added
Nov 28 17:13:54 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Releasing lock "refresh_cache-894da7a3-9c67-417e-b0f4-306335a533e6" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.compute.manager [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Instance network_info: |[{"id": "003f5480-4452-4891-8713-532403877f31", "address": "fa:16:3e:8d:b0:79", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap003f5480-44", "ovs_interfaceid": "003f5480-4452-4891-8713-532403877f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3bbf9109-0740-4959-b81b-0bc39957e25a req-000c5ba2-8c0b-4004-8add-75ae7edf4802 service nova] Acquired lock "refresh_cache-894da7a3-9c67-417e-b0f4-306335a533e6" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.network.neutron [req-3bbf9109-0740-4959-b81b-0bc39957e25a req-000c5ba2-8c0b-4004-8add-75ae7edf4802 service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Refreshing network info cache for port 003f5480-4452-4891-8713-532403877f31 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Start _get_guest_xml network_info=[{"id": "003f5480-4452-4891-8713-532403877f31", "address": "fa:16:3e:8d:b0:79", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap003f5480-44", "ovs_interfaceid": "003f5480-4452-4891-8713-532403877f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[823755ab-2b49-4065-b296-70774a68433a]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:54 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:13:54 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d483fd4a-956e-4539-88f1-0175a9b9af1d]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mLJHgbUQ {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:13:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-147363844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-147363844',id=33,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faec5bcef3e2441fba30b593c13d5516',ramdisk_id='',reservation_id='r-i4q709fp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-506006079',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:13:53Z,user_data=None,user_id='af8b6c3f092547dbbf3debe96c594590',uuid=894da7a3-9c67-417e-b0f4-306335a533e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "003f5480-4452-4891-8713-532403877f31", "address": "fa:16:3e:8d:b0:79", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap003f5480-44", "ovs_interfaceid": "003f5480-4452-4891-8713-532403877f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converting VIF {"id": "003f5480-4452-4891-8713-532403877f31", "address": "fa:16:3e:8d:b0:79", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap003f5480-44", "ovs_interfaceid": "003f5480-4452-4891-8713-532403877f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b0:79,bridge_name='br-int',has_traffic_filtering=True,id=003f5480-4452-4891-8713-532403877f31,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap003f5480-44') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.objects.instance [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'pci_devices' on Instance uuid 894da7a3-9c67-417e-b0f4-306335a533e6 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mLJHgbUQ" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f9e026-6eff-490f-bc2d-4470c0cf6554]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mLJHgbUQ'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:13:54 user nova-compute[75246]:   <uuid>894da7a3-9c67-417e-b0f4-306335a533e6</uuid>
Nov 28 17:13:54 user nova-compute[75246]:   <name>instance-00000021</name>
Nov 28 17:13:54 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:13:54 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:13:54 user nova-compute[75246]:   <metadata>
Nov 28 17:13:54 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:13:54 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:13:54 user nova-compute[75246]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-147363844</nova:name>
Nov 28 17:13:54 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:13:54</nova:creationTime>
Nov 28 17:13:54 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:13:54 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:13:54 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:13:54 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:13:54 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:13:54 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:13:54 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:13:54 user nova-compute[75246]:       <nova:owner>
Nov 28 17:13:54 user nova-compute[75246]:         <nova:user uuid="af8b6c3f092547dbbf3debe96c594590">tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member</nova:user>
Nov 28 17:13:54 user nova-compute[75246]:         <nova:project uuid="faec5bcef3e2441fba30b593c13d5516">tempest-ServerBootFromVolumeStableRescueTest-506006079</nova:project>
Nov 28 17:13:54 user nova-compute[75246]:       </nova:owner>
Nov 28 17:13:54 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:13:54 user nova-compute[75246]:       <nova:ports>
Nov 28 17:13:54 user nova-compute[75246]:         <nova:port uuid="003f5480-4452-4891-8713-532403877f31">
Nov 28 17:13:54 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 17:13:54 user nova-compute[75246]:         </nova:port>
Nov 28 17:13:54 user nova-compute[75246]:       </nova:ports>
Nov 28 17:13:54 user nova-compute[75246]:     </nova:instance>
Nov 28 17:13:54 user nova-compute[75246]:   </metadata>
Nov 28 17:13:54 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:13:54 user nova-compute[75246]:     <system>
Nov 28 17:13:54 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:13:54 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:13:54 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:13:54 user nova-compute[75246]:       <entry name="serial">894da7a3-9c67-417e-b0f4-306335a533e6</entry>
Nov 28 17:13:54 user nova-compute[75246]:       <entry name="uuid">894da7a3-9c67-417e-b0f4-306335a533e6</entry>
Nov 28 17:13:54 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:13:54 user nova-compute[75246]:     </system>
Nov 28 17:13:54 user nova-compute[75246]:   </sysinfo>
Nov 28 17:13:54 user nova-compute[75246]:   <os>
Nov 28 17:13:54 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:13:54 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:13:54 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:13:54 user nova-compute[75246]:   </os>
Nov 28 17:13:54 user nova-compute[75246]:   <features>
Nov 28 17:13:54 user nova-compute[75246]:     <acpi/>
Nov 28 17:13:54 user nova-compute[75246]:     <apic/>
Nov 28 17:13:54 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:13:54 user nova-compute[75246]:   </features>
Nov 28 17:13:54 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:13:54 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:13:54 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:13:54 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:13:54 user nova-compute[75246]:   </clock>
Nov 28 17:13:54 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:13:54 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:13:54 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:13:54 user nova-compute[75246]:   </cpu>
Nov 28 17:13:54 user nova-compute[75246]:   <devices>
Nov 28 17:13:54 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:13:54 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:13:54 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk"/>
Nov 28 17:13:54 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:13:54 user nova-compute[75246]:     </disk>
Nov 28 17:13:54 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:13:54 user nova-compute[75246]:       <mac address="fa:16:3e:8d:b0:79"/>
Nov 28 17:13:54 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:13:54 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:13:54 user nova-compute[75246]:       <target dev="tap003f5480-44"/>
Nov 28 17:13:54 user nova-compute[75246]:     </interface>
Nov 28 17:13:54 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:13:54 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/console.log" append="off"/>
Nov 28 17:13:54 user nova-compute[75246]:     </serial>
Nov 28 17:13:54 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:13:54 user nova-compute[75246]:     <video>
Nov 28 17:13:54 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:13:54 user nova-compute[75246]:     </video>
Nov 28 17:13:54 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:13:54 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:13:54 user nova-compute[75246]:     </rng>
Nov 28 17:13:54 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:13:54 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:13:54 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:13:54 user nova-compute[75246]:     </memballoon>
Nov 28 17:13:54 user nova-compute[75246]:   </devices>
Nov 28 17:13:54 user nova-compute[75246]: </domain>
Nov 28 17:13:54 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:13:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-147363844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-147363844',id=33,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faec5bcef3e2441fba30b593c13d5516',ramdisk_id='',reservation_id='r-i4q709fp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-506006079',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:13:53Z,user_data=None,user_id='af8b6c3f092547dbbf3debe96c594590',uuid=894da7a3-9c67-417e-b0f4-306335a533e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "003f5480-4452-4891-8713-532403877f31", "address": "fa:16:3e:8d:b0:79", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap003f5480-44", "ovs_interfaceid": "003f5480-4452-4891-8713-532403877f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converting VIF {"id": "003f5480-4452-4891-8713-532403877f31", "address": "fa:16:3e:8d:b0:79", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap003f5480-44", "ovs_interfaceid": "003f5480-4452-4891-8713-532403877f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b0:79,bridge_name='br-int',has_traffic_filtering=True,id=003f5480-4452-4891-8713-532403877f31,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap003f5480-44') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_vif [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b0:79,bridge_name='br-int',has_traffic_filtering=True,id=003f5480-4452-4891-8713-532403877f31,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap003f5480-44') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[843b08ef-9250-4044-b88d-93cc244787c6]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08f6c4f1-00a9-57c0-85ed-86f316793aa9', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap003f5480-44, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap003f5480-44, col_values=(('qos', UUID('b1a38657-172a-4d91-a9dc-61879b1e5416')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap003f5480-44, col_values=(('external_ids', {'iface-id': '003f5480-4452-4891-8713-532403877f31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:b0:79', 'vm-uuid': '894da7a3-9c67-417e-b0f4-306335a533e6'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[74738aa9-8c22-41c1-ad02-0c907ace93db]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:13:54 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:13:54 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:13:54 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:13:54 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:13:54 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:13:54 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:54 user nova-compute[75246]: INFO os_vif [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b0:79,bridge_name='br-int',has_traffic_filtering=True,id=003f5480-4452-4891-8713-532403877f31,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap003f5480-44')
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d986e30-e957-4122-ae2e-e59c9ffbab02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa, portal: 172.16.0.220,3260]
Nov 28 17:13:54 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa, portal: 172.16.0.220,3260] successful.
Nov 28 17:13:54 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] No VIF found with MAC fa:16:3e:8d:b0:79, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec4e862-34b0-43aa-bd32-96d6dde26abf]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b11c5d-5d26-43a7-b85d-8bffc1b196de]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:13:54 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:13:54 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:13:54 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:13:54 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:13:54 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:13:54 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:13:54 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:13:54 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[70277b00-1134-458e-b526-546df3fd8900]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:13:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLJHgbUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:13:55 user nova-compute[75246]: DEBUG nova.network.neutron [req-3bbf9109-0740-4959-b81b-0bc39957e25a req-000c5ba2-8c0b-4004-8add-75ae7edf4802 service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Updated VIF entry in instance network info cache for port 003f5480-4452-4891-8713-532403877f31. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:13:55 user nova-compute[75246]: DEBUG nova.network.neutron [req-3bbf9109-0740-4959-b81b-0bc39957e25a req-000c5ba2-8c0b-4004-8add-75ae7edf4802 service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Updating instance_info_cache with network_info: [{"id": "003f5480-4452-4891-8713-532403877f31", "address": "fa:16:3e:8d:b0:79", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap003f5480-44", "ovs_interfaceid": "003f5480-4452-4891-8713-532403877f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:13:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3bbf9109-0740-4959-b81b-0bc39957e25a req-000c5ba2-8c0b-4004-8add-75ae7edf4802 service nova] Releasing lock "refresh_cache-894da7a3-9c67-417e-b0f4-306335a533e6" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:13:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:13:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23433313133313162', 'path': '/dev/sdb'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:13:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433313133313162', 'path': '/dev/sdb'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:13:55 user nova-compute[75246]: DEBUG nova.objects.instance [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lazy-loading 'flavor' on Instance uuid 620ce71b-8ce0-492a-ac7e-72dd12987bfa {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:13:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:13:55 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:13:55 user nova-compute[75246]:   <source dev="/dev/sdb"/>
Nov 28 17:13:55 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:13:55 user nova-compute[75246]:   <serial>cf9c2de4-53e1-4251-b2c3-49e6365bd7fa</serial>
Nov 28 17:13:55 user nova-compute[75246]: </disk>
Nov 28 17:13:55 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:13:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:56 user nova-compute[75246]: DEBUG nova.compute.manager [req-7b9e9e37-5aff-48cf-bdb6-dd7cc248be78 req-6b65c21a-6e80-40ce-839a-cb2779ce1918 service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Received event network-vif-plugged-003f5480-4452-4891-8713-532403877f31 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:13:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7b9e9e37-5aff-48cf-bdb6-dd7cc248be78 req-6b65c21a-6e80-40ce-839a-cb2779ce1918 service nova] Acquiring lock "894da7a3-9c67-417e-b0f4-306335a533e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7b9e9e37-5aff-48cf-bdb6-dd7cc248be78 req-6b65c21a-6e80-40ce-839a-cb2779ce1918 service nova] Lock "894da7a3-9c67-417e-b0f4-306335a533e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7b9e9e37-5aff-48cf-bdb6-dd7cc248be78 req-6b65c21a-6e80-40ce-839a-cb2779ce1918 service nova] Lock "894da7a3-9c67-417e-b0f4-306335a533e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:56 user nova-compute[75246]: DEBUG nova.compute.manager [req-7b9e9e37-5aff-48cf-bdb6-dd7cc248be78 req-6b65c21a-6e80-40ce-839a-cb2779ce1918 service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] No waiting events found dispatching network-vif-plugged-003f5480-4452-4891-8713-532403877f31 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:13:56 user nova-compute[75246]: WARNING nova.compute.manager [req-7b9e9e37-5aff-48cf-bdb6-dd7cc248be78 req-6b65c21a-6e80-40ce-839a-cb2779ce1918 service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Received unexpected event network-vif-plugged-003f5480-4452-4891-8713-532403877f31 for instance with vm_state building and task_state spawning.
Nov 28 17:13:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:13:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:13:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] No VIF found with MAC fa:16:3e:6a:5d:8b, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:13:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c32ff799-cd09-4b95-972a-21da771f77ac tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.455s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:58 user nova-compute[75246]: DEBUG nova.compute.manager [req-ef757291-aa5a-4ba3-9c74-3723ee69064f req-3dd120ae-6fd6-4f83-a82b-c9cf28e73a87 service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Received event network-vif-plugged-003f5480-4452-4891-8713-532403877f31 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:13:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ef757291-aa5a-4ba3-9c74-3723ee69064f req-3dd120ae-6fd6-4f83-a82b-c9cf28e73a87 service nova] Acquiring lock "894da7a3-9c67-417e-b0f4-306335a533e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ef757291-aa5a-4ba3-9c74-3723ee69064f req-3dd120ae-6fd6-4f83-a82b-c9cf28e73a87 service nova] Lock "894da7a3-9c67-417e-b0f4-306335a533e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ef757291-aa5a-4ba3-9c74-3723ee69064f req-3dd120ae-6fd6-4f83-a82b-c9cf28e73a87 service nova] Lock "894da7a3-9c67-417e-b0f4-306335a533e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:58 user nova-compute[75246]: DEBUG nova.compute.manager [req-ef757291-aa5a-4ba3-9c74-3723ee69064f req-3dd120ae-6fd6-4f83-a82b-c9cf28e73a87 service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] No waiting events found dispatching network-vif-plugged-003f5480-4452-4891-8713-532403877f31 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:13:58 user nova-compute[75246]: WARNING nova.compute.manager [req-ef757291-aa5a-4ba3-9c74-3723ee69064f req-3dd120ae-6fd6-4f83-a82b-c9cf28e73a87 service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Received unexpected event network-vif-plugged-003f5480-4452-4891-8713-532403877f31 for instance with vm_state building and task_state spawning.
Nov 28 17:13:58 user nova-compute[75246]: DEBUG nova.compute.manager [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:13:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:13:58 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Instance spawned successfully.
Nov 28 17:13:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:13:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:13:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:13:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:13:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:13:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:13:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:13:58 user nova-compute[75246]: INFO nova.compute.manager [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Took 5.71 seconds to spawn the instance on the hypervisor.
Nov 28 17:13:58 user nova-compute[75246]: DEBUG nova.compute.manager [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:13:58 user nova-compute[75246]: INFO nova.compute.manager [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Took 6.45 seconds to build instance.
Nov 28 17:13:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-563da087-c80b-4adf-ab58-0e3f3cd4a462 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "894da7a3-9c67-417e-b0f4-306335a533e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.547s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lazy-loading 'flavor' on Instance uuid 620ce71b-8ce0-492a-ac7e-72dd12987bfa {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:13:59 user nova-compute[75246]: INFO nova.compute.manager [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Attaching volume 0b3fcfd3-af27-42b7-9e86-a6df72525206 to /dev/vdc
Nov 28 17:13:59 user nova-compute[75246]: DEBUG os_brick.utils [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9242c92e-777a-4310-bce1-920a8a8b29cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b08bd9-e850-44d4-8c0e-f9e2f7868268]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa2bd1e-c737-4b16-9e81-ebdd0e7ad802]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1350cf6-7dc8-4b84-b43a-f52eee734f66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:13:59 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:13:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6750c6-1fb7-46a6-9480-e8925820725a]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG os_brick.utils [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:13:59 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Updating existing volume attachment record: f51a01f7-6dec-4844-b926-0e497def1e94 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:14:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:05 user nova-compute[75246]: DEBUG nova.compute.manager [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:14:05 user nova-compute[75246]: INFO nova.compute.manager [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] instance snapshotting
Nov 28 17:14:05 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Beginning live snapshot process
Nov 28 17:14:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json -f qcow2 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json -f qcow2 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_kr07a5k/74326cf50a9b4720b6007baa7b8a34f9.delta 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_kr07a5k/74326cf50a9b4720b6007baa7b8a34f9.delta 1073741824" returned: 0 in 0.046s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:06 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 17:14:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] COPY block job progress, current cursor: 131072 final cursor: 75563008 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG nova.compute.manager [req-0198aed3-cf6d-4e95-97b3-b7f46c45bf9f req-64179487-ffe9-4f34-bdfa-3062820cdc02 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received event network-changed-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG nova.compute.manager [req-0198aed3-cf6d-4e95-97b3-b7f46c45bf9f req-64179487-ffe9-4f34-bdfa-3062820cdc02 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Refreshing instance network info cache due to event network-changed-5f6b2b48-5c6d-4528-95dd-e7eb24780e37. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0198aed3-cf6d-4e95-97b3-b7f46c45bf9f req-64179487-ffe9-4f34-bdfa-3062820cdc02 service nova] Acquiring lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0198aed3-cf6d-4e95-97b3-b7f46c45bf9f req-64179487-ffe9-4f34-bdfa-3062820cdc02 service nova] Acquired lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG nova.network.neutron [req-0198aed3-cf6d-4e95-97b3-b7f46c45bf9f req-64179487-ffe9-4f34-bdfa-3062820cdc02 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Refreshing network info cache for port 5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "90829136-472b-4c45-9607-c28433d05f56" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG nova.objects.instance [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'flavor' on Instance uuid 90829136-472b-4c45-9607-c28433d05f56 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "90829136-472b-4c45-9607-c28433d05f56" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:14:07 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "90829136-472b-4c45-9607-c28433d05f56" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:07 user nova-compute[75246]: INFO nova.compute.manager [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Attaching volume 97a00ba4-d68c-4715-abeb-e888a22a0158 to /dev/vdb
Nov 28 17:14:07 user nova-compute[75246]: DEBUG nova.privsep.utils [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75246) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_kr07a5k/74326cf50a9b4720b6007baa7b8a34f9.delta /opt/stack/data/nova/instances/snapshots/tmp_kr07a5k/74326cf50a9b4720b6007baa7b8a34f9 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG os_brick.utils [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG nova.network.neutron [req-0198aed3-cf6d-4e95-97b3-b7f46c45bf9f req-64179487-ffe9-4f34-bdfa-3062820cdc02 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Updated VIF entry in instance network info cache for port 5f6b2b48-5c6d-4528-95dd-e7eb24780e37. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG nova.network.neutron [req-0198aed3-cf6d-4e95-97b3-b7f46c45bf9f req-64179487-ffe9-4f34-bdfa-3062820cdc02 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Updating instance_info_cache with network_info: [{"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b4f76a-d028-4094-a0ec-0845516b8212]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[16196c6b-ce5b-4a4e-bbbc-26b9a46d7623]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0198aed3-cf6d-4e95-97b3-b7f46c45bf9f req-64179487-ffe9-4f34-bdfa-3062820cdc02 service nova] Releasing lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e4097d-dd50-4fa2-9b37-b360d97bb263]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[41227aea-dc2e-4508-92a8-dfef3d9c9bc8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:14:07 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:14:07 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b69464-f1e6-4812-bbc8-b5e9147f8aa2]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG os_brick.utils [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:14:07 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Updating existing volume attachment record: 745ef7bf-5e4e-4f9c-bc12-f5799b73751e {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:14:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_kr07a5k/74326cf50a9b4720b6007baa7b8a34f9.delta /opt/stack/data/nova/instances/snapshots/tmp_kr07a5k/74326cf50a9b4720b6007baa7b8a34f9" returned: 0 in 0.759s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:08 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Snapshot extracted, beginning image upload
Nov 28 17:14:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-6a5349dd-b2bc-4a3f-abf4-83eb42efc0bf req-903677c6-56cf-4598-b586-00778a396729 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received event network-changed-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:14:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-6a5349dd-b2bc-4a3f-abf4-83eb42efc0bf req-903677c6-56cf-4598-b586-00778a396729 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Refreshing instance network info cache due to event network-changed-434dbbbd-947d-47c5-a794-4fee8690d835. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:14:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6a5349dd-b2bc-4a3f-abf4-83eb42efc0bf req-903677c6-56cf-4598-b586-00778a396729 service nova] Acquiring lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:14:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6a5349dd-b2bc-4a3f-abf4-83eb42efc0bf req-903677c6-56cf-4598-b586-00778a396729 service nova] Acquired lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:14:09 user nova-compute[75246]: DEBUG nova.network.neutron [req-6a5349dd-b2bc-4a3f-abf4-83eb42efc0bf req-903677c6-56cf-4598-b586-00778a396729 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Refreshing network info cache for port 434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:14:09 user nova-compute[75246]: DEBUG nova.network.neutron [req-6a5349dd-b2bc-4a3f-abf4-83eb42efc0bf req-903677c6-56cf-4598-b586-00778a396729 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Updated VIF entry in instance network info cache for port 434dbbbd-947d-47c5-a794-4fee8690d835. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:14:09 user nova-compute[75246]: DEBUG nova.network.neutron [req-6a5349dd-b2bc-4a3f-abf4-83eb42efc0bf req-903677c6-56cf-4598-b586-00778a396729 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Updating instance_info_cache with network_info: [{"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:14:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6a5349dd-b2bc-4a3f-abf4-83eb42efc0bf req-903677c6-56cf-4598-b586-00778a396729 service nova] Releasing lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:14:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:11 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Snapshot image upload complete
Nov 28 17:14:11 user nova-compute[75246]: INFO nova.compute.manager [None req-d52030b4-5295-461e-ad52-e1bb53197c52 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Took 5.77 seconds to snapshot the instance on the hypervisor.
Nov 28 17:14:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:14:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcELVxsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:14:11 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:14:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:14:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:14:11 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:14:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:14:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:14:11 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:14:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:11 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcc5dc7-077d-4acf-b321-b8fdae805c7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:14:11 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:11 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbca5bc-0e38-42b4-89e0-a3e2975cee2d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206] added
Nov 28 17:14:11 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82341d5-d567-43da-8b9b-334310b237cc]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16dca6a-e493-418f-b144-1809f3e8a05f]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WcELVxsB {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WcELVxsB" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b15757-b7e7-4d72-8760-d104e19a5d5f]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WcELVxsB'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[860a66b1-c202-475a-8c30-ede70c365c35]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2da967-a438-4368-b228-e742114073eb]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:14:12 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:14:12 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:14:12 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:14:12 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:14:12 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:14:12 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:14:12 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:14:12 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[814a84d5-1ce3-4a5b-adb2-1312cb2cccb4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206, portal: 172.16.0.220,3260]
Nov 28 17:14:12 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206, portal: 172.16.0.220,3260] successful.
Nov 28 17:14:12 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[290a13c1-2781-4c9d-bdb3-bcbc88598694]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e0aa63-43d0-4273-b078-3c2b1243393f]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:14:12 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:14:12 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:14:12 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:14:12 user nova-compute[75246]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 (non-flash)
Nov 28 17:14:12 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:14:12 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:14:12 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:14:12 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:14:12 user nova-compute[75246]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 (non-flash)
Nov 28 17:14:12 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2eaadc-46bf-4892-8514-bb8f90e84795]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:14:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcELVxsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:14:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:14:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23963646637373831', 'path': '/dev/sdd'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:14:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963646637373831', 'path': '/dev/sdd'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:14:13 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lazy-loading 'flavor' on Instance uuid 620ce71b-8ce0-492a-ac7e-72dd12987bfa {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:14:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:14:13 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:14:13 user nova-compute[75246]:   <source dev="/dev/sdd"/>
Nov 28 17:14:13 user nova-compute[75246]:   <target dev="vdc" bus="virtio"/>
Nov 28 17:14:13 user nova-compute[75246]:   <serial>0b3fcfd3-af27-42b7-9e86-a6df72525206</serial>
Nov 28 17:14:13 user nova-compute[75246]: </disk>
Nov 28 17:14:13 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:14:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:14:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:14:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:14:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] No VIF found with MAC fa:16:3e:6a:5d:8b, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:14:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "953ce3ec-438c-437a-90e8-4178529c1a32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "953ce3ec-438c-437a-90e8-4178529c1a32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:13 user nova-compute[75246]: DEBUG nova.compute.manager [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:14:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6499fe62-90a2-4a93-a45b-0fd27da8f9a1 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.212s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:13 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:14:13 user nova-compute[75246]: INFO nova.compute.claims [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Claim successful on node user
Nov 28 17:14:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:14 user nova-compute[75246]: INFO nova.compute.manager [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Shelving
Nov 28 17:14:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-1d0e207b-c512-4903-8b3e-745040c19f64 req-667106c1-d507-415e-8b7b-4b63ee2a84b4 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received event network-changed-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-1d0e207b-c512-4903-8b3e-745040c19f64 req-667106c1-d507-415e-8b7b-4b63ee2a84b4 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Refreshing instance network info cache due to event network-changed-cadf851f-d826-43fb-984d-4f15cafa5f64. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1d0e207b-c512-4903-8b3e-745040c19f64 req-667106c1-d507-415e-8b7b-4b63ee2a84b4 service nova] Acquiring lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1d0e207b-c512-4903-8b3e-745040c19f64 req-667106c1-d507-415e-8b7b-4b63ee2a84b4 service nova] Acquired lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG nova.network.neutron [req-1d0e207b-c512-4903-8b3e-745040c19f64 req-667106c1-d507-415e-8b7b-4b63ee2a84b4 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Refreshing network info cache for port cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:14 user nova-compute[75246]: INFO nova.compute.manager [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Detaching volume 0b3fcfd3-af27-42b7-9e86-a6df72525206
Nov 28 17:14:14 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:14:14 user nova-compute[75246]: INFO nova.virt.block_device [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Attempting to driver detach volume 0b3fcfd3-af27-42b7-9e86-a6df72525206 from mountpoint /dev/vdc
Nov 28 17:14:14 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Attempting to detach device vdc from instance 620ce71b-8ce0-492a-ac7e-72dd12987bfa from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:14:14 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:14:14 user nova-compute[75246]:   <source dev="/dev/sdd"/>
Nov 28 17:14:14 user nova-compute[75246]:   <target dev="vdc" bus="virtio"/>
Nov 28 17:14:14 user nova-compute[75246]:   <serial>0b3fcfd3-af27-42b7-9e86-a6df72525206</serial>
Nov 28 17:14:14 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 17:14:14 user nova-compute[75246]: </disk>
Nov 28 17:14:14 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.701s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG nova.compute.manager [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:14:14 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Successfully detached device vdc from instance 620ce71b-8ce0-492a-ac7e-72dd12987bfa from the persistent domain config.
Nov 28 17:14:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 620ce71b-8ce0-492a-ac7e-72dd12987bfa from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:14:14 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:14:14 user nova-compute[75246]:   <source dev="/dev/sdd"/>
Nov 28 17:14:14 user nova-compute[75246]:   <target dev="vdc" bus="virtio"/>
Nov 28 17:14:14 user nova-compute[75246]:   <serial>0b3fcfd3-af27-42b7-9e86-a6df72525206</serial>
Nov 28 17:14:14 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 17:14:14 user nova-compute[75246]: </disk>
Nov 28 17:14:14 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG nova.compute.manager [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG nova.network.neutron [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-d266f6f9-7801-4ba4-9abb-de6e1c46f931 req-bed0538f-aff6-4505-b418-f32fdf212f12 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received event network-vif-unplugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d266f6f9-7801-4ba4-9abb-de6e1c46f931 req-bed0538f-aff6-4505-b418-f32fdf212f12 service nova] Acquiring lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d266f6f9-7801-4ba4-9abb-de6e1c46f931 req-bed0538f-aff6-4505-b418-f32fdf212f12 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d266f6f9-7801-4ba4-9abb-de6e1c46f931 req-bed0538f-aff6-4505-b418-f32fdf212f12 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-d266f6f9-7801-4ba4-9abb-de6e1c46f931 req-bed0538f-aff6-4505-b418-f32fdf212f12 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] No waiting events found dispatching network-vif-unplugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:14:14 user nova-compute[75246]: WARNING nova.compute.manager [req-d266f6f9-7801-4ba4-9abb-de6e1c46f931 req-bed0538f-aff6-4505-b418-f32fdf212f12 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received unexpected event network-vif-unplugged-434dbbbd-947d-47c5-a794-4fee8690d835 for instance with vm_state active and task_state shelving.
Nov 28 17:14:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:14 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:14:14 user nova-compute[75246]: DEBUG nova.compute.manager [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:14:15 user nova-compute[75246]: DEBUG nova.compute.manager [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:14:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:14:15 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Creating image(s)
Nov 28 17:14:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "/opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "/opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "/opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "3c1523c047b31aa2dd58c5fa2fd28fd74bd62951" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "3c1523c047b31aa2dd58c5fa2fd28fd74bd62951" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:15 user nova-compute[75246]: DEBUG nova.policy [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6897bba4a31544f78a2f1911294deb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84705237374f40e287bdc39098936027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951.part --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG nova.network.neutron [req-1d0e207b-c512-4903-8b3e-745040c19f64 req-667106c1-d507-415e-8b7b-4b63ee2a84b4 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Updated VIF entry in instance network info cache for port cadf851f-d826-43fb-984d-4f15cafa5f64. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG nova.network.neutron [req-1d0e207b-c512-4903-8b3e-745040c19f64 req-667106c1-d507-415e-8b7b-4b63ee2a84b4 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Updating instance_info_cache with network_info: [{"id": "cadf851f-d826-43fb-984d-4f15cafa5f64", "address": "fa:16:3e:74:a8:07", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadf851f-d8", "ovs_interfaceid": "cadf851f-d826-43fb-984d-4f15cafa5f64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-3a56339f-bf05-4393-8ae8-5be4840432c5 req-e809946c-d98a-4c42-b756-397f8da9fbe3 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received event network-changed-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-3a56339f-bf05-4393-8ae8-5be4840432c5 req-e809946c-d98a-4c42-b756-397f8da9fbe3 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Refreshing instance network info cache due to event network-changed-cadf851f-d826-43fb-984d-4f15cafa5f64. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3a56339f-bf05-4393-8ae8-5be4840432c5 req-e809946c-d98a-4c42-b756-397f8da9fbe3 service nova] Acquiring lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 620ce71b-8ce0-492a-ac7e-72dd12987bfa {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:14:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Instance destroyed successfully.
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1d0e207b-c512-4903-8b3e-745040c19f64 req-667106c1-d507-415e-8b7b-4b63ee2a84b4 service nova] Releasing lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3a56339f-bf05-4393-8ae8-5be4840432c5 req-e809946c-d98a-4c42-b756-397f8da9fbe3 service nova] Acquired lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG nova.network.neutron [req-3a56339f-bf05-4393-8ae8-5be4840432c5 req-e809946c-d98a-4c42-b756-397f8da9fbe3 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Refreshing network info cache for port cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:14:16 user nova-compute[75246]: INFO nova.compute.manager [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Detaching volume e6996356-1723-436e-b213-9f94003fa05a
Nov 28 17:14:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Beginning cold snapshot process
Nov 28 17:14:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951.part --force-share --output=json" returned: 0 in 0.189s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG nova.virt.images [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] 0a52cb9e-4028-4c58-bd6f-8a79afe03f65 was qcow2, converting to raw {{(pid=75246) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG nova.privsep.utils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75246) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951.part /opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951.converted {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:16 user nova-compute[75246]: INFO nova.virt.block_device [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Attempting to driver detach volume e6996356-1723-436e-b213-9f94003fa05a from mountpoint /dev/vdb
Nov 28 17:14:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Attempting to detach device vdb from instance 36e65da9-4cc0-4d73-9e5d-e64520e08f34 from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:14:16 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:14:16 user nova-compute[75246]:   <source dev="/dev/sdh"/>
Nov 28 17:14:16 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:14:16 user nova-compute[75246]:   <serial>e6996356-1723-436e-b213-9f94003fa05a</serial>
Nov 28 17:14:16 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:14:16 user nova-compute[75246]: </disk>
Nov 28 17:14:16 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:14:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Successfully detached device vdb from instance 36e65da9-4cc0-4d73-9e5d-e64520e08f34 from the persistent domain config.
Nov 28 17:14:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 36e65da9-4cc0-4d73-9e5d-e64520e08f34 from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:14:16 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:14:16 user nova-compute[75246]:   <source dev="/dev/sdh"/>
Nov 28 17:14:16 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:14:16 user nova-compute[75246]:   <serial>e6996356-1723-436e-b213-9f94003fa05a</serial>
Nov 28 17:14:16 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:14:16 user nova-compute[75246]: </disk>
Nov 28 17:14:16 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bWeKInFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:14:16 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:14:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:14:16 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:14:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:14:16 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[efeafd07-b2d0-49e5-be86-c14df1fbab51]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:14:16 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG nova.privsep.utils [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75246) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk /opt/stack/data/nova/instances/snapshots/tmpn4w1s8zc/75620e9cb9224f3bae3d963fbda8b581 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951.part /opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951.converted" returned: 0 in 0.265s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e0a002-201b-4ffc-a1ac-95cbe18e4983]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951.converted --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158] added
Nov 28 17:14:16 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-dea2f513-c25d-4c25-883c-abb48cf868c8 req-d63964bf-045f-4bb7-bd1c-c75cb26a69e5 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received event network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-dea2f513-c25d-4c25-883c-abb48cf868c8 req-d63964bf-045f-4bb7-bd1c-c75cb26a69e5 service nova] Acquiring lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-dea2f513-c25d-4c25-883c-abb48cf868c8 req-d63964bf-045f-4bb7-bd1c-c75cb26a69e5 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-dea2f513-c25d-4c25-883c-abb48cf868c8 req-d63964bf-045f-4bb7-bd1c-c75cb26a69e5 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-dea2f513-c25d-4c25-883c-abb48cf868c8 req-d63964bf-045f-4bb7-bd1c-c75cb26a69e5 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] No waiting events found dispatching network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:14:16 user nova-compute[75246]: WARNING nova.compute.manager [req-dea2f513-c25d-4c25-883c-abb48cf868c8 req-d63964bf-045f-4bb7-bd1c-c75cb26a69e5 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received unexpected event network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.138s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2786f33-80a5-4a4c-af2b-ca9bba6c246a]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "3c1523c047b31aa2dd58c5fa2fd28fd74bd62951" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.859s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93ee87a-d6e9-4952-a889-e7610f8eaa2b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bWeKInFP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bWeKInFP" returned: 0 in 0.036s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc898b1d-9bcd-41b4-8b8b-715d8d4acb88]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bWeKInFP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4bcb06-93e1-47bb-8abb-69f203494e40]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 36e65da9-4cc0-4d73-9e5d-e64520e08f34 {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1e272d-02e1-4367-9faf-bf593eb64dff]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:14:17 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:14:17 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:14:17 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:14:17 user nova-compute[75246]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 (non-flash)
Nov 28 17:14:17 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:14:17 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:14:17 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:14:17 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:14:17 user nova-compute[75246]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 (non-flash)
Nov 28 17:14:17 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951 --force-share --output=json" returned: 0 in 0.212s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "3c1523c047b31aa2dd58c5fa2fd28fd74bd62951" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "3c1523c047b31aa2dd58c5fa2fd28fd74bd62951" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --login" returned: 0 in 0.172s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45805b8-c1f5-4efd-8ab4-cf4cf8068923]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158, portal: 172.16.0.220,3260]
Nov 28 17:14:17 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158, portal: 172.16.0.220,3260] successful.
Nov 28 17:14:17 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7070ec14-d218-4561-85cc-cb53af7e8b92]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2458bcde-4c70-449b-9ced-ed1d1a7d7514]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:14:17 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:14:17 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:14:17 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:14:17 user nova-compute[75246]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 (non-flash)
Nov 28 17:14:17 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:14:17 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:14:17 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:14:17 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:14:17 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:14:17 user nova-compute[75246]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 (non-flash)
Nov 28 17:14:17 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:14:17 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.716s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951 --force-share --output=json" returned: 0 in 0.201s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951,backing_fmt=raw /opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21af665-404a-4397-9566-a1713ccf657c]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bWeKInFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951,backing_fmt=raw /opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/disk 1073741824" returned: 0 in 0.068s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "3c1523c047b31aa2dd58c5fa2fd28fd74bd62951" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk /opt/stack/data/nova/instances/snapshots/tmpn4w1s8zc/75620e9cb9224f3bae3d963fbda8b581" returned: 0 in 0.843s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:17 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Snapshot extracted, beginning image upload
Nov 28 17:14:17 user nova-compute[75246]: DEBUG nova.network.neutron [req-3a56339f-bf05-4393-8ae8-5be4840432c5 req-e809946c-d98a-4c42-b756-397f8da9fbe3 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Updated VIF entry in instance network info cache for port cadf851f-d826-43fb-984d-4f15cafa5f64. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG nova.network.neutron [req-3a56339f-bf05-4393-8ae8-5be4840432c5 req-e809946c-d98a-4c42-b756-397f8da9fbe3 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Updating instance_info_cache with network_info: [{"id": "cadf851f-d826-43fb-984d-4f15cafa5f64", "address": "fa:16:3e:74:a8:07", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadf851f-d8", "ovs_interfaceid": "cadf851f-d826-43fb-984d-4f15cafa5f64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951 --force-share --output=json" returned: 0 in 0.204s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Ensure instance console log exists: /opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG nova.network.neutron [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Successfully created port: 4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:14:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3a56339f-bf05-4393-8ae8-5be4840432c5 req-e809946c-d98a-4c42-b756-397f8da9fbe3 service nova] Releasing lock "refresh_cache-36e65da9-4cc0-4d73-9e5d-e64520e08f34" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.801s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] <== connect_volume: return (1807ms) {'type': 'block', 'scsi_wwn': '23032326436346561', 'path': '/dev/sde'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032326436346561', 'path': '/dev/sde'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.objects.instance [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'flavor' on Instance uuid 90829136-472b-4c45-9607-c28433d05f56 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:14:18 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:14:18 user nova-compute[75246]:   <source dev="/dev/sde"/>
Nov 28 17:14:18 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:14:18 user nova-compute[75246]:   <serial>97a00ba4-d68c-4715-abeb-e888a22a0158</serial>
Nov 28 17:14:18 user nova-compute[75246]: </disk>
Nov 28 17:14:18 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.network.neutron [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Successfully updated port: 4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "refresh_cache-953ce3ec-438c-437a-90e8-4178529c1a32" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquired lock "refresh_cache-953ce3ec-438c-437a-90e8-4178529c1a32" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.network.neutron [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-8877e978-7df0-4cef-a66d-d02aa6e199ff req-67b9b759-3cef-4ab6-9a9a-abc543a5cb9e service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Received event network-changed-4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-8877e978-7df0-4cef-a66d-d02aa6e199ff req-67b9b759-3cef-4ab6-9a9a-abc543a5cb9e service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Refreshing instance network info cache due to event network-changed-4cd5853c-099d-4ec5-91b6-475f7c703aeb. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8877e978-7df0-4cef-a66d-d02aa6e199ff req-67b9b759-3cef-4ab6-9a9a-abc543a5cb9e service nova] Acquiring lock "refresh_cache-953ce3ec-438c-437a-90e8-4178529c1a32" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.network.neutron [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.network.neutron [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Updating instance_info_cache with network_info: [{"id": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "address": "fa:16:3e:bc:39:fe", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5853c-09", "ovs_interfaceid": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] No VIF found with MAC fa:16:3e:1a:7d:4a, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Releasing lock "refresh_cache-953ce3ec-438c-437a-90e8-4178529c1a32" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Instance network_info: |[{"id": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "address": "fa:16:3e:bc:39:fe", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5853c-09", "ovs_interfaceid": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8877e978-7df0-4cef-a66d-d02aa6e199ff req-67b9b759-3cef-4ab6-9a9a-abc543a5cb9e service nova] Acquired lock "refresh_cache-953ce3ec-438c-437a-90e8-4178529c1a32" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.network.neutron [req-8877e978-7df0-4cef-a66d-d02aa6e199ff req-67b9b759-3cef-4ab6-9a9a-abc543a5cb9e service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Refreshing network info cache for port 4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Start _get_guest_xml network_info=[{"id": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "address": "fa:16:3e:bc:39:fe", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5853c-09", "ovs_interfaceid": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d4f8a1757ca722e05223092f1a0f7879',container_format='bare',created_at=2023-11-28T17:14:05Z,direct_url=<?>,disk_format='qcow2',id=0a52cb9e-4028-4c58-bd6f-8a79afe03f65,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1545093628',owner='84705237374f40e287bdc39098936027',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T17:14:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '0a52cb9e-4028-4c58-bd6f-8a79afe03f65'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:14:18 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:14:18 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d4f8a1757ca722e05223092f1a0f7879',container_format='bare',created_at=2023-11-28T17:14:05Z,direct_url=<?>,disk_format='qcow2',id=0a52cb9e-4028-4c58-bd6f-8a79afe03f65,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1545093628',owner='84705237374f40e287bdc39098936027',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T17:14:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:14:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-675220610',display_name='tempest-TestStampPattern-server-675220610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-675220610',id=34,image_ref='0a52cb9e-4028-4c58-bd6f-8a79afe03f65',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnj4hviUDvSX6hriv+L/QlZItoNaDMhnx3xQZWny569+OHLO66OwUH6l0a05JpEbHna9f+mLN7Ii3Ir+MVNbuGgRCX/YzUtBIJTlrG7CTESk7NAniXb5lC2lIImNVOo0A==',key_name='tempest-TestStampPattern-150119392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84705237374f40e287bdc39098936027',ramdisk_id='',reservation_id='r-auigz48y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0ed72d2a-ca9b-4b99-b422-86fa93af945c',image_min_disk='1',image_min_ram='0',image_owner_id='84705237374f40e287bdc39098936027',image_owner_project_name='tempest-TestStampPattern-1581372233',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1581372233-project-member',image_user_id='6897bba4a31544f78a2f1911294deb97',network_allocated='True',owner_project_name='tempest-TestStampPattern-1581372233',owner_user_name='tempest-TestStampPattern-1581372233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:14:15Z,user_data=None,user_id='6897bba4a31544f78a2f1911294deb97',uuid=953ce3ec-438c-437a-90e8-4178529c1a32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "address": "fa:16:3e:bc:39:fe", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5853c-09", "ovs_interfaceid": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Converting VIF {"id": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "address": "fa:16:3e:bc:39:fe", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5853c-09", "ovs_interfaceid": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:39:fe,bridge_name='br-int',has_traffic_filtering=True,id=4cd5853c-099d-4ec5-91b6-475f7c703aeb,network=Network(ce13947d-26bc-4814-afed-38b0697cb13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5853c-09') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.objects.instance [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lazy-loading 'pci_devices' on Instance uuid 953ce3ec-438c-437a-90e8-4178529c1a32 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:14:18 user nova-compute[75246]:   <uuid>953ce3ec-438c-437a-90e8-4178529c1a32</uuid>
Nov 28 17:14:18 user nova-compute[75246]:   <name>instance-00000022</name>
Nov 28 17:14:18 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:14:18 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:14:18 user nova-compute[75246]:   <metadata>
Nov 28 17:14:18 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:14:18 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:14:18 user nova-compute[75246]:       <nova:name>tempest-TestStampPattern-server-675220610</nova:name>
Nov 28 17:14:18 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:14:18</nova:creationTime>
Nov 28 17:14:18 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:14:18 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:14:18 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:14:18 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:14:18 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:14:18 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:14:18 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:14:18 user nova-compute[75246]:       <nova:owner>
Nov 28 17:14:18 user nova-compute[75246]:         <nova:user uuid="6897bba4a31544f78a2f1911294deb97">tempest-TestStampPattern-1581372233-project-member</nova:user>
Nov 28 17:14:18 user nova-compute[75246]:         <nova:project uuid="84705237374f40e287bdc39098936027">tempest-TestStampPattern-1581372233</nova:project>
Nov 28 17:14:18 user nova-compute[75246]:       </nova:owner>
Nov 28 17:14:18 user nova-compute[75246]:       <nova:root type="image" uuid="0a52cb9e-4028-4c58-bd6f-8a79afe03f65"/>
Nov 28 17:14:18 user nova-compute[75246]:       <nova:ports>
Nov 28 17:14:18 user nova-compute[75246]:         <nova:port uuid="4cd5853c-099d-4ec5-91b6-475f7c703aeb">
Nov 28 17:14:18 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 17:14:18 user nova-compute[75246]:         </nova:port>
Nov 28 17:14:18 user nova-compute[75246]:       </nova:ports>
Nov 28 17:14:18 user nova-compute[75246]:     </nova:instance>
Nov 28 17:14:18 user nova-compute[75246]:   </metadata>
Nov 28 17:14:18 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:14:18 user nova-compute[75246]:     <system>
Nov 28 17:14:18 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:14:18 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:14:18 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:14:18 user nova-compute[75246]:       <entry name="serial">953ce3ec-438c-437a-90e8-4178529c1a32</entry>
Nov 28 17:14:18 user nova-compute[75246]:       <entry name="uuid">953ce3ec-438c-437a-90e8-4178529c1a32</entry>
Nov 28 17:14:18 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:14:18 user nova-compute[75246]:     </system>
Nov 28 17:14:18 user nova-compute[75246]:   </sysinfo>
Nov 28 17:14:18 user nova-compute[75246]:   <os>
Nov 28 17:14:18 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:14:18 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:14:18 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:14:18 user nova-compute[75246]:   </os>
Nov 28 17:14:18 user nova-compute[75246]:   <features>
Nov 28 17:14:18 user nova-compute[75246]:     <acpi/>
Nov 28 17:14:18 user nova-compute[75246]:     <apic/>
Nov 28 17:14:18 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:14:18 user nova-compute[75246]:   </features>
Nov 28 17:14:18 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:14:18 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:14:18 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:14:18 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:14:18 user nova-compute[75246]:   </clock>
Nov 28 17:14:18 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:14:18 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:14:18 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:14:18 user nova-compute[75246]:   </cpu>
Nov 28 17:14:18 user nova-compute[75246]:   <devices>
Nov 28 17:14:18 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:14:18 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:14:18 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/disk"/>
Nov 28 17:14:18 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:14:18 user nova-compute[75246]:     </disk>
Nov 28 17:14:18 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:14:18 user nova-compute[75246]:       <mac address="fa:16:3e:bc:39:fe"/>
Nov 28 17:14:18 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:14:18 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:14:18 user nova-compute[75246]:       <target dev="tap4cd5853c-09"/>
Nov 28 17:14:18 user nova-compute[75246]:     </interface>
Nov 28 17:14:18 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:14:18 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/console.log" append="off"/>
Nov 28 17:14:18 user nova-compute[75246]:     </serial>
Nov 28 17:14:18 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:14:18 user nova-compute[75246]:     <video>
Nov 28 17:14:18 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:14:18 user nova-compute[75246]:     </video>
Nov 28 17:14:18 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:14:18 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:14:18 user nova-compute[75246]:     </rng>
Nov 28 17:14:18 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:14:18 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:14:18 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:14:18 user nova-compute[75246]:     </memballoon>
Nov 28 17:14:18 user nova-compute[75246]:   </devices>
Nov 28 17:14:18 user nova-compute[75246]: </domain>
Nov 28 17:14:18 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:14:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-675220610',display_name='tempest-TestStampPattern-server-675220610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-675220610',id=34,image_ref='0a52cb9e-4028-4c58-bd6f-8a79afe03f65',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnj4hviUDvSX6hriv+L/QlZItoNaDMhnx3xQZWny569+OHLO66OwUH6l0a05JpEbHna9f+mLN7Ii3Ir+MVNbuGgRCX/YzUtBIJTlrG7CTESk7NAniXb5lC2lIImNVOo0A==',key_name='tempest-TestStampPattern-150119392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84705237374f40e287bdc39098936027',ramdisk_id='',reservation_id='r-auigz48y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0ed72d2a-ca9b-4b99-b422-86fa93af945c',image_min_disk='1',image_min_ram='0',image_owner_id='84705237374f40e287bdc39098936027',image_owner_project_name='tempest-TestStampPattern-1581372233',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1581372233-project-member',image_user_id='6897bba4a31544f78a2f1911294deb97',network_allocated='True',owner_project_name='tempest-TestStampPattern-1581372233',owner_user_name='tempest-TestStampPattern-1581372233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:14:15Z,user_data=None,user_id='6897bba4a31544f78a2f1911294deb97',uuid=953ce3ec-438c-437a-90e8-4178529c1a32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "address": "fa:16:3e:bc:39:fe", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5853c-09", "ovs_interfaceid": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Converting VIF {"id": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "address": "fa:16:3e:bc:39:fe", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5853c-09", "ovs_interfaceid": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:39:fe,bridge_name='br-int',has_traffic_filtering=True,id=4cd5853c-099d-4ec5-91b6-475f7c703aeb,network=Network(ce13947d-26bc-4814-afed-38b0697cb13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5853c-09') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG os_vif [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:39:fe,bridge_name='br-int',has_traffic_filtering=True,id=4cd5853c-099d-4ec5-91b6-475f7c703aeb,network=Network(ce13947d-26bc-4814-afed-38b0697cb13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5853c-09') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f689cade-7d9f-5efe-a493-d8149e480217', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cd5853c-09, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cd5853c-09, col_values=(('qos', UUID('e375afdb-9e92-4070-ae2a-84f4d39cd068')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cd5853c-09, col_values=(('external_ids', {'iface-id': '4cd5853c-099d-4ec5-91b6-475f7c703aeb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:39:fe', 'vm-uuid': '953ce3ec-438c-437a-90e8-4178529c1a32'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:14:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:19 user nova-compute[75246]: INFO os_vif [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:39:fe,bridge_name='br-int',has_traffic_filtering=True,id=4cd5853c-099d-4ec5-91b6-475f7c703aeb,network=Network(ce13947d-26bc-4814-afed-38b0697cb13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5853c-09')
Nov 28 17:14:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-edc00143-fb6a-4bad-8ea1-b6dbdaf5152b tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "90829136-472b-4c45-9607-c28433d05f56" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.449s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:14:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] No VIF found with MAC fa:16:3e:bc:39:fe, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:14:19 user nova-compute[75246]: DEBUG nova.network.neutron [req-8877e978-7df0-4cef-a66d-d02aa6e199ff req-67b9b759-3cef-4ab6-9a9a-abc543a5cb9e service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Updated VIF entry in instance network info cache for port 4cd5853c-099d-4ec5-91b6-475f7c703aeb. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:14:19 user nova-compute[75246]: DEBUG nova.network.neutron [req-8877e978-7df0-4cef-a66d-d02aa6e199ff req-67b9b759-3cef-4ab6-9a9a-abc543a5cb9e service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Updating instance_info_cache with network_info: [{"id": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "address": "fa:16:3e:bc:39:fe", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5853c-09", "ovs_interfaceid": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:14:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8877e978-7df0-4cef-a66d-d02aa6e199ff req-67b9b759-3cef-4ab6-9a9a-abc543a5cb9e service nova] Releasing lock "refresh_cache-953ce3ec-438c-437a-90e8-4178529c1a32" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:14:19 user nova-compute[75246]: INFO nova.compute.manager [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Rescuing
Nov 28 17:14:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:14:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquired lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:14:19 user nova-compute[75246]: DEBUG nova.network.neutron [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:14:20 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Snapshot image upload complete
Nov 28 17:14:20 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG nova.network.neutron [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Updating instance_info_cache with network_info: [{"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:14:20 user nova-compute[75246]: INFO nova.compute.manager [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Shelve offloading
Nov 28 17:14:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Releasing lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:14:20 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Instance destroyed successfully.
Nov 28 17:14:20 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquired lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-71b6cec6-eb9a-4b7c-8e67-79ea9c9a5566 req-19a878dc-50d2-4881-8e1a-a57725b1c93c service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received event network-vif-unplugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-71b6cec6-eb9a-4b7c-8e67-79ea9c9a5566 req-19a878dc-50d2-4881-8e1a-a57725b1c93c service nova] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-71b6cec6-eb9a-4b7c-8e67-79ea9c9a5566 req-19a878dc-50d2-4881-8e1a-a57725b1c93c service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-71b6cec6-eb9a-4b7c-8e67-79ea9c9a5566 req-19a878dc-50d2-4881-8e1a-a57725b1c93c service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-71b6cec6-eb9a-4b7c-8e67-79ea9c9a5566 req-19a878dc-50d2-4881-8e1a-a57725b1c93c service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] No waiting events found dispatching network-vif-unplugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:14:20 user nova-compute[75246]: WARNING nova.compute.manager [req-71b6cec6-eb9a-4b7c-8e67-79ea9c9a5566 req-19a878dc-50d2-4881-8e1a-a57725b1c93c service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received unexpected event network-vif-unplugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 for instance with vm_state active and task_state rescuing.
Nov 28 17:14:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-cac5d6ea-c119-44bd-a53c-124030ea564a req-47ad41eb-faad-4ebc-ad9c-20a34020679d service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Received event network-vif-plugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cac5d6ea-c119-44bd-a53c-124030ea564a req-47ad41eb-faad-4ebc-ad9c-20a34020679d service nova] Acquiring lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cac5d6ea-c119-44bd-a53c-124030ea564a req-47ad41eb-faad-4ebc-ad9c-20a34020679d service nova] Lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cac5d6ea-c119-44bd-a53c-124030ea564a req-47ad41eb-faad-4ebc-ad9c-20a34020679d service nova] Lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-cac5d6ea-c119-44bd-a53c-124030ea564a req-47ad41eb-faad-4ebc-ad9c-20a34020679d service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] No waiting events found dispatching network-vif-plugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:14:20 user nova-compute[75246]: WARNING nova.compute.manager [req-cac5d6ea-c119-44bd-a53c-124030ea564a req-47ad41eb-faad-4ebc-ad9c-20a34020679d service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Received unexpected event network-vif-plugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb for instance with vm_state building and task_state spawning.
Nov 28 17:14:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG nova.network.neutron [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Updating instance_info_cache with network_info: [{"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Releasing lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:21 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 90829136-472b-4c45-9607-c28433d05f56] Instance destroyed successfully.
Nov 28 17:14:21 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Attempting rescue
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75246) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Instance directory exists: not creating {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 17:14:21 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Creating image(s)
Nov 28 17:14:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "/opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "/opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "/opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.objects.instance [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'trusted_certs' on Instance uuid 90829136-472b-4c45-9607-c28433d05f56 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk.rescue {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk.rescue" returned: 0 in 0.056s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.objects.instance [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'migration_context' on Instance uuid 90829136-472b-4c45-9607-c28433d05f56 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.objects.base [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Object Instance<90829136-472b-4c45-9607-c28433d05f56> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Start _get_guest_xml network_info=[{"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "vif_mac": "fa:16:3e:1a:7d:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.objects.instance [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'resources' on Instance uuid 90829136-472b-4c45-9607-c28433d05f56 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.objects.base [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Object Instance<90829136-472b-4c45-9607-c28433d05f56> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.objects.instance [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'numa_topology' on Instance uuid 90829136-472b-4c45-9607-c28433d05f56 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.objects.base [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Object Instance<90829136-472b-4c45-9607-c28433d05f56> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:14:21 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Instance destroyed successfully.
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.objects.instance [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'resources' on Instance uuid 1d3f57d8-3580-4c42-8a4c-cef210e19eb4 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:14:21 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:14:21 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2130907667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2130907667',id=32,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkyQVU4+IKRbdT/9XXp3whOYOZpGrX/8I6qjmkWxKzuwGZbu6+LtoKJ1o0iUy0Plg/S1jnl5rqH3hbqK/R2kiB32pqva3FiYFAbn/9EY1INepDABzQQiQlwaAFWnxd6Tw==',key_name='tempest-keypair-1886774448',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:12:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cd94665acd9a4448a1ad1350d71d8f72',ramdisk_id='',reservation_id='r-3eim7bic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726606277',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726606277-project-member',shelved_at='2023-11-28T17:14:20.329748',shelved_host='user',shelved_image_id='1951ced5-e521-49f3-abd2-6da5c17ec0ed'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:14:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ed095223674edebcee82e4183c8ea0',uuid=1d3f57d8-3580-4c42-8a4c-cef210e19eb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converting VIF {"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:db:6a,bridge_name='br-int',has_traffic_filtering=True,id=434dbbbd-947d-47c5-a794-4fee8690d835,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434dbbbd-94') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG os_vif [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:db:6a,bridge_name='br-int',has_traffic_filtering=True,id=434dbbbd-947d-47c5-a794-4fee8690d835,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434dbbbd-94') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap434dbbbd-94, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=625b77ee-c67a-4208-9490-6233cda9b4ee) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.objects.instance [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'vcpu_model' on Instance uuid 90829136-472b-4c45-9607-c28433d05f56 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.compute.manager [req-d9e18af3-8d03-4721-b4e8-94ad08e27bdc req-34b80c8a-4dae-4452-8e05-90f6d1aa406a service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received event network-changed-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.compute.manager [req-d9e18af3-8d03-4721-b4e8-94ad08e27bdc req-34b80c8a-4dae-4452-8e05-90f6d1aa406a service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Refreshing instance network info cache due to event network-changed-434dbbbd-947d-47c5-a794-4fee8690d835. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d9e18af3-8d03-4721-b4e8-94ad08e27bdc req-34b80c8a-4dae-4452-8e05-90f6d1aa406a service nova] Acquiring lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d9e18af3-8d03-4721-b4e8-94ad08e27bdc req-34b80c8a-4dae-4452-8e05-90f6d1aa406a service nova] Acquired lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.network.neutron [req-d9e18af3-8d03-4721-b4e8-94ad08e27bdc req-34b80c8a-4dae-4452-8e05-90f6d1aa406a service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Refreshing network info cache for port 434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.objects.base [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Object Instance<90829136-472b-4c45-9607-c28433d05f56> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:12:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-904390000',display_name='tempest-ServerRescueNegativeTestJSON-server-904390000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-904390000',id=31,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZ87kIt1XgMGQQZuF6spI0RsdOfKq7otrdj2C3YZOeKitq4qaVEU4L/6TIfjjxxs5HbyoYdyOZFRxRzbLaO4PpN3Qz0YtRnNy3kiitPSO/VFgmaSMKcNRkWPgRAD8B1HQ==',key_name='tempest-keypair-929323611',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:12:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60768e53b1e3414cb05eaaf23d382493',ramdisk_id='',reservation_id='r-x1gqpe35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-220335783',owner_user_name='tempest-ServerRescueNegativeTestJSON-220335783-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:12:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b79c4440e4734a2f82b08de54ed61737',uuid=90829136-472b-4c45-9607-c28433d05f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "vif_mac": "fa:16:3e:1a:7d:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converting VIF {"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "vif_mac": "fa:16:3e:1a:7d:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:7d:4a,bridge_name='br-int',has_traffic_filtering=True,id=5f6b2b48-5c6d-4528-95dd-e7eb24780e37,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6b2b48-5c') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.objects.instance [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'pci_devices' on Instance uuid 90829136-472b-4c45-9607-c28433d05f56 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:14:21 user nova-compute[75246]: INFO os_vif [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:db:6a,bridge_name='br-int',has_traffic_filtering=True,id=434dbbbd-947d-47c5-a794-4fee8690d835,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434dbbbd-94')
Nov 28 17:14:21 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Deleting instance files /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4_del
Nov 28 17:14:21 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Deletion of /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4_del complete
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.objects.base [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Object Instance<90829136-472b-4c45-9607-c28433d05f56> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:14:21 user nova-compute[75246]:   <uuid>90829136-472b-4c45-9607-c28433d05f56</uuid>
Nov 28 17:14:21 user nova-compute[75246]:   <name>instance-0000001f</name>
Nov 28 17:14:21 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:14:21 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:14:21 user nova-compute[75246]:   <metadata>
Nov 28 17:14:21 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:14:21 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:14:21 user nova-compute[75246]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-904390000</nova:name>
Nov 28 17:14:21 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:14:21</nova:creationTime>
Nov 28 17:14:21 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:14:21 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:14:21 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:14:21 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:14:21 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:14:21 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:14:21 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:14:21 user nova-compute[75246]:       <nova:owner>
Nov 28 17:14:21 user nova-compute[75246]:         <nova:user uuid="b79c4440e4734a2f82b08de54ed61737">tempest-ServerRescueNegativeTestJSON-220335783-project-member</nova:user>
Nov 28 17:14:21 user nova-compute[75246]:         <nova:project uuid="60768e53b1e3414cb05eaaf23d382493">tempest-ServerRescueNegativeTestJSON-220335783</nova:project>
Nov 28 17:14:21 user nova-compute[75246]:       </nova:owner>
Nov 28 17:14:21 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:14:21 user nova-compute[75246]:       <nova:ports>
Nov 28 17:14:21 user nova-compute[75246]:         <nova:port uuid="5f6b2b48-5c6d-4528-95dd-e7eb24780e37">
Nov 28 17:14:21 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 17:14:21 user nova-compute[75246]:         </nova:port>
Nov 28 17:14:21 user nova-compute[75246]:       </nova:ports>
Nov 28 17:14:21 user nova-compute[75246]:     </nova:instance>
Nov 28 17:14:21 user nova-compute[75246]:   </metadata>
Nov 28 17:14:21 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:14:21 user nova-compute[75246]:     <system>
Nov 28 17:14:21 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:14:21 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:14:21 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:14:21 user nova-compute[75246]:       <entry name="serial">90829136-472b-4c45-9607-c28433d05f56</entry>
Nov 28 17:14:21 user nova-compute[75246]:       <entry name="uuid">90829136-472b-4c45-9607-c28433d05f56</entry>
Nov 28 17:14:21 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:14:21 user nova-compute[75246]:     </system>
Nov 28 17:14:21 user nova-compute[75246]:   </sysinfo>
Nov 28 17:14:21 user nova-compute[75246]:   <os>
Nov 28 17:14:21 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:14:21 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:14:21 user nova-compute[75246]:   </os>
Nov 28 17:14:21 user nova-compute[75246]:   <features>
Nov 28 17:14:21 user nova-compute[75246]:     <acpi/>
Nov 28 17:14:21 user nova-compute[75246]:     <apic/>
Nov 28 17:14:21 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:14:21 user nova-compute[75246]:   </features>
Nov 28 17:14:21 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:14:21 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:14:21 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:14:21 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:14:21 user nova-compute[75246]:   </clock>
Nov 28 17:14:21 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:14:21 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:14:21 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:14:21 user nova-compute[75246]:   </cpu>
Nov 28 17:14:21 user nova-compute[75246]:   <devices>
Nov 28 17:14:21 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:14:21 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:14:21 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk.rescue"/>
Nov 28 17:14:21 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:14:21 user nova-compute[75246]:     </disk>
Nov 28 17:14:21 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:14:21 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:14:21 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk"/>
Nov 28 17:14:21 user nova-compute[75246]:       <target dev="vdb" bus="virtio"/>
Nov 28 17:14:21 user nova-compute[75246]:     </disk>
Nov 28 17:14:21 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:14:21 user nova-compute[75246]:       <mac address="fa:16:3e:1a:7d:4a"/>
Nov 28 17:14:21 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:14:21 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:14:21 user nova-compute[75246]:       <target dev="tap5f6b2b48-5c"/>
Nov 28 17:14:21 user nova-compute[75246]:     </interface>
Nov 28 17:14:21 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:14:21 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/console.log" append="off"/>
Nov 28 17:14:21 user nova-compute[75246]:     </serial>
Nov 28 17:14:21 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:14:21 user nova-compute[75246]:     <video>
Nov 28 17:14:21 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:14:21 user nova-compute[75246]:     </video>
Nov 28 17:14:21 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:14:21 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:14:21 user nova-compute[75246]:     </rng>
Nov 28 17:14:21 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:14:21 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:14:21 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:14:21 user nova-compute[75246]:     </memballoon>
Nov 28 17:14:21 user nova-compute[75246]:   </devices>
Nov 28 17:14:21 user nova-compute[75246]: </domain>
Nov 28 17:14:21 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:21 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 90829136-472b-4c45-9607-c28433d05f56] Instance destroyed successfully.
Nov 28 17:14:21 user nova-compute[75246]: INFO nova.compute.manager [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Detaching volume 390e628d-d2d2-4b2a-b404-813e8186a20d
Nov 28 17:14:21 user nova-compute[75246]: INFO nova.virt.block_device [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Attempting to driver detach volume 390e628d-d2d2-4b2a-b404-813e8186a20d from mountpoint /dev/vdb
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Attempting to detach device vdb from instance aa9ef0b8-3519-416a-b42c-cd953c4ddc0d from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:14:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:14:21 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:14:21 user nova-compute[75246]:   <source dev="/dev/sdf"/>
Nov 28 17:14:21 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:14:21 user nova-compute[75246]:   <serial>390e628d-d2d2-4b2a-b404-813e8186a20d</serial>
Nov 28 17:14:21 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:14:21 user nova-compute[75246]: </disk>
Nov 28 17:14:21 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:14:22 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Successfully detached device vdb from instance aa9ef0b8-3519-416a-b42c-cd953c4ddc0d from the persistent domain config.
Nov 28 17:14:22 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aa9ef0b8-3519-416a-b42c-cd953c4ddc0d from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:14:22 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:14:22 user nova-compute[75246]:   <source dev="/dev/sdf"/>
Nov 28 17:14:22 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:14:22 user nova-compute[75246]:   <serial>390e628d-d2d2-4b2a-b404-813e8186a20d</serial>
Nov 28 17:14:22 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:14:22 user nova-compute[75246]: </disk>
Nov 28 17:14:22 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] No VIF found with MAC fa:16:3e:1a:7d:4a, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:14:22 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Deleted allocations for instance 1d3f57d8-3580-4c42-8a4c-cef210e19eb4
Nov 28 17:14:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG nova.objects.instance [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'numa_topology' on Instance uuid 1d3f57d8-3580-4c42-8a4c-cef210e19eb4 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG nova.objects.base [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Object Instance<1d3f57d8-3580-4c42-8a4c-cef210e19eb4> lazy-loaded attributes: resources,numa_topology {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG nova.network.neutron [req-d9e18af3-8d03-4721-b4e8-94ad08e27bdc req-34b80c8a-4dae-4452-8e05-90f6d1aa406a service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Updated VIF entry in instance network info cache for port 434dbbbd-947d-47c5-a794-4fee8690d835. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG nova.network.neutron [req-d9e18af3-8d03-4721-b4e8-94ad08e27bdc req-34b80c8a-4dae-4452-8e05-90f6d1aa406a service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Updating instance_info_cache with network_info: [{"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap434dbbbd-94", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d9e18af3-8d03-4721-b4e8-94ad08e27bdc req-34b80c8a-4dae-4452-8e05-90f6d1aa406a service nova] Releasing lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c3328d15-db32-4a51-9da7-5394a9ece3af tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.373s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aa9ef0b8-3519-416a-b42c-cd953c4ddc0d {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG nova.compute.manager [req-4edda581-8ecb-46c3-87c3-1cd8761e1cb8 req-f1e94ffc-1b07-4159-b693-6ed607da4e68 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received event network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4edda581-8ecb-46c3-87c3-1cd8761e1cb8 req-f1e94ffc-1b07-4159-b693-6ed607da4e68 service nova] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4edda581-8ecb-46c3-87c3-1cd8761e1cb8 req-f1e94ffc-1b07-4159-b693-6ed607da4e68 service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4edda581-8ecb-46c3-87c3-1cd8761e1cb8 req-f1e94ffc-1b07-4159-b693-6ed607da4e68 service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG nova.compute.manager [req-4edda581-8ecb-46c3-87c3-1cd8761e1cb8 req-f1e94ffc-1b07-4159-b693-6ed607da4e68 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] No waiting events found dispatching network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:14:22 user nova-compute[75246]: WARNING nova.compute.manager [req-4edda581-8ecb-46c3-87c3-1cd8761e1cb8 req-f1e94ffc-1b07-4159-b693-6ed607da4e68 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received unexpected event network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 for instance with vm_state active and task_state rescuing.
Nov 28 17:14:22 user nova-compute[75246]: DEBUG nova.compute.manager [req-4fdeb9da-19e7-439d-88df-90a8c19da911 req-6fd035d4-244b-4116-bda9-4641b0e97f2a service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Received event network-vif-plugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4fdeb9da-19e7-439d-88df-90a8c19da911 req-6fd035d4-244b-4116-bda9-4641b0e97f2a service nova] Acquiring lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4fdeb9da-19e7-439d-88df-90a8c19da911 req-6fd035d4-244b-4116-bda9-4641b0e97f2a service nova] Lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4fdeb9da-19e7-439d-88df-90a8c19da911 req-6fd035d4-244b-4116-bda9-4641b0e97f2a service nova] Lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:22 user nova-compute[75246]: DEBUG nova.compute.manager [req-4fdeb9da-19e7-439d-88df-90a8c19da911 req-6fd035d4-244b-4116-bda9-4641b0e97f2a service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] No waiting events found dispatching network-vif-plugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:14:22 user nova-compute[75246]: WARNING nova.compute.manager [req-4fdeb9da-19e7-439d-88df-90a8c19da911 req-6fd035d4-244b-4116-bda9-4641b0e97f2a service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Received unexpected event network-vif-plugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb for instance with vm_state building and task_state spawning.
Nov 28 17:14:23 user nova-compute[75246]: DEBUG nova.compute.manager [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:14:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:14:23 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Instance spawned successfully.
Nov 28 17:14:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:14:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:14:23 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:14:23 user nova-compute[75246]: INFO nova.compute.manager [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Took 8.28 seconds to spawn the instance on the hypervisor.
Nov 28 17:14:23 user nova-compute[75246]: DEBUG nova.compute.manager [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:14:23 user nova-compute[75246]: INFO nova.compute.manager [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Took 9.46 seconds to build instance.
Nov 28 17:14:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-27624a70-a513-4fd1-a774-486ccd5076dc tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "953ce3ec-438c-437a-90e8-4178529c1a32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.581s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "0fb728b1-9a86-412e-b37e-57a072164534" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "0fb728b1-9a86-412e-b37e-57a072164534" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:24 user nova-compute[75246]: DEBUG nova.compute.manager [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:14:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:24 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:14:24 user nova-compute[75246]: INFO nova.compute.claims [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Claim successful on node user
Nov 28 17:14:24 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:14:24 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:14:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:24 user nova-compute[75246]: DEBUG nova.compute.manager [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:14:24 user nova-compute[75246]: DEBUG nova.compute.manager [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:14:24 user nova-compute[75246]: DEBUG nova.network.neutron [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:14:24 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:14:24 user nova-compute[75246]: DEBUG nova.compute.manager [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-6efbc08c-7d9c-4f4f-8849-b8f77d4f9ea1 req-9b118f39-207e-4996-b496-bb03f555d4f2 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received event network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6efbc08c-7d9c-4f4f-8849-b8f77d4f9ea1 req-9b118f39-207e-4996-b496-bb03f555d4f2 service nova] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6efbc08c-7d9c-4f4f-8849-b8f77d4f9ea1 req-9b118f39-207e-4996-b496-bb03f555d4f2 service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6efbc08c-7d9c-4f4f-8849-b8f77d4f9ea1 req-9b118f39-207e-4996-b496-bb03f555d4f2 service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-6efbc08c-7d9c-4f4f-8849-b8f77d4f9ea1 req-9b118f39-207e-4996-b496-bb03f555d4f2 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] No waiting events found dispatching network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:14:25 user nova-compute[75246]: WARNING nova.compute.manager [req-6efbc08c-7d9c-4f4f-8849-b8f77d4f9ea1 req-9b118f39-207e-4996-b496-bb03f555d4f2 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received unexpected event network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 for instance with vm_state active and task_state rescuing.
Nov 28 17:14:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-6efbc08c-7d9c-4f4f-8849-b8f77d4f9ea1 req-9b118f39-207e-4996-b496-bb03f555d4f2 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received event network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6efbc08c-7d9c-4f4f-8849-b8f77d4f9ea1 req-9b118f39-207e-4996-b496-bb03f555d4f2 service nova] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6efbc08c-7d9c-4f4f-8849-b8f77d4f9ea1 req-9b118f39-207e-4996-b496-bb03f555d4f2 service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6efbc08c-7d9c-4f4f-8849-b8f77d4f9ea1 req-9b118f39-207e-4996-b496-bb03f555d4f2 service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-6efbc08c-7d9c-4f4f-8849-b8f77d4f9ea1 req-9b118f39-207e-4996-b496-bb03f555d4f2 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] No waiting events found dispatching network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:14:25 user nova-compute[75246]: WARNING nova.compute.manager [req-6efbc08c-7d9c-4f4f-8849-b8f77d4f9ea1 req-9b118f39-207e-4996-b496-bb03f555d4f2 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received unexpected event network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 for instance with vm_state active and task_state rescuing.
Nov 28 17:14:25 user nova-compute[75246]: DEBUG nova.policy [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c334f73c5bf1473aadf865c8f032c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0eebdd39c54a74be8d2e0f9842b165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:14:25 user nova-compute[75246]: INFO nova.virt.block_device [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Booting with volume be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e at /dev/vda
Nov 28 17:14:25 user nova-compute[75246]: DEBUG os_brick.utils [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d62c8c-a3c3-40e8-94dd-2b4548e3a72f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e465002-4b83-4119-8ad4-8087aa56e732]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7701c705-a33c-41f5-a8ea-8b7b89e8b1a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f016f629-0569-4a64-8535-8f6830905954]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:14:25 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:14:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c036c35-4135-4098-8236-02cbfaea700b]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG os_brick.utils [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Updating existing volume attachment record: 503e3d0a-4442-4549-acdf-ebd4f27db44f {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG nova.network.neutron [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Successfully created port: 14ad7288-2755-4a75-b2a9-b8641b0a0bd4 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:14:25 user nova-compute[75246]: DEBUG nova.compute.manager [None req-43a330ad-25f5-485f-93b5-952546690af1 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:14:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Successfully updated port: 14ad7288-2755-4a75-b2a9-b8641b0a0bd4 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:14:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "refresh_cache-0fb728b1-9a86-412e-b37e-57a072164534" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:14:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquired lock "refresh_cache-0fb728b1-9a86-412e-b37e-57a072164534" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:14:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:14:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-25123b06-87d6-437c-adc5-e29852d25d0f req-4c4e428c-e675-4238-8413-f1e26489034f service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Received event network-changed-14ad7288-2755-4a75-b2a9-b8641b0a0bd4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:14:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-25123b06-87d6-437c-adc5-e29852d25d0f req-4c4e428c-e675-4238-8413-f1e26489034f service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Refreshing instance network info cache due to event network-changed-14ad7288-2755-4a75-b2a9-b8641b0a0bd4. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:14:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-25123b06-87d6-437c-adc5-e29852d25d0f req-4c4e428c-e675-4238-8413-f1e26489034f service nova] Acquiring lock "refresh_cache-0fb728b1-9a86-412e-b37e-57a072164534" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:14:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:14:26 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:14:27 user nova-compute[75246]: DEBUG nova.network.neutron [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Updating instance_info_cache with network_info: [{"id": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "address": "fa:16:3e:59:00:36", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ad7288-27", "ovs_interfaceid": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:14:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Releasing lock "refresh_cache-0fb728b1-9a86-412e-b37e-57a072164534" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:14:27 user nova-compute[75246]: DEBUG nova.compute.manager [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Instance network_info: |[{"id": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "address": "fa:16:3e:59:00:36", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ad7288-27", "ovs_interfaceid": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:14:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-25123b06-87d6-437c-adc5-e29852d25d0f req-4c4e428c-e675-4238-8413-f1e26489034f service nova] Acquired lock "refresh_cache-0fb728b1-9a86-412e-b37e-57a072164534" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:14:27 user nova-compute[75246]: DEBUG nova.network.neutron [req-25123b06-87d6-437c-adc5-e29852d25d0f req-4c4e428c-e675-4238-8413-f1e26489034f service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Refreshing network info cache for port 14ad7288-2755-4a75-b2a9-b8641b0a0bd4 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:14:27 user nova-compute[75246]: DEBUG nova.network.neutron [req-25123b06-87d6-437c-adc5-e29852d25d0f req-4c4e428c-e675-4238-8413-f1e26489034f service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Updated VIF entry in instance network info cache for port 14ad7288-2755-4a75-b2a9-b8641b0a0bd4. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:14:27 user nova-compute[75246]: DEBUG nova.network.neutron [req-25123b06-87d6-437c-adc5-e29852d25d0f req-4c4e428c-e675-4238-8413-f1e26489034f service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Updating instance_info_cache with network_info: [{"id": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "address": "fa:16:3e:59:00:36", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ad7288-27", "ovs_interfaceid": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:14:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-25123b06-87d6-437c-adc5-e29852d25d0f req-4c4e428c-e675-4238-8413-f1e26489034f service nova] Releasing lock "refresh_cache-0fb728b1-9a86-412e-b37e-57a072164534" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:14:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:31 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:14:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:32 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:14:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:14:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:14:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:36 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 620ce71b-8ce0-492a-ac7e-72dd12987bfa is timed out.
Nov 28 17:14:36 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Successfully detached device vdc from instance 620ce71b-8ce0-492a-ac7e-72dd12987bfa from the live domain config.
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcELVxsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:14:36 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:14:36 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Creating image(s)
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Did not create local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Ensure instance console log exists: /opt/stack/data/nova/instances/0fb728b1-9a86-412e-b37e-57a072164534/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Start _get_guest_xml network_info=[{"id": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "address": "fa:16:3e:59:00:36", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ad7288-27", "ovs_interfaceid": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '503e3d0a-4442-4549-acdf-ebd4f27db44f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xeUkAREn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0fb728b1-9a86-412e-b37e-57a072164534', 'attached_at': '', 'detached_at': '', 'volume_id': 'be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e', 'serial': 'be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:36 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:14:36 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed1e727-a1d6-4a6d-91e3-083083d5bc92]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:14:36 user nova-compute[75246]: No targets found.
Nov 28 17:14:36 user nova-compute[75246]: iSNS:
Nov 28 17:14:36 user nova-compute[75246]: No targets found.
Nov 28 17:14:36 user nova-compute[75246]: STATIC:
Nov 28 17:14:36 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206
Nov 28 17:14:36 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:14:36 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:14:36 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158
Nov 28 17:14:36 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:14:36 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:14:36 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa
Nov 28 17:14:36 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:14:36 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:14:36 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a
Nov 28 17:14:36 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:14:36 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:14:36 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3
Nov 28 17:14:36 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:14:36 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:14:36 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d
Nov 28 17:14:36 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:14:36 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:14:36 user nova-compute[75246]: FIRMWARE:
Nov 28 17:14:36 user nova-compute[75246]: No targets found.
Nov 28 17:14:36 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:14:36 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:14:36 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xeUkAREn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:14:36 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8d75de-6e9f-4ec6-a636-c7b2fe90978b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[754aa1e2-1963-4212-b99a-4a154b384e23]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:14:36 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:14:36 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:14:36 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:14:36 user nova-compute[75246]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 (non-flash)
Nov 28 17:14:36 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:14:36 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:14:36 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:14:36 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:14:36 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:14:36 user nova-compute[75246]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 (non-flash)
Nov 28 17:14:36 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:14:36 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d8134040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206'): ({'sdd'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Removing single pathed devices sdd {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad632626-c5d9-47eb-9e82-7b4361bf3b5a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eff46e3-1d50-46c1-ac85-81c69b203f41]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Flushing IO for device /dev/sdd {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd979d3-9109-4d2b-891b-21b96980b7fb]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3529f654-37c7-4a32-89b7-0417ace64f1b]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d3be82-c9f9-479c-8348-5171853b923f]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e162a1ac-a1b3-417a-a79c-c82606bf9be5]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206, portal: 172.16.0.220,3260]
Nov 28 17:14:36 user nova-compute[75246]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206, portal: 172.16.0.220,3260] successful.
Nov 28 17:14:36 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:36 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:14:36 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:14:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=7464MB free_disk=25.121612548828125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:37 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 36e65da9-4cc0-4d73-9e5d-e64520e08f34 is timed out.
Nov 28 17:14:37 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Successfully detached device vdb from instance 36e65da9-4cc0-4d73-9e5d-e64520e08f34 from the live domain config.
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b3fcfd3-af27-42b7-9e86-a6df72525206 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7436a574-e43e-48ef-8b7b-114bf4aa5589]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.724s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] <== disconnect_volume: return (725ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.661s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:14:37 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:14:37 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ythHnuOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:14:37 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8f90ca-2608-403f-a835-f80abd4b6a51]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:14:37 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6cd0c7-e831-49d0-af77-fb6db4f4c452]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e] added
Nov 28 17:14:37 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f3003d-1e8f-48f5-ab6c-35cf07f41be9]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Applying migration context for instance 5c199841-2ce5-4f72-a3f1-6d6d0c746505 as it has an incoming, in-progress migration 3a0acfc8-ebd0-4c9e-8eb8-a289b4345e05. Migration status is finished {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 17:14:37 user nova-compute[75246]: INFO nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Updating resource usage from migration 3a0acfc8-ebd0-4c9e-8eb8-a289b4345e05
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc263c8-0202-4b2e-a0e7-ee4658bed4c5]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xeUkAREn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xeUkAREn" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66df8d0-5cbf-48ce-a567-125e86b934e8]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xeUkAREn'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[10acf3d7-408d-403c-a77c-3f8f06caf512]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e1266470-c182-4c0c-a575-4c5043f54745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c94900af-f484-47bf-8627-8aa863334b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance aa9ef0b8-3519-416a-b42c-cd953c4ddc0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 36e65da9-4cc0-4d73-9e5d-e64520e08f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 0ed72d2a-ca9b-4b99-b422-86fa93af945c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 620ce71b-8ce0-492a-ac7e-72dd12987bfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 90829136-472b-4c45-9607-c28433d05f56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Migration 3a0acfc8-ebd0-4c9e-8eb8-a289b4345e05 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 5c199841-2ce5-4f72-a3f1-6d6d0c746505 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 953ce3ec-438c-437a-90e8-4178529c1a32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 0fb728b1-9a86-412e-b37e-57a072164534 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5b0d1c-65c7-4e60-9176-ae7913267c10]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:14:37 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:14:37 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:14:37 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:14:37 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:14:37 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:14:37 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:14:37 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:14:37 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:14:37 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:14:37 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d338a42b-61c9-469e-af8b-690ef641f633]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e, portal: 172.16.0.220,3260]
Nov 28 17:14:37 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e, portal: 172.16.0.220,3260] successful.
Nov 28 17:14:37 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bb5cff-5064-4dbb-9b6a-54f0f2ba1fe6]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8de1af3-1e5b-415d-8468-3b98efd88031]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:14:37 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:14:37 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:14:37 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:14:37 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:14:37 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:14:37 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:14:37 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:14:37 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:14:37 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:14:37 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:14:37 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:14:37 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13c49cd-1fc7-4611-a26f-477bc9911cc5]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: None {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.654s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG nova.objects.instance [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lazy-loading 'flavor' on Instance uuid 620ce71b-8ce0-492a-ac7e-72dd12987bfa {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:14:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-72a35699-bc77-49fd-ad5d-be23805a41ba tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.381s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xeUkAREn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] <== connect_volume: return (2053ms) {'type': 'block', 'scsi_wwn': '23464663736353763', 'path': '/dev/sdd'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464663736353763', 'path': '/dev/sdd'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.389s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[257b6cc3-05ef-4504-8c46-0fc0b21090b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:14:38 user nova-compute[75246]: No targets found.
Nov 28 17:14:38 user nova-compute[75246]: iSNS:
Nov 28 17:14:38 user nova-compute[75246]: No targets found.
Nov 28 17:14:38 user nova-compute[75246]: STATIC:
Nov 28 17:14:38 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e
Nov 28 17:14:38 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:14:38 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:14:38 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158
Nov 28 17:14:38 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:14:38 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:14:38 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa
Nov 28 17:14:38 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:14:38 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:14:38 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a
Nov 28 17:14:38 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:14:38 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:14:38 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3
Nov 28 17:14:38 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:14:38 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:14:38 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d
Nov 28 17:14:38 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:14:38 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:14:38 user nova-compute[75246]: FIRMWARE:
Nov 28 17:14:38 user nova-compute[75246]: No targets found.
Nov 28 17:14:38 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:14:38 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:14:38 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-233855623',display_name='tempest-TestVolumeBootPattern-volume-backed-server-233855623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-233855623',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHI4hps3jXqTExNHYhOU8FX7+zIFGGafDIDmvWAxlJwXHL/ifAVZKBKwuDHAKC9+L8QRtHYha80zaIoyL5j4jtGmxCRFwpSUly8+eWBd/sL24pi4FbZh2oSEcLg8NEvRw==',key_name='tempest-keypair-625009801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe0eebdd39c54a74be8d2e0f9842b165',ramdisk_id='',reservation_id='r-nblwzgb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-389869337',owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:14:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c334f73c5bf1473aadf865c8f032c0cb',uuid=0fb728b1-9a86-412e-b37e-57a072164534,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "address": "fa:16:3e:59:00:36", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ad7288-27", "ovs_interfaceid": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converting VIF {"id": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "address": "fa:16:3e:59:00:36", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ad7288-27", "ovs_interfaceid": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:00:36,bridge_name='br-int',has_traffic_filtering=True,id=14ad7288-2755-4a75-b2a9-b8641b0a0bd4,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ad7288-27') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG nova.objects.instance [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fb728b1-9a86-412e-b37e-57a072164534 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d335b3-f5a2-45ec-8f66-28557cf8aac5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:14:38 user nova-compute[75246]:   <uuid>0fb728b1-9a86-412e-b37e-57a072164534</uuid>
Nov 28 17:14:38 user nova-compute[75246]:   <name>instance-00000023</name>
Nov 28 17:14:38 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:14:38 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:14:38 user nova-compute[75246]:   <metadata>
Nov 28 17:14:38 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:14:38 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:14:38 user nova-compute[75246]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-233855623</nova:name>
Nov 28 17:14:38 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:14:36</nova:creationTime>
Nov 28 17:14:38 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:14:38 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:14:38 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:14:38 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:14:38 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:14:38 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:14:38 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:14:38 user nova-compute[75246]:       <nova:owner>
Nov 28 17:14:38 user nova-compute[75246]:         <nova:user uuid="c334f73c5bf1473aadf865c8f032c0cb">tempest-TestVolumeBootPattern-389869337-project-member</nova:user>
Nov 28 17:14:38 user nova-compute[75246]:         <nova:project uuid="fe0eebdd39c54a74be8d2e0f9842b165">tempest-TestVolumeBootPattern-389869337</nova:project>
Nov 28 17:14:38 user nova-compute[75246]:       </nova:owner>
Nov 28 17:14:38 user nova-compute[75246]:       <nova:ports>
Nov 28 17:14:38 user nova-compute[75246]:         <nova:port uuid="14ad7288-2755-4a75-b2a9-b8641b0a0bd4">
Nov 28 17:14:38 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 17:14:38 user nova-compute[75246]:         </nova:port>
Nov 28 17:14:38 user nova-compute[75246]:       </nova:ports>
Nov 28 17:14:38 user nova-compute[75246]:     </nova:instance>
Nov 28 17:14:38 user nova-compute[75246]:   </metadata>
Nov 28 17:14:38 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:14:38 user nova-compute[75246]:     <system>
Nov 28 17:14:38 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:14:38 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:14:38 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:14:38 user nova-compute[75246]:       <entry name="serial">0fb728b1-9a86-412e-b37e-57a072164534</entry>
Nov 28 17:14:38 user nova-compute[75246]:       <entry name="uuid">0fb728b1-9a86-412e-b37e-57a072164534</entry>
Nov 28 17:14:38 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:14:38 user nova-compute[75246]:     </system>
Nov 28 17:14:38 user nova-compute[75246]:   </sysinfo>
Nov 28 17:14:38 user nova-compute[75246]:   <os>
Nov 28 17:14:38 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:14:38 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:14:38 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:14:38 user nova-compute[75246]:   </os>
Nov 28 17:14:38 user nova-compute[75246]:   <features>
Nov 28 17:14:38 user nova-compute[75246]:     <acpi/>
Nov 28 17:14:38 user nova-compute[75246]:     <apic/>
Nov 28 17:14:38 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:14:38 user nova-compute[75246]:   </features>
Nov 28 17:14:38 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:14:38 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:14:38 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:14:38 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:14:38 user nova-compute[75246]:   </clock>
Nov 28 17:14:38 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:14:38 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:14:38 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:14:38 user nova-compute[75246]:   </cpu>
Nov 28 17:14:38 user nova-compute[75246]:   <devices>
Nov 28 17:14:38 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:14:38 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:14:38 user nova-compute[75246]:       <source dev="/dev/sdd"/>
Nov 28 17:14:38 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:14:38 user nova-compute[75246]:       <serial>be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e</serial>
Nov 28 17:14:38 user nova-compute[75246]:     </disk>
Nov 28 17:14:38 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:14:38 user nova-compute[75246]:       <mac address="fa:16:3e:59:00:36"/>
Nov 28 17:14:38 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:14:38 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:14:38 user nova-compute[75246]:       <target dev="tap14ad7288-27"/>
Nov 28 17:14:38 user nova-compute[75246]:     </interface>
Nov 28 17:14:38 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:14:38 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/0fb728b1-9a86-412e-b37e-57a072164534/console.log" append="off"/>
Nov 28 17:14:38 user nova-compute[75246]:     </serial>
Nov 28 17:14:38 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:14:38 user nova-compute[75246]:     <video>
Nov 28 17:14:38 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:14:38 user nova-compute[75246]:     </video>
Nov 28 17:14:38 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:14:38 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:14:38 user nova-compute[75246]:     </rng>
Nov 28 17:14:38 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:14:38 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:14:38 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:14:38 user nova-compute[75246]:     </memballoon>
Nov 28 17:14:38 user nova-compute[75246]:   </devices>
Nov 28 17:14:38 user nova-compute[75246]: </domain>
Nov 28 17:14:38 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-233855623',display_name='tempest-TestVolumeBootPattern-volume-backed-server-233855623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-233855623',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHI4hps3jXqTExNHYhOU8FX7+zIFGGafDIDmvWAxlJwXHL/ifAVZKBKwuDHAKC9+L8QRtHYha80zaIoyL5j4jtGmxCRFwpSUly8+eWBd/sL24pi4FbZh2oSEcLg8NEvRw==',key_name='tempest-keypair-625009801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe0eebdd39c54a74be8d2e0f9842b165',ramdisk_id='',reservation_id='r-nblwzgb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-389869337',owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:14:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c334f73c5bf1473aadf865c8f032c0cb',uuid=0fb728b1-9a86-412e-b37e-57a072164534,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "address": "fa:16:3e:59:00:36", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ad7288-27", "ovs_interfaceid": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converting VIF {"id": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "address": "fa:16:3e:59:00:36", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ad7288-27", "ovs_interfaceid": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:00:36,bridge_name='br-int',has_traffic_filtering=True,id=14ad7288-2755-4a75-b2a9-b8641b0a0bd4,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ad7288-27') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_vif [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:00:36,bridge_name='br-int',has_traffic_filtering=True,id=14ad7288-2755-4a75-b2a9-b8641b0a0bd4,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ad7288-27') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0ecbb55-0aa5-5454-8b4d-9da6374be42c', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b812b398-187f-46a7-a557-8b2e340b285a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:14:38 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:14:38 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:14:38 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:14:38 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:14:38 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:14:38 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:14:38 user nova-compute[75246]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a (non-flash)
Nov 28 17:14:38 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:14:38 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:14:38 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:14:38 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:14:38 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d8199fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a'): ({'sdh'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Removing single pathed devices sdh {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14ad7288-27, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap14ad7288-27, col_values=(('qos', UUID('410ed329-5380-4bab-9b71-09926fa2f937')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap14ad7288-27, col_values=(('external_ids', {'iface-id': '14ad7288-2755-4a75-b2a9-b8641b0a0bd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:00:36', 'vm-uuid': '0fb728b1-9a86-412e-b37e-57a072164534'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbd4fd8-fb53-40a7-a9fb-a71886e52108]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:38 user nova-compute[75246]: INFO os_vif [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:00:36,bridge_name='br-int',has_traffic_filtering=True,id=14ad7288-2755-4a75-b2a9-b8641b0a0bd4,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ad7288-27')
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e6715c-fb2c-40c9-abd6-e785071345a9]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Flushing IO for device /dev/sdh {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd58a45d-6280-478a-8a36-fec4b56d0ce0]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] No VIF found with MAC fa:16:3e:59:00:36, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.035s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c37358-e847-4475-9883-7fc8fdce8551]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] SCSI volumes sdh have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8616453-1425-4d15-8a1b-63b55c337b34]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[371cf16f-76f6-4711-8908-d1534e39362d]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a, portal: 172.16.0.220,3260]
Nov 28 17:14:38 user nova-compute[75246]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a, portal: 172.16.0.220,3260] successful.
Nov 28 17:14:38 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6996356-1723-436e-b213-9f94003fa05a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f960214f-56b9-4813-b69d-bcea1f3e1a23]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] <== disconnect_volume: return (1708ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:14:38 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:14:39 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Updating instance_info_cache with network_info: [{"id": "0a3da48f-457a-450f-8102-d758c18d2554", "address": "fa:16:3e:a5:be:9f", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a3da48f-45", "ovs_interfaceid": "0a3da48f-457a-450f-8102-d758c18d2554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:14:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:14:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:14:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:14:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:14:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:14:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:14:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:14:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:14:39 user nova-compute[75246]: DEBUG nova.objects.instance [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lazy-loading 'flavor' on Instance uuid 36e65da9-4cc0-4d73-9e5d-e64520e08f34 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:14:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c363989c-3807-4063-a0b9-76909c2af9af tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.342s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-ac22210f-6bcd-4960-9c05-193f9d53bdaa req-4137c713-4155-40b7-878e-90fc1c7939bf service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Received event network-vif-plugged-14ad7288-2755-4a75-b2a9-b8641b0a0bd4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:14:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ac22210f-6bcd-4960-9c05-193f9d53bdaa req-4137c713-4155-40b7-878e-90fc1c7939bf service nova] Acquiring lock "0fb728b1-9a86-412e-b37e-57a072164534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ac22210f-6bcd-4960-9c05-193f9d53bdaa req-4137c713-4155-40b7-878e-90fc1c7939bf service nova] Lock "0fb728b1-9a86-412e-b37e-57a072164534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ac22210f-6bcd-4960-9c05-193f9d53bdaa req-4137c713-4155-40b7-878e-90fc1c7939bf service nova] Lock "0fb728b1-9a86-412e-b37e-57a072164534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-ac22210f-6bcd-4960-9c05-193f9d53bdaa req-4137c713-4155-40b7-878e-90fc1c7939bf service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] No waiting events found dispatching network-vif-plugged-14ad7288-2755-4a75-b2a9-b8641b0a0bd4 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:14:40 user nova-compute[75246]: WARNING nova.compute.manager [req-ac22210f-6bcd-4960-9c05-193f9d53bdaa req-4137c713-4155-40b7-878e-90fc1c7939bf service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Received unexpected event network-vif-plugged-14ad7288-2755-4a75-b2a9-b8641b0a0bd4 for instance with vm_state building and task_state spawning.
Nov 28 17:14:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG nova.compute.manager [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:14:42 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Instance spawned successfully.
Nov 28 17:14:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:14:42 user nova-compute[75246]: INFO nova.compute.manager [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 28 17:14:42 user nova-compute[75246]: DEBUG nova.compute.manager [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:14:42 user nova-compute[75246]: INFO nova.compute.manager [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Took 17.90 seconds to build instance.
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8bf42b65-e996-4b1a-a7bd-85409e82f86b tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "0fb728b1-9a86-412e-b37e-57a072164534" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.990s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG nova.compute.manager [req-071c453a-d545-4fe7-aa49-fe992e7f13a8 req-d3f3be67-b6d7-4a52-946d-6aaebaa9ad5a service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Received event network-vif-plugged-14ad7288-2755-4a75-b2a9-b8641b0a0bd4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-071c453a-d545-4fe7-aa49-fe992e7f13a8 req-d3f3be67-b6d7-4a52-946d-6aaebaa9ad5a service nova] Acquiring lock "0fb728b1-9a86-412e-b37e-57a072164534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-071c453a-d545-4fe7-aa49-fe992e7f13a8 req-d3f3be67-b6d7-4a52-946d-6aaebaa9ad5a service nova] Lock "0fb728b1-9a86-412e-b37e-57a072164534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-071c453a-d545-4fe7-aa49-fe992e7f13a8 req-d3f3be67-b6d7-4a52-946d-6aaebaa9ad5a service nova] Lock "0fb728b1-9a86-412e-b37e-57a072164534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG nova.compute.manager [req-071c453a-d545-4fe7-aa49-fe992e7f13a8 req-d3f3be67-b6d7-4a52-946d-6aaebaa9ad5a service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] No waiting events found dispatching network-vif-plugged-14ad7288-2755-4a75-b2a9-b8641b0a0bd4 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:14:42 user nova-compute[75246]: WARNING nova.compute.manager [req-071c453a-d545-4fe7-aa49-fe992e7f13a8 req-d3f3be67-b6d7-4a52-946d-6aaebaa9ad5a service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Received unexpected event network-vif-plugged-14ad7288-2755-4a75-b2a9-b8641b0a0bd4 for instance with vm_state active and task_state None.
Nov 28 17:14:42 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance aa9ef0b8-3519-416a-b42c-cd953c4ddc0d is timed out.
Nov 28 17:14:42 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Successfully detached device vdb from instance aa9ef0b8-3519-416a-b42c-cd953c4ddc0d from the live domain config.
Nov 28 17:14:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJesNDPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:14:42 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26fdbd0-f942-4888-98d5-36238f6081d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:14:42 user nova-compute[75246]: No targets found.
Nov 28 17:14:42 user nova-compute[75246]: iSNS:
Nov 28 17:14:42 user nova-compute[75246]: No targets found.
Nov 28 17:14:42 user nova-compute[75246]: STATIC:
Nov 28 17:14:42 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e
Nov 28 17:14:42 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:14:42 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:14:42 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158
Nov 28 17:14:42 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:14:42 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:14:42 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa
Nov 28 17:14:42 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:14:42 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:14:42 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3
Nov 28 17:14:42 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:14:42 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:14:42 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d
Nov 28 17:14:42 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:14:42 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:14:42 user nova-compute[75246]: FIRMWARE:
Nov 28 17:14:42 user nova-compute[75246]: No targets found.
Nov 28 17:14:42 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:14:42 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:14:42 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfdc90c-bb60-4e13-96da-04d1d49fbb2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[45767b03-5385-48dd-82c4-7d9d951079b4]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:14:42 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:14:42 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:14:42 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:14:42 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:14:42 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d (non-flash)
Nov 28 17:14:42 user nova-compute[75246]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:14:42 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:14:42 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:14:42 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:14:42 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4b877ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d'): ({'sdf'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Removing single pathed devices sdf {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c08106-5ec7-4ddf-8862-91797f5fa468]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f10440-8f92-4edd-9254-57a6f6b451f7]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Flushing IO for device /dev/sdf {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa156a87-2595-46e3-ba22-f08007bf5ed0]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.030s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09a4720-d01b-4308-9ecd-d82c22ba5440]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] SCSI volumes sdf have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc79708-d9cc-4f6b-81de-45dccfbfe811]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c11f5f-b631-4b12-a697-aa849120d9bd]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d, portal: 172.16.0.220,3260]
Nov 28 17:14:42 user nova-compute[75246]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d, portal: 172.16.0.220,3260] successful.
Nov 28 17:14:42 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390e628d-d2d2-4b2a-b404-813e8186a20d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd2ca3a-c19b-4ae9-80d3-6c30a33b2612]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] <== disconnect_volume: return (305ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:14:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:14:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:43 user nova-compute[75246]: DEBUG nova.objects.instance [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lazy-loading 'flavor' on Instance uuid aa9ef0b8-3519-416a-b42c-cd953c4ddc0d {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:14:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-52a72f9c-c26d-42ef-a048-42c36c8a3190 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.026s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6471f39b-53de-4ba0-9136-0ca0f6c2b93f tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6471f39b-53de-4ba0-9136-0ca0f6c2b93f tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:48 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6471f39b-53de-4ba0-9136-0ca0f6c2b93f tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Going to confirm migration 2 {{(pid=75246) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 28 17:14:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6471f39b-53de-4ba0-9136-0ca0f6c2b93f tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:14:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6471f39b-53de-4ba0-9136-0ca0f6c2b93f tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquired lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:14:48 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6471f39b-53de-4ba0-9136-0ca0f6c2b93f tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:14:48 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6471f39b-53de-4ba0-9136-0ca0f6c2b93f tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lazy-loading 'info_cache' on Instance uuid 5c199841-2ce5-4f72-a3f1-6d6d0c746505 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:14:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:48 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6471f39b-53de-4ba0-9136-0ca0f6c2b93f tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Updating instance_info_cache with network_info: [{"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:14:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6471f39b-53de-4ba0-9136-0ca0f6c2b93f tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Releasing lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:14:48 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6471f39b-53de-4ba0-9136-0ca0f6c2b93f tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lazy-loading 'migration_context' on Instance uuid 5c199841-2ce5-4f72-a3f1-6d6d0c746505 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:14:48 user nova-compute[75246]: DEBUG nova.objects.base [None req-6471f39b-53de-4ba0-9136-0ca0f6c2b93f tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Object Instance<5c199841-2ce5-4f72-a3f1-6d6d0c746505> lazy-loaded attributes: info_cache,migration_context {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:14:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6471f39b-53de-4ba0-9136-0ca0f6c2b93f tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:14:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6471f39b-53de-4ba0-9136-0ca0f6c2b93f tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:14:49 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-6471f39b-53de-4ba0-9136-0ca0f6c2b93f tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:14:49 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-6471f39b-53de-4ba0-9136-0ca0f6c2b93f tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:14:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6471f39b-53de-4ba0-9136-0ca0f6c2b93f tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.461s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:49 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-6471f39b-53de-4ba0-9136-0ca0f6c2b93f tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Deleted allocation for migration 3a0acfc8-ebd0-4c9e-8eb8-a289b4345e05
Nov 28 17:14:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6471f39b-53de-4ba0-9136-0ca0f6c2b93f tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.558s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:14:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:14:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:15:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:15:05 user nova-compute[75246]: INFO nova.compute.manager [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Detaching volume cf9c2de4-53e1-4251-b2c3-49e6365bd7fa
Nov 28 17:15:05 user nova-compute[75246]: INFO nova.virt.block_device [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Attempting to driver detach volume cf9c2de4-53e1-4251-b2c3-49e6365bd7fa from mountpoint /dev/vdb
Nov 28 17:15:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Attempting to detach device vdb from instance 620ce71b-8ce0-492a-ac7e-72dd12987bfa from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:15:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:15:05 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:15:05 user nova-compute[75246]:   <source dev="/dev/sdb"/>
Nov 28 17:15:05 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:15:05 user nova-compute[75246]:   <serial>cf9c2de4-53e1-4251-b2c3-49e6365bd7fa</serial>
Nov 28 17:15:05 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:15:05 user nova-compute[75246]: </disk>
Nov 28 17:15:05 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:15:05 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Successfully detached device vdb from instance 620ce71b-8ce0-492a-ac7e-72dd12987bfa from the persistent domain config.
Nov 28 17:15:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 620ce71b-8ce0-492a-ac7e-72dd12987bfa from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:15:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:15:05 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:15:05 user nova-compute[75246]:   <source dev="/dev/sdb"/>
Nov 28 17:15:05 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:15:05 user nova-compute[75246]:   <serial>cf9c2de4-53e1-4251-b2c3-49e6365bd7fa</serial>
Nov 28 17:15:05 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:15:05 user nova-compute[75246]: </disk>
Nov 28 17:15:05 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:15:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 620ce71b-8ce0-492a-ac7e-72dd12987bfa {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:15:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:15:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:15:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:15:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:15:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:15:09 user nova-compute[75246]: INFO nova.compute.manager [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Terminating instance
Nov 28 17:15:09 user nova-compute[75246]: DEBUG nova.compute.manager [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:15:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-72977e54-4cad-4fa4-8e2d-815a7c3262f8 req-76b1172d-fb9d-4365-82cc-73785465b1f3 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received event network-vif-unplugged-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-72977e54-4cad-4fa4-8e2d-815a7c3262f8 req-76b1172d-fb9d-4365-82cc-73785465b1f3 service nova] Acquiring lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-72977e54-4cad-4fa4-8e2d-815a7c3262f8 req-76b1172d-fb9d-4365-82cc-73785465b1f3 service nova] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-72977e54-4cad-4fa4-8e2d-815a7c3262f8 req-76b1172d-fb9d-4365-82cc-73785465b1f3 service nova] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-72977e54-4cad-4fa4-8e2d-815a7c3262f8 req-76b1172d-fb9d-4365-82cc-73785465b1f3 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] No waiting events found dispatching network-vif-unplugged-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-72977e54-4cad-4fa4-8e2d-815a7c3262f8 req-76b1172d-fb9d-4365-82cc-73785465b1f3 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received event network-vif-unplugged-cadf851f-d826-43fb-984d-4f15cafa5f64 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:15:10 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Instance destroyed successfully.
Nov 28 17:15:10 user nova-compute[75246]: DEBUG nova.objects.instance [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lazy-loading 'resources' on Instance uuid 36e65da9-4cc0-4d73-9e5d-e64520e08f34 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1660038977',display_name='tempest-TestMinimumBasicScenario-server-1660038977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1660038977',id=24,image_ref='54e18ca0-fa62-4673-b826-73048d2c0357',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPffPZx5HtyUTtuyElK8T2h3LJDo9CkoGf9Uk87IsKnp59gU96LEw/ql/olfbqBcInGNp0uWKaupc6QdJUDgr00AaZzJG7ufaKdWtkye1jcvGvyXXqU3gI4tXP94aeII7g==',key_name='tempest-TestMinimumBasicScenario-525419178',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:10:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d01a3eaa26b4fc790abe7761fb2bb8a',ramdisk_id='',reservation_id='r-mbkjshax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='54e18ca0-fa62-4673-b826-73048d2c0357',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-433831737',owner_user_name='tempest-TestMinimumBasicScenario-433831737-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:12:30Z,user_data=None,user_id='194df496b87a48d68835cb7aa0802560',uuid=36e65da9-4cc0-4d73-9e5d-e64520e08f34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cadf851f-d826-43fb-984d-4f15cafa5f64", "address": "fa:16:3e:74:a8:07", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadf851f-d8", "ovs_interfaceid": "cadf851f-d826-43fb-984d-4f15cafa5f64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Converting VIF {"id": "cadf851f-d826-43fb-984d-4f15cafa5f64", "address": "fa:16:3e:74:a8:07", "network": {"id": "fbf015b9-9d79-4b65-8352-1c3dc7840b0a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-740231184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d01a3eaa26b4fc790abe7761fb2bb8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadf851f-d8", "ovs_interfaceid": "cadf851f-d826-43fb-984d-4f15cafa5f64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=cadf851f-d826-43fb-984d-4f15cafa5f64,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadf851f-d8') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG os_vif [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=cadf851f-d826-43fb-984d-4f15cafa5f64,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadf851f-d8') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcadf851f-d8, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6520bc89-f4ef-4056-af85-db6cef795e7e) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:15:10 user nova-compute[75246]: INFO os_vif [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:a8:07,bridge_name='br-int',has_traffic_filtering=True,id=cadf851f-d826-43fb-984d-4f15cafa5f64,network=Network(fbf015b9-9d79-4b65-8352-1c3dc7840b0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadf851f-d8')
Nov 28 17:15:10 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Deleting instance files /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34_del
Nov 28 17:15:10 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Deletion of /opt/stack/data/nova/instances/36e65da9-4cc0-4d73-9e5d-e64520e08f34_del complete
Nov 28 17:15:10 user nova-compute[75246]: INFO nova.compute.manager [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 17:15:10 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:15:10 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:15:11 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:15:11 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Took 0.43 seconds to deallocate network for instance.
Nov 28 17:15:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-15622a73-0417-4d45-a4b4-cb8bd2ab14a4 req-a225731a-e7ad-412e-aedb-3544f1e9a026 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received event network-vif-deleted-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:15:11 user nova-compute[75246]: INFO nova.compute.manager [req-15622a73-0417-4d45-a4b4-cb8bd2ab14a4 req-a225731a-e7ad-412e-aedb-3544f1e9a026 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Neutron deleted interface cadf851f-d826-43fb-984d-4f15cafa5f64; detaching it from the instance and deleting it from the info cache
Nov 28 17:15:11 user nova-compute[75246]: DEBUG nova.network.neutron [req-15622a73-0417-4d45-a4b4-cb8bd2ab14a4 req-a225731a-e7ad-412e-aedb-3544f1e9a026 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:15:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-15622a73-0417-4d45-a4b4-cb8bd2ab14a4 req-a225731a-e7ad-412e-aedb-3544f1e9a026 service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Detach interface failed, port_id=cadf851f-d826-43fb-984d-4f15cafa5f64, reason: Instance 36e65da9-4cc0-4d73-9e5d-e64520e08f34 could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:15:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:15:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:15:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:11 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:15:11 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:15:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:15:11 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Deleted allocations for instance 36e65da9-4cc0-4d73-9e5d-e64520e08f34
Nov 28 17:15:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-119423a8-08dc-4ddf-b66c-574f74aab5ff tempest-TestMinimumBasicScenario-433831737 tempest-TestMinimumBasicScenario-433831737-project-member] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.819s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:15:12 user nova-compute[75246]: DEBUG nova.compute.manager [req-6cb90a39-baf8-4fd8-8877-981771b099f5 req-2083a6d7-5c38-4cf7-bb38-15172019fa5b service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received event network-vif-plugged-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:15:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6cb90a39-baf8-4fd8-8877-981771b099f5 req-2083a6d7-5c38-4cf7-bb38-15172019fa5b service nova] Acquiring lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:15:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6cb90a39-baf8-4fd8-8877-981771b099f5 req-2083a6d7-5c38-4cf7-bb38-15172019fa5b service nova] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:15:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6cb90a39-baf8-4fd8-8877-981771b099f5 req-2083a6d7-5c38-4cf7-bb38-15172019fa5b service nova] Lock "36e65da9-4cc0-4d73-9e5d-e64520e08f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:15:12 user nova-compute[75246]: DEBUG nova.compute.manager [req-6cb90a39-baf8-4fd8-8877-981771b099f5 req-2083a6d7-5c38-4cf7-bb38-15172019fa5b service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] No waiting events found dispatching network-vif-plugged-cadf851f-d826-43fb-984d-4f15cafa5f64 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:15:12 user nova-compute[75246]: WARNING nova.compute.manager [req-6cb90a39-baf8-4fd8-8877-981771b099f5 req-2083a6d7-5c38-4cf7-bb38-15172019fa5b service nova] [instance: 36e65da9-4cc0-4d73-9e5d-e64520e08f34] Received unexpected event network-vif-plugged-cadf851f-d826-43fb-984d-4f15cafa5f64 for instance with vm_state deleted and task_state None.
Nov 28 17:15:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:15:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:15:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:15:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:15:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:15:12 user nova-compute[75246]: INFO nova.compute.manager [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Terminating instance
Nov 28 17:15:12 user nova-compute[75246]: DEBUG nova.compute.manager [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:15:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:13 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Instance destroyed successfully.
Nov 28 17:15:13 user nova-compute[75246]: DEBUG nova.objects.instance [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lazy-loading 'resources' on Instance uuid aa9ef0b8-3519-416a-b42c-cd953c4ddc0d {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:15:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1587321449',display_name='tempest-AttachVolumeNegativeTest-server-1587321449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1587321449',id=23,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMJpyaT8CK+Br7PkJisTxCGe990GQUVzKkTd8HJwrslD24/jfvlsksP/66OPc0gL3eNW2409OuXhOMmHcyGBHXc6I7Sax3GX0L0tFRZT9xf3bufQ4/MbAO1PypFyMBDBA==',key_name='tempest-keypair-1614315722',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:09:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d39dde859674409847b50613bcc608b',ramdisk_id='',reservation_id='r-bk1g2e0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-524813585',owner_user_name='tempest-AttachVolumeNegativeTest-524813585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:09:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ae91a734974162a14d7b4c498c4b8d',uuid=aa9ef0b8-3519-416a-b42c-cd953c4ddc0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "address": "fa:16:3e:75:a4:ec", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26eaa437-c3", "ovs_interfaceid": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:15:13 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converting VIF {"id": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "address": "fa:16:3e:75:a4:ec", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26eaa437-c3", "ovs_interfaceid": "26eaa437-c34e-4b6f-b907-e3083bc7b10a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:15:13 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:a4:ec,bridge_name='br-int',has_traffic_filtering=True,id=26eaa437-c34e-4b6f-b907-e3083bc7b10a,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26eaa437-c3') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:15:13 user nova-compute[75246]: DEBUG os_vif [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:a4:ec,bridge_name='br-int',has_traffic_filtering=True,id=26eaa437-c34e-4b6f-b907-e3083bc7b10a,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26eaa437-c3') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:15:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26eaa437-c3, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:15:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3388db8b-36f3-4893-9244-98ff4e4abb31) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:15:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:13 user nova-compute[75246]: INFO os_vif [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:a4:ec,bridge_name='br-int',has_traffic_filtering=True,id=26eaa437-c34e-4b6f-b907-e3083bc7b10a,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26eaa437-c3')
Nov 28 17:15:13 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Deleting instance files /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d_del
Nov 28 17:15:13 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Deletion of /opt/stack/data/nova/instances/aa9ef0b8-3519-416a-b42c-cd953c4ddc0d_del complete
Nov 28 17:15:13 user nova-compute[75246]: INFO nova.compute.manager [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 17:15:13 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:15:13 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:15:13 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:15:13 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:15:13 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Took 0.74 seconds to deallocate network for instance.
Nov 28 17:15:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-e7dd173a-3d1b-48d3-8518-a2379778a027 req-f0ad59ff-9c8d-45d5-baa8-ca557c00f391 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Received event network-vif-deleted-26eaa437-c34e-4b6f-b907-e3083bc7b10a {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:15:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:15:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:15:14 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:15:14 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:15:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:15:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-6bef2545-ca9c-41cc-881c-0a73b5f73670 req-1478c84d-18aa-42e4-a3f3-d018f8bca8f5 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Received event network-vif-unplugged-26eaa437-c34e-4b6f-b907-e3083bc7b10a {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:15:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6bef2545-ca9c-41cc-881c-0a73b5f73670 req-1478c84d-18aa-42e4-a3f3-d018f8bca8f5 service nova] Acquiring lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:15:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6bef2545-ca9c-41cc-881c-0a73b5f73670 req-1478c84d-18aa-42e4-a3f3-d018f8bca8f5 service nova] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:15:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6bef2545-ca9c-41cc-881c-0a73b5f73670 req-1478c84d-18aa-42e4-a3f3-d018f8bca8f5 service nova] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:15:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-6bef2545-ca9c-41cc-881c-0a73b5f73670 req-1478c84d-18aa-42e4-a3f3-d018f8bca8f5 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] No waiting events found dispatching network-vif-unplugged-26eaa437-c34e-4b6f-b907-e3083bc7b10a {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:15:14 user nova-compute[75246]: WARNING nova.compute.manager [req-6bef2545-ca9c-41cc-881c-0a73b5f73670 req-1478c84d-18aa-42e4-a3f3-d018f8bca8f5 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Received unexpected event network-vif-unplugged-26eaa437-c34e-4b6f-b907-e3083bc7b10a for instance with vm_state deleted and task_state None.
Nov 28 17:15:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-6bef2545-ca9c-41cc-881c-0a73b5f73670 req-1478c84d-18aa-42e4-a3f3-d018f8bca8f5 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Received event network-vif-plugged-26eaa437-c34e-4b6f-b907-e3083bc7b10a {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:15:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6bef2545-ca9c-41cc-881c-0a73b5f73670 req-1478c84d-18aa-42e4-a3f3-d018f8bca8f5 service nova] Acquiring lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:15:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6bef2545-ca9c-41cc-881c-0a73b5f73670 req-1478c84d-18aa-42e4-a3f3-d018f8bca8f5 service nova] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:15:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6bef2545-ca9c-41cc-881c-0a73b5f73670 req-1478c84d-18aa-42e4-a3f3-d018f8bca8f5 service nova] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:15:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-6bef2545-ca9c-41cc-881c-0a73b5f73670 req-1478c84d-18aa-42e4-a3f3-d018f8bca8f5 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] No waiting events found dispatching network-vif-plugged-26eaa437-c34e-4b6f-b907-e3083bc7b10a {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:15:14 user nova-compute[75246]: WARNING nova.compute.manager [req-6bef2545-ca9c-41cc-881c-0a73b5f73670 req-1478c84d-18aa-42e4-a3f3-d018f8bca8f5 service nova] [instance: aa9ef0b8-3519-416a-b42c-cd953c4ddc0d] Received unexpected event network-vif-plugged-26eaa437-c34e-4b6f-b907-e3083bc7b10a for instance with vm_state deleted and task_state None.
Nov 28 17:15:14 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Deleted allocations for instance aa9ef0b8-3519-416a-b42c-cd953c4ddc0d
Nov 28 17:15:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-bfb9a5a7-cc87-4305-9784-57e23cdc8374 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "aa9ef0b8-3519-416a-b42c-cd953c4ddc0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.098s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:15:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:23 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:15:23 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 17:15:24 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] There are 0 instances to clean {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 17:15:25 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 620ce71b-8ce0-492a-ac7e-72dd12987bfa is timed out.
Nov 28 17:15:25 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Successfully detached device vdb from instance 620ce71b-8ce0-492a-ac7e-72dd12987bfa from the live domain config.
Nov 28 17:15:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLJHgbUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:15:25 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf06248-0d15-453b-88cf-47ea3dc8ae9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:15:25 user nova-compute[75246]: No targets found.
Nov 28 17:15:25 user nova-compute[75246]: iSNS:
Nov 28 17:15:25 user nova-compute[75246]: No targets found.
Nov 28 17:15:25 user nova-compute[75246]: STATIC:
Nov 28 17:15:25 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e
Nov 28 17:15:25 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:15:25 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:15:25 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158
Nov 28 17:15:25 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:15:25 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:15:25 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa
Nov 28 17:15:25 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:15:25 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:15:25 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3
Nov 28 17:15:25 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:15:25 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:15:25 user nova-compute[75246]: FIRMWARE:
Nov 28 17:15:25 user nova-compute[75246]: No targets found.
Nov 28 17:15:25 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:15:25 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:15:25 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89cb1ff-d06e-406a-b4fe-f5d7a9d7c8b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ba9e54-f1f6-4bbc-a41b-c4a1fa315e13]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:15:25 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:15:25 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:15:25 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:15:25 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:15:25 user nova-compute[75246]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa (non-flash)
Nov 28 17:15:25 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:15:25 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:15:25 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4b8699630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa'): ({'sdb'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Removing single pathed devices sdb {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ccc607-ddcf-4d0c-ae0f-b89569ff2fac]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa812ef9-08ff-4d5c-b212-e44b749e8195]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Flushing IO for device /dev/sdb {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e588f0-6d95-4bf6-bd39-0de55198d833]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63612df-d1e8-44ac-be10-ca16c1a5f583]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7590a241-69e6-4489-8da6-24d011860021]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8ad290-ddf5-4871-9691-3238d5fa681b]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa, portal: 172.16.0.220,3260]
Nov 28 17:15:25 user nova-compute[75246]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa, portal: 172.16.0.220,3260] successful.
Nov 28 17:15:25 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf9c2de4-53e1-4251-b2c3-49e6365bd7fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca143c3f-b3cc-4442-9fdd-96adf9cc745b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] <== disconnect_volume: return (326ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:15:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:15:26 user nova-compute[75246]: DEBUG nova.objects.instance [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lazy-loading 'flavor' on Instance uuid 620ce71b-8ce0-492a-ac7e-72dd12987bfa {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:15:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-217509f0-db65-48b9-9e62-50d158a75b24 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.674s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:15:28 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:15:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:15:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:15:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:15:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:15:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:31 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:15:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:15:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:15:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:15:32 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:15:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:15:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:15:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:15:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:35 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:15:35 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:15:35 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=7290MB free_disk=25.173969268798828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:15:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:15:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e1266470-c182-4c0c-a575-4c5043f54745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c94900af-f484-47bf-8627-8aa863334b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 0ed72d2a-ca9b-4b99-b422-86fa93af945c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 620ce71b-8ce0-492a-ac7e-72dd12987bfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 90829136-472b-4c45-9607-c28433d05f56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 5c199841-2ce5-4f72-a3f1-6d6d0c746505 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 953ce3ec-438c-437a-90e8-4178529c1a32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 0fb728b1-9a86-412e-b37e-57a072164534 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing inventories for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating ProviderTree inventory for provider 241ad926-9deb-44ba-a618-a49e4ac21089 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating inventory in ProviderTree for provider 241ad926-9deb-44ba-a618-a49e4ac21089 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing aggregate associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, aggregates: None {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing trait associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.746s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:15:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75246) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 17:15:37 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:15:37 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:15:37 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:15:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-0ed72d2a-ca9b-4b99-b422-86fa93af945c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:15:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-0ed72d2a-ca9b-4b99-b422-86fa93af945c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:15:37 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:15:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:15:38 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Updating instance_info_cache with network_info: [{"id": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "address": "fa:16:3e:ef:e7:23", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e447d-e8", "ovs_interfaceid": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:15:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-0ed72d2a-ca9b-4b99-b422-86fa93af945c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:15:38 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:15:38 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:15:38 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:15:38 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:15:38 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:15:38 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:15:38 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:15:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:15:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:43 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:15:43 user nova-compute[75246]: INFO nova.compute.manager [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] instance snapshotting
Nov 28 17:15:43 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Beginning live snapshot process
Nov 28 17:15:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json -f qcow2 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json -f qcow2 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp70h_oxkx/2ea3a688b62e4ba7ac1d22dae8f3726b.delta 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp70h_oxkx/2ea3a688b62e4ba7ac1d22dae8f3726b.delta 1073741824" returned: 0 in 0.047s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:44 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 17:15:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:15:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] COPY block job progress, current cursor: 15925248 final cursor: 75497472 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:15:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:15:45 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 17:15:45 user nova-compute[75246]: DEBUG nova.privsep.utils [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75246) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 17:15:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp70h_oxkx/2ea3a688b62e4ba7ac1d22dae8f3726b.delta /opt/stack/data/nova/instances/snapshots/tmp70h_oxkx/2ea3a688b62e4ba7ac1d22dae8f3726b {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:15:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp70h_oxkx/2ea3a688b62e4ba7ac1d22dae8f3726b.delta /opt/stack/data/nova/instances/snapshots/tmp70h_oxkx/2ea3a688b62e4ba7ac1d22dae8f3726b" returned: 0 in 0.467s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:15:46 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Snapshot extracted, beginning image upload
Nov 28 17:15:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:15:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:15:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:15:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:15:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:48 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Snapshot image upload complete
Nov 28 17:15:48 user nova-compute[75246]: INFO nova.compute.manager [None req-4f870bc4-dc6a-4a71-bbb5-71c08df24df4 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Took 5.61 seconds to snapshot the instance on the hypervisor.
Nov 28 17:15:50 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:15:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:15:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:15:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:15:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:15:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:15:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:15:55 user nova-compute[75246]: INFO nova.compute.manager [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Terminating instance
Nov 28 17:15:55 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:15:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG nova.compute.manager [req-ccb0add2-1e8b-4f3d-813e-35c6fdcb806a req-61b83a46-f06f-44cb-96a1-830feec7e379 service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Received event network-vif-unplugged-ac842cb7-f241-4a68-bb18-9841f2e26ed0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ccb0add2-1e8b-4f3d-813e-35c6fdcb806a req-61b83a46-f06f-44cb-96a1-830feec7e379 service nova] Acquiring lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ccb0add2-1e8b-4f3d-813e-35c6fdcb806a req-61b83a46-f06f-44cb-96a1-830feec7e379 service nova] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ccb0add2-1e8b-4f3d-813e-35c6fdcb806a req-61b83a46-f06f-44cb-96a1-830feec7e379 service nova] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG nova.compute.manager [req-ccb0add2-1e8b-4f3d-813e-35c6fdcb806a req-61b83a46-f06f-44cb-96a1-830feec7e379 service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] No waiting events found dispatching network-vif-unplugged-ac842cb7-f241-4a68-bb18-9841f2e26ed0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG nova.compute.manager [req-ccb0add2-1e8b-4f3d-813e-35c6fdcb806a req-61b83a46-f06f-44cb-96a1-830feec7e379 service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Received event network-vif-unplugged-ac842cb7-f241-4a68-bb18-9841f2e26ed0 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:15:56 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Instance destroyed successfully.
Nov 28 17:15:56 user nova-compute[75246]: DEBUG nova.objects.instance [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lazy-loading 'resources' on Instance uuid 620ce71b-8ce0-492a-ac7e-72dd12987bfa {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:11:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1139541218',display_name='tempest-TestServerVolumeAttachmentScenario-server-1139541218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1139541218',id=30,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCedd/aOe/QHLQ6YdGcHXoFFfdTMZ1dbNux1Karb3lOEPBr5IDWlmKz8Deg32DmQqiepavZn0PF575jyYD+Ou3tf/ks/cJpvcKL/a7e1CGfNddCs1DiYEiaYsXO/iD+7Q==',key_name='tempest-keypair-1064130482',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:12:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca57cea906e44d0b99222b8a7ebcc3a3',ramdisk_id='',reservation_id='r-ak61824c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-615546460',owner_user_name='tempest-TestServerVolumeAttachmentScenario-615546460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd16e9d549c1421ea573f21b2adee326',uuid=620ce71b-8ce0-492a-ac7e-72dd12987bfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "address": "fa:16:3e:6a:5d:8b", "network": {"id": "0fb12881-436f-4943-9a68-00e1b782cc8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-319021949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca57cea906e44d0b99222b8a7ebcc3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac842cb7-f2", "ovs_interfaceid": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Converting VIF {"id": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "address": "fa:16:3e:6a:5d:8b", "network": {"id": "0fb12881-436f-4943-9a68-00e1b782cc8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-319021949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca57cea906e44d0b99222b8a7ebcc3a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac842cb7-f2", "ovs_interfaceid": "ac842cb7-f241-4a68-bb18-9841f2e26ed0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:5d:8b,bridge_name='br-int',has_traffic_filtering=True,id=ac842cb7-f241-4a68-bb18-9841f2e26ed0,network=Network(0fb12881-436f-4943-9a68-00e1b782cc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac842cb7-f2') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG os_vif [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:5d:8b,bridge_name='br-int',has_traffic_filtering=True,id=ac842cb7-f241-4a68-bb18-9841f2e26ed0,network=Network(0fb12881-436f-4943-9a68-00e1b782cc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac842cb7-f2') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac842cb7-f2, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0597921c-4a0f-42b1-9e7e-ef3684ebcbcd) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:15:56 user nova-compute[75246]: INFO os_vif [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:5d:8b,bridge_name='br-int',has_traffic_filtering=True,id=ac842cb7-f241-4a68-bb18-9841f2e26ed0,network=Network(0fb12881-436f-4943-9a68-00e1b782cc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac842cb7-f2')
Nov 28 17:15:56 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Deleting instance files /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa_del
Nov 28 17:15:56 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Deletion of /opt/stack/data/nova/instances/620ce71b-8ce0-492a-ac7e-72dd12987bfa_del complete
Nov 28 17:15:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:15:56 user nova-compute[75246]: INFO nova.compute.manager [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 28 17:15:56 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:15:56 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:15:57 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:15:57 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Took 0.71 seconds to deallocate network for instance.
Nov 28 17:15:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:15:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:15:57 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:15:57 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:15:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:15:57 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Deleted allocations for instance 620ce71b-8ce0-492a-ac7e-72dd12987bfa
Nov 28 17:15:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4e3cf1ee-a6fe-42cb-808e-8273bab11c93 tempest-TestServerVolumeAttachmentScenario-615546460 tempest-TestServerVolumeAttachmentScenario-615546460-project-member] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.126s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:15:58 user nova-compute[75246]: DEBUG nova.compute.manager [req-c1442a4f-c57d-4656-8d74-abcba59d7228 req-b7dbc1ae-baa7-4b2f-bbe1-1ec85fe62763 service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Received event network-vif-plugged-ac842cb7-f241-4a68-bb18-9841f2e26ed0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:15:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c1442a4f-c57d-4656-8d74-abcba59d7228 req-b7dbc1ae-baa7-4b2f-bbe1-1ec85fe62763 service nova] Acquiring lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:15:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c1442a4f-c57d-4656-8d74-abcba59d7228 req-b7dbc1ae-baa7-4b2f-bbe1-1ec85fe62763 service nova] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:15:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c1442a4f-c57d-4656-8d74-abcba59d7228 req-b7dbc1ae-baa7-4b2f-bbe1-1ec85fe62763 service nova] Lock "620ce71b-8ce0-492a-ac7e-72dd12987bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:15:58 user nova-compute[75246]: DEBUG nova.compute.manager [req-c1442a4f-c57d-4656-8d74-abcba59d7228 req-b7dbc1ae-baa7-4b2f-bbe1-1ec85fe62763 service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] No waiting events found dispatching network-vif-plugged-ac842cb7-f241-4a68-bb18-9841f2e26ed0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:15:58 user nova-compute[75246]: WARNING nova.compute.manager [req-c1442a4f-c57d-4656-8d74-abcba59d7228 req-b7dbc1ae-baa7-4b2f-bbe1-1ec85fe62763 service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Received unexpected event network-vif-plugged-ac842cb7-f241-4a68-bb18-9841f2e26ed0 for instance with vm_state deleted and task_state None.
Nov 28 17:15:58 user nova-compute[75246]: DEBUG nova.compute.manager [req-c1442a4f-c57d-4656-8d74-abcba59d7228 req-b7dbc1ae-baa7-4b2f-bbe1-1ec85fe62763 service nova] [instance: 620ce71b-8ce0-492a-ac7e-72dd12987bfa] Received event network-vif-deleted-ac842cb7-f241-4a68-bb18-9841f2e26ed0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:16:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-40383e77-1c4f-491f-ad5c-752fbde9053a req-24ff779d-7c82-418b-8629-76e90c3e4f97 service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Received event network-changed-4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:16:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-40383e77-1c4f-491f-ad5c-752fbde9053a req-24ff779d-7c82-418b-8629-76e90c3e4f97 service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Refreshing instance network info cache due to event network-changed-4cd5853c-099d-4ec5-91b6-475f7c703aeb. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:16:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-40383e77-1c4f-491f-ad5c-752fbde9053a req-24ff779d-7c82-418b-8629-76e90c3e4f97 service nova] Acquiring lock "refresh_cache-953ce3ec-438c-437a-90e8-4178529c1a32" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:16:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-40383e77-1c4f-491f-ad5c-752fbde9053a req-24ff779d-7c82-418b-8629-76e90c3e4f97 service nova] Acquired lock "refresh_cache-953ce3ec-438c-437a-90e8-4178529c1a32" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:16:06 user nova-compute[75246]: DEBUG nova.network.neutron [req-40383e77-1c4f-491f-ad5c-752fbde9053a req-24ff779d-7c82-418b-8629-76e90c3e4f97 service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Refreshing network info cache for port 4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:16:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "953ce3ec-438c-437a-90e8-4178529c1a32" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "953ce3ec-438c-437a-90e8-4178529c1a32" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:06 user nova-compute[75246]: DEBUG nova.objects.instance [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lazy-loading 'flavor' on Instance uuid 953ce3ec-438c-437a-90e8-4178529c1a32 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:16:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:16:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "953ce3ec-438c-437a-90e8-4178529c1a32" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:06 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:16:06 user nova-compute[75246]: INFO nova.compute.claims [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Claim successful on node user
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "953ce3ec-438c-437a-90e8-4178529c1a32" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "953ce3ec-438c-437a-90e8-4178529c1a32" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:07 user nova-compute[75246]: INFO nova.compute.manager [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Attaching volume 4e0169b2-12ec-4f65-aba2-edfe7286e1a4 to /dev/vdb
Nov 28 17:16:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG os_brick.utils [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cba5e2-e7a9-4e96-8708-4bf865b484a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d01516-cee4-4c40-9344-64b4832205ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a206d867-f727-45e8-bdc2-ad3c6a04bc31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[779989a1-e966-4dcd-a6ca-6445c631ef85]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG nova.network.neutron [req-40383e77-1c4f-491f-ad5c-752fbde9053a req-24ff779d-7c82-418b-8629-76e90c3e4f97 service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Updated VIF entry in instance network info cache for port 4cd5853c-099d-4ec5-91b6-475f7c703aeb. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG nova.network.neutron [req-40383e77-1c4f-491f-ad5c-752fbde9053a req-24ff779d-7c82-418b-8629-76e90c3e4f97 service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Updating instance_info_cache with network_info: [{"id": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "address": "fa:16:3e:bc:39:fe", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5853c-09", "ovs_interfaceid": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-40383e77-1c4f-491f-ad5c-752fbde9053a req-24ff779d-7c82-418b-8629-76e90c3e4f97 service nova] Releasing lock "refresh_cache-953ce3ec-438c-437a-90e8-4178529c1a32" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:16:07 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8006dd6c-0b5f-4638-8187-a928d54d869e]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG os_brick.utils [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Updating existing volume attachment record: e1111949-fa91-4d07-aead-8c54456715b3 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:07 user nova-compute[75246]: INFO nova.compute.manager [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Unshelving
Nov 28 17:16:07 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.012s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG nova.objects.instance [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'pci_requests' on Instance uuid 1d3f57d8-3580-4c42-8a4c-cef210e19eb4 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG nova.objects.instance [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'numa_topology' on Instance uuid 1d3f57d8-3580-4c42-8a4c-cef210e19eb4 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:16:07 user nova-compute[75246]: INFO nova.compute.claims [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Claim successful on node user
Nov 28 17:16:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG nova.network.neutron [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:16:07 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:16:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:16:07 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Creating image(s)
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "/opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "/opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "/opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG nova.policy [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03ae91a734974162a14d7b4c498c4b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d39dde859674409847b50613bcc608b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.186s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:07 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.193s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:08 user nova-compute[75246]: INFO nova.network.neutron [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Updating port 434dbbbd-947d-47c5-a794-4fee8690d835 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk 1073741824" returned: 0 in 0.068s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Cannot resize image /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Ensure instance console log exists: /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:08 user nova-compute[75246]: DEBUG nova.network.neutron [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Successfully created port: 5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquired lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG nova.network.neutron [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-dc76d2f0-621d-4db9-a826-a7d1cc7af482 req-cb4b644e-254b-4491-b69a-e5cd64825130 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received event network-changed-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-dc76d2f0-621d-4db9-a826-a7d1cc7af482 req-cb4b644e-254b-4491-b69a-e5cd64825130 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Refreshing instance network info cache due to event network-changed-434dbbbd-947d-47c5-a794-4fee8690d835. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-dc76d2f0-621d-4db9-a826-a7d1cc7af482 req-cb4b644e-254b-4491-b69a-e5cd64825130 service nova] Acquiring lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG nova.network.neutron [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Updating instance_info_cache with network_info: [{"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Releasing lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:16:09 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Creating image(s)
Nov 28 17:16:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "/opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "/opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG nova.objects.instance [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1d3f57d8-3580-4c42-8a4c-cef210e19eb4 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-dc76d2f0-621d-4db9-a826-a7d1cc7af482 req-cb4b644e-254b-4491-b69a-e5cd64825130 service nova] Acquired lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG nova.network.neutron [req-dc76d2f0-621d-4db9-a826-a7d1cc7af482 req-cb4b644e-254b-4491-b69a-e5cd64825130 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Refreshing network info cache for port 434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG nova.network.neutron [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Successfully updated port: 5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG nova.objects.base [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Object Instance<1d3f57d8-3580-4c42-8a4c-cef210e19eb4> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "98a4c755859047a9be7cb7200466afe02d4192dc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "98a4c755859047a9be7cb7200466afe02d4192dc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "refresh_cache-9885ad9e-10d1-4b86-afe4-252f543bc2ec" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquired lock "refresh_cache-9885ad9e-10d1-4b86-afe4-252f543bc2ec" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:16:09 user nova-compute[75246]: DEBUG nova.network.neutron [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:16:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc.part --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:10 user nova-compute[75246]: DEBUG nova.network.neutron [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.images [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] 1951ced5-e521-49f3-abd2-6da5c17ec0ed was qcow2, converting to raw {{(pid=75246) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.privsep.utils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75246) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc.part /opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc.converted {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:11 user nova-compute[75246]: INFO nova.compute.manager [None req-6334c291-675c-4e88-af03-eee49393cca2 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Unrescuing
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6334c291-675c-4e88-af03-eee49393cca2 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6334c291-675c-4e88-af03-eee49393cca2 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquired lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6334c291-675c-4e88-af03-eee49393cca2 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-da99fa81-1e08-4a84-acd9-f3ba42ebdaa2 req-54e67e81-00e6-47cd-b8a0-eaa482414c5c service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Received event network-changed-5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-da99fa81-1e08-4a84-acd9-f3ba42ebdaa2 req-54e67e81-00e6-47cd-b8a0-eaa482414c5c service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Refreshing instance network info cache due to event network-changed-5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-da99fa81-1e08-4a84-acd9-f3ba42ebdaa2 req-54e67e81-00e6-47cd-b8a0-eaa482414c5c service nova] Acquiring lock "refresh_cache-9885ad9e-10d1-4b86-afe4-252f543bc2ec" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc.part /opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc.converted" returned: 0 in 0.272s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc.converted --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.network.neutron [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Updating instance_info_cache with network_info: [{"id": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "address": "fa:16:3e:8b:ef:38", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f8bb871-17", "ovs_interfaceid": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Releasing lock "refresh_cache-9885ad9e-10d1-4b86-afe4-252f543bc2ec" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.compute.manager [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Instance network_info: |[{"id": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "address": "fa:16:3e:8b:ef:38", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f8bb871-17", "ovs_interfaceid": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-da99fa81-1e08-4a84-acd9-f3ba42ebdaa2 req-54e67e81-00e6-47cd-b8a0-eaa482414c5c service nova] Acquired lock "refresh_cache-9885ad9e-10d1-4b86-afe4-252f543bc2ec" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.network.neutron [req-da99fa81-1e08-4a84-acd9-f3ba42ebdaa2 req-54e67e81-00e6-47cd-b8a0-eaa482414c5c service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Refreshing network info cache for port 5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Start _get_guest_xml network_info=[{"id": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "address": "fa:16:3e:8b:ef:38", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f8bb871-17", "ovs_interfaceid": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:16:11 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:16:11 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-913953353',display_name='tempest-AttachVolumeNegativeTest-server-913953353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-913953353',id=36,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPrfGpihlwhj1nhbfIh50p6lz5WReDE81fXFguzfNjIlemUS50ubkZEwYGIMpiI8Fc8pq0N3hJxqhksx1+poDXyZqvm89CYPy9K2eekTSU/655XojtqkmY/3CJBo/gF/Q==',key_name='tempest-keypair-776473454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d39dde859674409847b50613bcc608b',ramdisk_id='',reservation_id='r-0poqan5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-524813585',owner_user_name='tempest-AttachVolumeNegativeTest-524813585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:16:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ae91a734974162a14d7b4c498c4b8d',uuid=9885ad9e-10d1-4b86-afe4-252f543bc2ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "address": "fa:16:3e:8b:ef:38", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f8bb871-17", "ovs_interfaceid": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converting VIF {"id": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "address": "fa:16:3e:8b:ef:38", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f8bb871-17", "ovs_interfaceid": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ef:38,bridge_name='br-int',has_traffic_filtering=True,id=5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f8bb871-17') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.objects.instance [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lazy-loading 'pci_devices' on Instance uuid 9885ad9e-10d1-4b86-afe4-252f543bc2ec {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.network.neutron [req-dc76d2f0-621d-4db9-a826-a7d1cc7af482 req-cb4b644e-254b-4491-b69a-e5cd64825130 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Updated VIF entry in instance network info cache for port 434dbbbd-947d-47c5-a794-4fee8690d835. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.network.neutron [req-dc76d2f0-621d-4db9-a826-a7d1cc7af482 req-cb4b644e-254b-4491-b69a-e5cd64825130 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Updating instance_info_cache with network_info: [{"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:16:11 user nova-compute[75246]:   <uuid>9885ad9e-10d1-4b86-afe4-252f543bc2ec</uuid>
Nov 28 17:16:11 user nova-compute[75246]:   <name>instance-00000024</name>
Nov 28 17:16:11 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:16:11 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:16:11 user nova-compute[75246]:   <metadata>
Nov 28 17:16:11 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:16:11 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:16:11 user nova-compute[75246]:       <nova:name>tempest-AttachVolumeNegativeTest-server-913953353</nova:name>
Nov 28 17:16:11 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:16:11</nova:creationTime>
Nov 28 17:16:11 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:16:11 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:16:11 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:16:11 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:16:11 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:16:11 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:16:11 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:16:11 user nova-compute[75246]:       <nova:owner>
Nov 28 17:16:11 user nova-compute[75246]:         <nova:user uuid="03ae91a734974162a14d7b4c498c4b8d">tempest-AttachVolumeNegativeTest-524813585-project-member</nova:user>
Nov 28 17:16:11 user nova-compute[75246]:         <nova:project uuid="9d39dde859674409847b50613bcc608b">tempest-AttachVolumeNegativeTest-524813585</nova:project>
Nov 28 17:16:11 user nova-compute[75246]:       </nova:owner>
Nov 28 17:16:11 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:16:11 user nova-compute[75246]:       <nova:ports>
Nov 28 17:16:11 user nova-compute[75246]:         <nova:port uuid="5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1">
Nov 28 17:16:11 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 17:16:11 user nova-compute[75246]:         </nova:port>
Nov 28 17:16:11 user nova-compute[75246]:       </nova:ports>
Nov 28 17:16:11 user nova-compute[75246]:     </nova:instance>
Nov 28 17:16:11 user nova-compute[75246]:   </metadata>
Nov 28 17:16:11 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:16:11 user nova-compute[75246]:     <system>
Nov 28 17:16:11 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:16:11 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:16:11 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:16:11 user nova-compute[75246]:       <entry name="serial">9885ad9e-10d1-4b86-afe4-252f543bc2ec</entry>
Nov 28 17:16:11 user nova-compute[75246]:       <entry name="uuid">9885ad9e-10d1-4b86-afe4-252f543bc2ec</entry>
Nov 28 17:16:11 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:16:11 user nova-compute[75246]:     </system>
Nov 28 17:16:11 user nova-compute[75246]:   </sysinfo>
Nov 28 17:16:11 user nova-compute[75246]:   <os>
Nov 28 17:16:11 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:16:11 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:16:11 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:16:11 user nova-compute[75246]:   </os>
Nov 28 17:16:11 user nova-compute[75246]:   <features>
Nov 28 17:16:11 user nova-compute[75246]:     <acpi/>
Nov 28 17:16:11 user nova-compute[75246]:     <apic/>
Nov 28 17:16:11 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:16:11 user nova-compute[75246]:   </features>
Nov 28 17:16:11 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:16:11 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:16:11 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:16:11 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:16:11 user nova-compute[75246]:   </clock>
Nov 28 17:16:11 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:16:11 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:16:11 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:16:11 user nova-compute[75246]:   </cpu>
Nov 28 17:16:11 user nova-compute[75246]:   <devices>
Nov 28 17:16:11 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:16:11 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:16:11 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk"/>
Nov 28 17:16:11 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:16:11 user nova-compute[75246]:     </disk>
Nov 28 17:16:11 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:16:11 user nova-compute[75246]:       <mac address="fa:16:3e:8b:ef:38"/>
Nov 28 17:16:11 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:16:11 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:16:11 user nova-compute[75246]:       <target dev="tap5f8bb871-17"/>
Nov 28 17:16:11 user nova-compute[75246]:     </interface>
Nov 28 17:16:11 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:16:11 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/console.log" append="off"/>
Nov 28 17:16:11 user nova-compute[75246]:     </serial>
Nov 28 17:16:11 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:16:11 user nova-compute[75246]:     <video>
Nov 28 17:16:11 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:16:11 user nova-compute[75246]:     </video>
Nov 28 17:16:11 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:16:11 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:16:11 user nova-compute[75246]:     </rng>
Nov 28 17:16:11 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:16:11 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:16:11 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:16:11 user nova-compute[75246]:     </memballoon>
Nov 28 17:16:11 user nova-compute[75246]:   </devices>
Nov 28 17:16:11 user nova-compute[75246]: </domain>
Nov 28 17:16:11 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-913953353',display_name='tempest-AttachVolumeNegativeTest-server-913953353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-913953353',id=36,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPrfGpihlwhj1nhbfIh50p6lz5WReDE81fXFguzfNjIlemUS50ubkZEwYGIMpiI8Fc8pq0N3hJxqhksx1+poDXyZqvm89CYPy9K2eekTSU/655XojtqkmY/3CJBo/gF/Q==',key_name='tempest-keypair-776473454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d39dde859674409847b50613bcc608b',ramdisk_id='',reservation_id='r-0poqan5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-524813585',owner_user_name='tempest-AttachVolumeNegativeTest-524813585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:16:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ae91a734974162a14d7b4c498c4b8d',uuid=9885ad9e-10d1-4b86-afe4-252f543bc2ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "address": "fa:16:3e:8b:ef:38", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f8bb871-17", "ovs_interfaceid": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converting VIF {"id": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "address": "fa:16:3e:8b:ef:38", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f8bb871-17", "ovs_interfaceid": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ef:38,bridge_name='br-int',has_traffic_filtering=True,id=5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f8bb871-17') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG os_vif [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ef:38,bridge_name='br-int',has_traffic_filtering=True,id=5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f8bb871-17') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc.converted --force-share --output=json" returned: 0 in 0.226s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "98a4c755859047a9be7cb7200466afe02d4192dc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.685s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-dc76d2f0-621d-4db9-a826-a7d1cc7af482 req-cb4b644e-254b-4491-b69a-e5cd64825130 service nova] Releasing lock "refresh_cache-1d3f57d8-3580-4c42-8a4c-cef210e19eb4" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5a63541-8915-5ad1-8f13-5a863d1fd349', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f8bb871-17, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f8bb871-17, col_values=(('qos', UUID('9cc3679b-d583-4187-83ad-2e7ce4f25b67')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f8bb871-17, col_values=(('external_ids', {'iface-id': '5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:ef:38', 'vm-uuid': '9885ad9e-10d1-4b86-afe4-252f543bc2ec'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:11 user nova-compute[75246]: INFO os_vif [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ef:38,bridge_name='br-int',has_traffic_filtering=True,id=5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f8bb871-17')
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] No VIF found with MAC fa:16:3e:8b:ef:38, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc --force-share --output=json" returned: 0 in 0.190s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "98a4c755859047a9be7cb7200466afe02d4192dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "98a4c755859047a9be7cb7200466afe02d4192dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6334c291-675c-4e88-af03-eee49393cca2 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Updating instance_info_cache with network_info: [{"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6334c291-675c-4e88-af03-eee49393cca2 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Releasing lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6334c291-675c-4e88-af03-eee49393cca2 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'flavor' on Instance uuid 90829136-472b-4c45-9607-c28433d05f56 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc --force-share --output=json" returned: 0 in 0.176s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc,backing_fmt=raw /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG nova.network.neutron [req-da99fa81-1e08-4a84-acd9-f3ba42ebdaa2 req-54e67e81-00e6-47cd-b8a0-eaa482414c5c service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Updated VIF entry in instance network info cache for port 5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG nova.network.neutron [req-da99fa81-1e08-4a84-acd9-f3ba42ebdaa2 req-54e67e81-00e6-47cd-b8a0-eaa482414c5c service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Updating instance_info_cache with network_info: [{"id": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "address": "fa:16:3e:8b:ef:38", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f8bb871-17", "ovs_interfaceid": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc,backing_fmt=raw /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk 1073741824" returned: 0 in 0.059s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "98a4c755859047a9be7cb7200466afe02d4192dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-da99fa81-1e08-4a84-acd9-f3ba42ebdaa2 req-54e67e81-00e6-47cd-b8a0-eaa482414c5c service nova] Releasing lock "refresh_cache-9885ad9e-10d1-4b86-afe4-252f543bc2ec" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc --force-share --output=json" returned: 0 in 0.193s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG nova.objects.instance [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'migration_context' on Instance uuid 1d3f57d8-3580-4c42-8a4c-cef210e19eb4 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG nova.objects.base [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Object Instance<1d3f57d8-3580-4c42-8a4c-cef210e19eb4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:16:12 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Rebasing disk image.
Nov 28 17:16:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG nova.compute.manager [req-fbe94fa5-f3be-4d8b-bf4e-18e0f61b42f5 req-49ac3392-c759-434e-be70-fccde615313e service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received event network-vif-unplugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fbe94fa5-f3be-4d8b-bf4e-18e0f61b42f5 req-49ac3392-c759-434e-be70-fccde615313e service nova] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fbe94fa5-f3be-4d8b-bf4e-18e0f61b42f5 req-49ac3392-c759-434e-be70-fccde615313e service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fbe94fa5-f3be-4d8b-bf4e-18e0f61b42f5 req-49ac3392-c759-434e-be70-fccde615313e service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG nova.compute.manager [req-fbe94fa5-f3be-4d8b-bf4e-18e0f61b42f5 req-49ac3392-c759-434e-be70-fccde615313e service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] No waiting events found dispatching network-vif-unplugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:16:12 user nova-compute[75246]: WARNING nova.compute.manager [req-fbe94fa5-f3be-4d8b-bf4e-18e0f61b42f5 req-49ac3392-c759-434e-be70-fccde615313e service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received unexpected event network-vif-unplugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 for instance with vm_state rescued and task_state unrescuing.
Nov 28 17:16:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.222s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 -F raw /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:13 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 90829136-472b-4c45-9607-c28433d05f56] Instance destroyed successfully.
Nov 28 17:16:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-b1109670-b1e9-40e3-ba6c-5254afb5a6b8 req-5797158a-fcbe-4a39-b873-731dae022ced service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Received event network-vif-plugged-5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:16:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b1109670-b1e9-40e3-ba6c-5254afb5a6b8 req-5797158a-fcbe-4a39-b873-731dae022ced service nova] Acquiring lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b1109670-b1e9-40e3-ba6c-5254afb5a6b8 req-5797158a-fcbe-4a39-b873-731dae022ced service nova] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b1109670-b1e9-40e3-ba6c-5254afb5a6b8 req-5797158a-fcbe-4a39-b873-731dae022ced service nova] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-b1109670-b1e9-40e3-ba6c-5254afb5a6b8 req-5797158a-fcbe-4a39-b873-731dae022ced service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] No waiting events found dispatching network-vif-plugged-5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:16:13 user nova-compute[75246]: WARNING nova.compute.manager [req-b1109670-b1e9-40e3-ba6c-5254afb5a6b8 req-5797158a-fcbe-4a39-b873-731dae022ced service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Received unexpected event network-vif-plugged-5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 for instance with vm_state building and task_state spawning.
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-6b9b8b39-c018-4722-9dc0-4a85d2800bec req-e54c8d23-5467-46a9-a6f7-0109e483d68a service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received event network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6b9b8b39-c018-4722-9dc0-4a85d2800bec req-e54c8d23-5467-46a9-a6f7-0109e483d68a service nova] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6b9b8b39-c018-4722-9dc0-4a85d2800bec req-e54c8d23-5467-46a9-a6f7-0109e483d68a service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6b9b8b39-c018-4722-9dc0-4a85d2800bec req-e54c8d23-5467-46a9-a6f7-0109e483d68a service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-6b9b8b39-c018-4722-9dc0-4a85d2800bec req-e54c8d23-5467-46a9-a6f7-0109e483d68a service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] No waiting events found dispatching network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:16:14 user nova-compute[75246]: WARNING nova.compute.manager [req-6b9b8b39-c018-4722-9dc0-4a85d2800bec req-e54c8d23-5467-46a9-a6f7-0109e483d68a service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received unexpected event network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 for instance with vm_state rescued and task_state unrescuing.
Nov 28 17:16:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 -F raw /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk" returned: 0 in 2.169s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Ensure instance console log exists: /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Start _get_guest_xml network_info=[{"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8cebe2d4fd37eb1f04275f387f536707',container_format='bare',created_at=2023-11-28T17:14:14Z,direct_url=<?>,disk_format='qcow2',id=1951ced5-e521-49f3-abd2-6da5c17ec0ed,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2130907667-shelved',owner='cd94665acd9a4448a1ad1350d71d8f72',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T17:14:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:16:14 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:16:14 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8cebe2d4fd37eb1f04275f387f536707',container_format='bare',created_at=2023-11-28T17:14:14Z,direct_url=<?>,disk_format='qcow2',id=1951ced5-e521-49f3-abd2-6da5c17ec0ed,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2130907667-shelved',owner='cd94665acd9a4448a1ad1350d71d8f72',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T17:14:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.objects.instance [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1d3f57d8-3580-4c42-8a4c-cef210e19eb4 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.objects.base [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Object Instance<1d3f57d8-3580-4c42-8a4c-cef210e19eb4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T17:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2130907667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2130907667',id=32,image_ref='1951ced5-e521-49f3-abd2-6da5c17ec0ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1886774448',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:12:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cd94665acd9a4448a1ad1350d71d8f72',ramdisk_id='',reservation_id='r-3eim7bic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726606277',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726606277-project-member',shelved_at='2023-11-28T17:14:20.329748',shelved_host='user',shelved_image_id='1951ced5-e521-49f3-abd2-6da5c17ec0ed'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:16:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ed095223674edebcee82e4183c8ea0',uuid=1d3f57d8-3580-4c42-8a4c-cef210e19eb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converting VIF {"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:db:6a,bridge_name='br-int',has_traffic_filtering=True,id=434dbbbd-947d-47c5-a794-4fee8690d835,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434dbbbd-94') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.objects.instance [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d3f57d8-3580-4c42-8a4c-cef210e19eb4 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.objects.base [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Object Instance<1d3f57d8-3580-4c42-8a4c-cef210e19eb4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:16:14 user nova-compute[75246]:   <uuid>1d3f57d8-3580-4c42-8a4c-cef210e19eb4</uuid>
Nov 28 17:16:14 user nova-compute[75246]:   <name>instance-00000020</name>
Nov 28 17:16:14 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:16:14 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:16:14 user nova-compute[75246]:   <metadata>
Nov 28 17:16:14 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:16:14 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:16:14 user nova-compute[75246]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2130907667</nova:name>
Nov 28 17:16:14 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:16:14</nova:creationTime>
Nov 28 17:16:14 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:16:14 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:16:14 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:16:14 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:16:14 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:16:14 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:16:14 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:16:14 user nova-compute[75246]:       <nova:owner>
Nov 28 17:16:14 user nova-compute[75246]:         <nova:user uuid="a0ed095223674edebcee82e4183c8ea0">tempest-AttachVolumeShelveTestJSON-1726606277-project-member</nova:user>
Nov 28 17:16:14 user nova-compute[75246]:         <nova:project uuid="cd94665acd9a4448a1ad1350d71d8f72">tempest-AttachVolumeShelveTestJSON-1726606277</nova:project>
Nov 28 17:16:14 user nova-compute[75246]:       </nova:owner>
Nov 28 17:16:14 user nova-compute[75246]:       <nova:root type="image" uuid="1951ced5-e521-49f3-abd2-6da5c17ec0ed"/>
Nov 28 17:16:14 user nova-compute[75246]:       <nova:ports>
Nov 28 17:16:14 user nova-compute[75246]:         <nova:port uuid="434dbbbd-947d-47c5-a794-4fee8690d835">
Nov 28 17:16:14 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 17:16:14 user nova-compute[75246]:         </nova:port>
Nov 28 17:16:14 user nova-compute[75246]:       </nova:ports>
Nov 28 17:16:14 user nova-compute[75246]:     </nova:instance>
Nov 28 17:16:14 user nova-compute[75246]:   </metadata>
Nov 28 17:16:14 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:16:14 user nova-compute[75246]:     <system>
Nov 28 17:16:14 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:16:14 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:16:14 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:16:14 user nova-compute[75246]:       <entry name="serial">1d3f57d8-3580-4c42-8a4c-cef210e19eb4</entry>
Nov 28 17:16:14 user nova-compute[75246]:       <entry name="uuid">1d3f57d8-3580-4c42-8a4c-cef210e19eb4</entry>
Nov 28 17:16:14 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:16:14 user nova-compute[75246]:     </system>
Nov 28 17:16:14 user nova-compute[75246]:   </sysinfo>
Nov 28 17:16:14 user nova-compute[75246]:   <os>
Nov 28 17:16:14 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:16:14 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:16:14 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:16:14 user nova-compute[75246]:   </os>
Nov 28 17:16:14 user nova-compute[75246]:   <features>
Nov 28 17:16:14 user nova-compute[75246]:     <acpi/>
Nov 28 17:16:14 user nova-compute[75246]:     <apic/>
Nov 28 17:16:14 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:16:14 user nova-compute[75246]:   </features>
Nov 28 17:16:14 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:16:14 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:16:14 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:16:14 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:16:14 user nova-compute[75246]:   </clock>
Nov 28 17:16:14 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:16:14 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:16:14 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:16:14 user nova-compute[75246]:   </cpu>
Nov 28 17:16:14 user nova-compute[75246]:   <devices>
Nov 28 17:16:14 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:16:14 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:16:14 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk"/>
Nov 28 17:16:14 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:16:14 user nova-compute[75246]:     </disk>
Nov 28 17:16:14 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:16:14 user nova-compute[75246]:       <mac address="fa:16:3e:24:db:6a"/>
Nov 28 17:16:14 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:16:14 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:16:14 user nova-compute[75246]:       <target dev="tap434dbbbd-94"/>
Nov 28 17:16:14 user nova-compute[75246]:     </interface>
Nov 28 17:16:14 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:16:14 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/console.log" append="off"/>
Nov 28 17:16:14 user nova-compute[75246]:     </serial>
Nov 28 17:16:14 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:16:14 user nova-compute[75246]:     <video>
Nov 28 17:16:14 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:16:14 user nova-compute[75246]:     </video>
Nov 28 17:16:14 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:16:14 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:16:14 user nova-compute[75246]:     </rng>
Nov 28 17:16:14 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:16:14 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:16:14 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:16:14 user nova-compute[75246]:     </memballoon>
Nov 28 17:16:14 user nova-compute[75246]:   </devices>
Nov 28 17:16:14 user nova-compute[75246]: </domain>
Nov 28 17:16:14 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T17:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2130907667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2130907667',id=32,image_ref='1951ced5-e521-49f3-abd2-6da5c17ec0ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1886774448',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:12:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cd94665acd9a4448a1ad1350d71d8f72',ramdisk_id='',reservation_id='r-3eim7bic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726606277',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726606277-project-member',shelved_at='2023-11-28T17:14:20.329748',shelved_host='user',shelved_image_id='1951ced5-e521-49f3-abd2-6da5c17ec0ed'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:16:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ed095223674edebcee82e4183c8ea0',uuid=1d3f57d8-3580-4c42-8a4c-cef210e19eb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converting VIF {"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:db:6a,bridge_name='br-int',has_traffic_filtering=True,id=434dbbbd-947d-47c5-a794-4fee8690d835,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434dbbbd-94') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG os_vif [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:db:6a,bridge_name='br-int',has_traffic_filtering=True,id=434dbbbd-947d-47c5-a794-4fee8690d835,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434dbbbd-94') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22722f50-7947-5208-86f6-d9a77adee9b5', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap434dbbbd-94, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap434dbbbd-94, col_values=(('qos', UUID('43e0fa4e-998a-479c-a5e3-5904d6ce0191')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap434dbbbd-94, col_values=(('external_ids', {'iface-id': '434dbbbd-947d-47c5-a794-4fee8690d835', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:db:6a', 'vm-uuid': '1d3f57d8-3580-4c42-8a4c-cef210e19eb4'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:14 user nova-compute[75246]: INFO os_vif [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:db:6a,bridge_name='br-int',has_traffic_filtering=True,id=434dbbbd-947d-47c5-a794-4fee8690d835,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434dbbbd-94')
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:16:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] No VIF found with MAC fa:16:3e:24:db:6a, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DVWvgXuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:16:15 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:16:15 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:16:15 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e6c0fc-c30e-4718-8377-db2316b86b0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:16:15 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f7e983-e55b-462b-84c9-49d3fe71b1b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4] added
Nov 28 17:16:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fed960f-5c1d-4f70-a019-caec24ea3957]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e82f9e-4b91-4ca4-8875-db45f15bbcd2]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DVWvgXuc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DVWvgXuc" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2a7bc3-0b1c-43fc-9c42-40be7cf3aaa3]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DVWvgXuc'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd60997-a277-40ca-a0f6-187e0359b80a]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.090s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0f405f-46a1-4984-9095-95d53fea9c7d]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:16:15 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:16:15 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:16:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:16:15 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:16:15 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:16:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f38051-5c1c-4879-a83c-b2386137cd05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4, portal: 172.16.0.220,3260]
Nov 28 17:16:15 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4, portal: 172.16.0.220,3260] successful.
Nov 28 17:16:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[94516813-22f0-4b9d-9c06-275e92926c85]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed783a4-2119-4827-817f-af2810878ef1]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:16:15 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:16:15 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:16:15 user nova-compute[75246]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 (non-flash)
Nov 28 17:16:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:16:15 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:16:15 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:16:15 user nova-compute[75246]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 (non-flash)
Nov 28 17:16:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c58fe98-ac22-4b65-9700-50d6485d4e80]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DVWvgXuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-57438471-f76d-4d1b-8cd4-da7cddbfd098 req-b6b95bcc-88ff-4a2a-981f-b6fbb63fc82e service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Received event network-vif-plugged-5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-57438471-f76d-4d1b-8cd4-da7cddbfd098 req-b6b95bcc-88ff-4a2a-981f-b6fbb63fc82e service nova] Acquiring lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-57438471-f76d-4d1b-8cd4-da7cddbfd098 req-b6b95bcc-88ff-4a2a-981f-b6fbb63fc82e service nova] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-57438471-f76d-4d1b-8cd4-da7cddbfd098 req-b6b95bcc-88ff-4a2a-981f-b6fbb63fc82e service nova] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-57438471-f76d-4d1b-8cd4-da7cddbfd098 req-b6b95bcc-88ff-4a2a-981f-b6fbb63fc82e service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] No waiting events found dispatching network-vif-plugged-5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:16:16 user nova-compute[75246]: WARNING nova.compute.manager [req-57438471-f76d-4d1b-8cd4-da7cddbfd098 req-b6b95bcc-88ff-4a2a-981f-b6fbb63fc82e service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Received unexpected event network-vif-plugged-5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 for instance with vm_state building and task_state spawning.
Nov 28 17:16:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received event network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:16:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] No waiting events found dispatching network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:16:16 user nova-compute[75246]: WARNING nova.compute.manager [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received unexpected event network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 for instance with vm_state rescued and task_state unrescuing.
Nov 28 17:16:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Received event network-changed-14ad7288-2755-4a75-b2a9-b8641b0a0bd4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:16:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Refreshing instance network info cache due to event network-changed-14ad7288-2755-4a75-b2a9-b8641b0a0bd4. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:16:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] Acquiring lock "refresh_cache-0fb728b1-9a86-412e-b37e-57a072164534" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:16:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] Acquired lock "refresh_cache-0fb728b1-9a86-412e-b37e-57a072164534" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:16:16 user nova-compute[75246]: DEBUG nova.network.neutron [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Refreshing network info cache for port 14ad7288-2755-4a75-b2a9-b8641b0a0bd4 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:16:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.474s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:16:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] <== connect_volume: return (1476ms) {'type': 'block', 'scsi_wwn': '23030323264303038', 'path': '/dev/sdb'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:16:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030323264303038', 'path': '/dev/sdb'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:16:16 user nova-compute[75246]: DEBUG nova.objects.instance [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lazy-loading 'flavor' on Instance uuid 953ce3ec-438c-437a-90e8-4178529c1a32 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG nova.network.neutron [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Updated VIF entry in instance network info cache for port 14ad7288-2755-4a75-b2a9-b8641b0a0bd4. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG nova.network.neutron [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Updating instance_info_cache with network_info: [{"id": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "address": "fa:16:3e:59:00:36", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ad7288-27", "ovs_interfaceid": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:16:17 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:16:17 user nova-compute[75246]:   <source dev="/dev/sdb"/>
Nov 28 17:16:17 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:16:17 user nova-compute[75246]:   <serial>4e0169b2-12ec-4f65-aba2-edfe7286e1a4</serial>
Nov 28 17:16:17 user nova-compute[75246]: </disk>
Nov 28 17:16:17 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] Releasing lock "refresh_cache-0fb728b1-9a86-412e-b37e-57a072164534" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received event network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] No waiting events found dispatching network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:16:17 user nova-compute[75246]: WARNING nova.compute.manager [req-64191fef-99ca-439a-ad1f-9798de214867 req-f53fcd48-f00e-4a55-a323-5bf65a530c03 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received unexpected event network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 for instance with vm_state rescued and task_state unrescuing.
Nov 28 17:16:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:16:17 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Instance spawned successfully.
Nov 28 17:16:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] No VIF found with MAC fa:16:3e:bc:39:fe, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:16:17 user nova-compute[75246]: INFO nova.compute.manager [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Took 10.05 seconds to spawn the instance on the hypervisor.
Nov 28 17:16:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:16:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-35306faa-0bc2-4062-bf2e-09b1ebf9ea79 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "953ce3ec-438c-437a-90e8-4178529c1a32" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.824s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:17 user nova-compute[75246]: INFO nova.compute.manager [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Took 11.06 seconds to build instance.
Nov 28 17:16:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96223899-13a3-47d9-b273-62a7cce9c741 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.175s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-25d48bb6-8ed2-4926-af15-2034cc8b009a req-1fea8613-3135-461e-9182-e673fb7ac1b0 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received event network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:16:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-25d48bb6-8ed2-4926-af15-2034cc8b009a req-1fea8613-3135-461e-9182-e673fb7ac1b0 service nova] Acquiring lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-25d48bb6-8ed2-4926-af15-2034cc8b009a req-1fea8613-3135-461e-9182-e673fb7ac1b0 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-25d48bb6-8ed2-4926-af15-2034cc8b009a req-1fea8613-3135-461e-9182-e673fb7ac1b0 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-25d48bb6-8ed2-4926-af15-2034cc8b009a req-1fea8613-3135-461e-9182-e673fb7ac1b0 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] No waiting events found dispatching network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:16:18 user nova-compute[75246]: WARNING nova.compute.manager [req-25d48bb6-8ed2-4926-af15-2034cc8b009a req-1fea8613-3135-461e-9182-e673fb7ac1b0 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received unexpected event network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 17:16:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-25d48bb6-8ed2-4926-af15-2034cc8b009a req-1fea8613-3135-461e-9182-e673fb7ac1b0 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received event network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:16:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-25d48bb6-8ed2-4926-af15-2034cc8b009a req-1fea8613-3135-461e-9182-e673fb7ac1b0 service nova] Acquiring lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-25d48bb6-8ed2-4926-af15-2034cc8b009a req-1fea8613-3135-461e-9182-e673fb7ac1b0 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-25d48bb6-8ed2-4926-af15-2034cc8b009a req-1fea8613-3135-461e-9182-e673fb7ac1b0 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-25d48bb6-8ed2-4926-af15-2034cc8b009a req-1fea8613-3135-461e-9182-e673fb7ac1b0 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] No waiting events found dispatching network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:16:18 user nova-compute[75246]: WARNING nova.compute.manager [req-25d48bb6-8ed2-4926-af15-2034cc8b009a req-1fea8613-3135-461e-9182-e673fb7ac1b0 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received unexpected event network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 17:16:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6334c291-675c-4e88-af03-eee49393cca2 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:16:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "953ce3ec-438c-437a-90e8-4178529c1a32" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "953ce3ec-438c-437a-90e8-4178529c1a32" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:19 user nova-compute[75246]: INFO nova.compute.manager [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Detaching volume 4e0169b2-12ec-4f65-aba2-edfe7286e1a4
Nov 28 17:16:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:19 user nova-compute[75246]: DEBUG nova.compute.manager [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:16:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:16:19 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Instance spawned successfully.
Nov 28 17:16:19 user nova-compute[75246]: INFO nova.virt.block_device [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Attempting to driver detach volume 4e0169b2-12ec-4f65-aba2-edfe7286e1a4 from mountpoint /dev/vdb
Nov 28 17:16:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Attempting to detach device vdb from instance 953ce3ec-438c-437a-90e8-4178529c1a32 from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:16:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:16:19 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:16:19 user nova-compute[75246]:   <source dev="/dev/sdb"/>
Nov 28 17:16:19 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:16:19 user nova-compute[75246]:   <serial>4e0169b2-12ec-4f65-aba2-edfe7286e1a4</serial>
Nov 28 17:16:19 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:16:19 user nova-compute[75246]: </disk>
Nov 28 17:16:19 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:16:19 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Successfully detached device vdb from instance 953ce3ec-438c-437a-90e8-4178529c1a32 from the persistent domain config.
Nov 28 17:16:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 953ce3ec-438c-437a-90e8-4178529c1a32 from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:16:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:16:19 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:16:19 user nova-compute[75246]:   <source dev="/dev/sdb"/>
Nov 28 17:16:19 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:16:19 user nova-compute[75246]:   <serial>4e0169b2-12ec-4f65-aba2-edfe7286e1a4</serial>
Nov 28 17:16:19 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:16:19 user nova-compute[75246]: </disk>
Nov 28 17:16:19 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:16:20 user nova-compute[75246]: DEBUG nova.compute.manager [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:16:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-802d1a0d-9692-4f08-9500-0d8503718566 tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.864s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:20 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 953ce3ec-438c-437a-90e8-4178529c1a32 {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:16:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:23 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:16:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:23 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:16:23 user nova-compute[75246]: INFO nova.compute.claims [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Claim successful on node user
Nov 28 17:16:24 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:16:24 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:16:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:24 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:16:24 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:16:24 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:16:24 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:16:24 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:16:24 user nova-compute[75246]: INFO nova.virt.block_device [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Booting with volume snapshot 2a7c803d-7bbe-4099-8a42-7f05db27011c at /dev/vda
Nov 28 17:16:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:24 user nova-compute[75246]: DEBUG nova.policy [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c334f73c5bf1473aadf865c8f032c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0eebdd39c54a74be8d2e0f9842b165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:16:25 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Successfully created port: aa057f8e-b65b-43d3-8d22-5c29f782178b {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:16:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Successfully updated port: aa057f8e-b65b-43d3-8d22-5c29f782178b {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:16:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "refresh_cache-190d2e59-1de9-4b1b-8a0d-cd983f857f7e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:16:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquired lock "refresh_cache-190d2e59-1de9-4b1b-8a0d-cd983f857f7e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:16:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:16:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-03246c6b-2efb-4ce9-a43c-df271721a6b9 req-bbfb1d13-7925-47d1-a6e5-31c0b7fe3f83 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Received event network-changed-aa057f8e-b65b-43d3-8d22-5c29f782178b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:16:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-03246c6b-2efb-4ce9-a43c-df271721a6b9 req-bbfb1d13-7925-47d1-a6e5-31c0b7fe3f83 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Refreshing instance network info cache due to event network-changed-aa057f8e-b65b-43d3-8d22-5c29f782178b. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:16:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-03246c6b-2efb-4ce9-a43c-df271721a6b9 req-bbfb1d13-7925-47d1-a6e5-31c0b7fe3f83 service nova] Acquiring lock "refresh_cache-190d2e59-1de9-4b1b-8a0d-cd983f857f7e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:16:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:16:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Updating instance_info_cache with network_info: [{"id": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "address": "fa:16:3e:8e:05:22", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa057f8e-b6", "ovs_interfaceid": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:16:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Releasing lock "refresh_cache-190d2e59-1de9-4b1b-8a0d-cd983f857f7e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:16:26 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Instance network_info: |[{"id": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "address": "fa:16:3e:8e:05:22", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa057f8e-b6", "ovs_interfaceid": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:16:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-03246c6b-2efb-4ce9-a43c-df271721a6b9 req-bbfb1d13-7925-47d1-a6e5-31c0b7fe3f83 service nova] Acquired lock "refresh_cache-190d2e59-1de9-4b1b-8a0d-cd983f857f7e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:16:26 user nova-compute[75246]: DEBUG nova.network.neutron [req-03246c6b-2efb-4ce9-a43c-df271721a6b9 req-bbfb1d13-7925-47d1-a6e5-31c0b7fe3f83 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Refreshing network info cache for port aa057f8e-b65b-43d3-8d22-5c29f782178b {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:16:27 user nova-compute[75246]: DEBUG nova.network.neutron [req-03246c6b-2efb-4ce9-a43c-df271721a6b9 req-bbfb1d13-7925-47d1-a6e5-31c0b7fe3f83 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Updated VIF entry in instance network info cache for port aa057f8e-b65b-43d3-8d22-5c29f782178b. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:16:27 user nova-compute[75246]: DEBUG nova.network.neutron [req-03246c6b-2efb-4ce9-a43c-df271721a6b9 req-bbfb1d13-7925-47d1-a6e5-31c0b7fe3f83 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Updating instance_info_cache with network_info: [{"id": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "address": "fa:16:3e:8e:05:22", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa057f8e-b6", "ovs_interfaceid": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:16:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-03246c6b-2efb-4ce9-a43c-df271721a6b9 req-bbfb1d13-7925-47d1-a6e5-31c0b7fe3f83 service nova] Releasing lock "refresh_cache-190d2e59-1de9-4b1b-8a0d-cd983f857f7e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:16:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:29 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG os_brick.utils [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64e1643-24b1-45d6-8a16-6497830d8dff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaac1438-8506-4ec2-90b2-67028244dc43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e48e5af-0364-4a77-bff9-56f8164ea2b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e6502d-4e82-4057-ba96-c3df3613e75e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:16:30 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:16:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a89a16-53ac-463f-bc8c-8e0e056b00f4]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG os_brick.utils [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:16:30 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Updating existing volume attachment record: 69efc01a-935b-4048-952d-257cbf4d6820 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:16:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:32 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:16:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:33 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:16:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:16:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:16:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:16:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:37 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:16:37 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:16:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=7347MB free_disk=25.13888168334961GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e1266470-c182-4c0c-a575-4c5043f54745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c94900af-f484-47bf-8627-8aa863334b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 0ed72d2a-ca9b-4b99-b422-86fa93af945c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 90829136-472b-4c45-9607-c28433d05f56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 5c199841-2ce5-4f72-a3f1-6d6d0c746505 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 953ce3ec-438c-437a-90e8-4178529c1a32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 0fb728b1-9a86-412e-b37e-57a072164534 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 9885ad9e-10d1-4b86-afe4-252f543bc2ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 1d3f57d8-3580-4c42-8a4c-cef210e19eb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 190d2e59-1de9-4b1b-8a0d-cd983f857f7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:16:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:16:38 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Creating image(s)
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Did not create local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Ensure instance console log exists: /opt/stack/data/nova/instances/190d2e59-1de9-4b1b-8a0d-cd983f857f7e/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Start _get_guest_xml network_info=[{"id": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "address": "fa:16:3e:8e:05:22", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa057f8e-b6", "ovs_interfaceid": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-28T17:16:17Z,direct_url=<?>,disk_format='qcow2',id=cbd02447-101a-4c8e-921a-e469dd22fc78,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1163362493',owner='fe0eebdd39c54a74be8d2e0f9842b165',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-28T17:16:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '69efc01a-935b-4048-952d-257cbf4d6820', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KNaGWDzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '190d2e59-1de9-4b1b-8a0d-cd983f857f7e', 'attached_at': '', 'detached_at': '', 'volume_id': 'e1a7a123-b95b-4581-af6c-7dee729a318a', 'serial': 'e1a7a123-b95b-4581-af6c-7dee729a318a'}, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:16:38 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:16:38 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-28T17:16:17Z,direct_url=<?>,disk_format='qcow2',id=cbd02447-101a-4c8e-921a-e469dd22fc78,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1163362493',owner='fe0eebdd39c54a74be8d2e0f9842b165',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-28T17:16:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KNaGWDzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:16:38 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:16:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:16:38 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:16:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:16:38 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb96311-ad3d-4f93-8f07-d523861ae602]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:16:38 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bfe328-6d97-4174-a95b-9cfebf5f2ebd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a] added
Nov 28 17:16:38 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f060be-febb-43a6-bb82-bc9382cd4e18]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2826154c-4f00-41c1-a153-37627a6db3a7]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KNaGWDzO {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KNaGWDzO" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[12feb9a9-0d0e-4870-8338-77e1b55c16ff]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KNaGWDzO'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec75f928-c4aa-4c94-b61f-88c9394c19cc]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea310d3b-eeef-4cad-9525-c3ed615d7965]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:16:39 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:16:39 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:16:39 user nova-compute[75246]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 (non-flash)
Nov 28 17:16:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:16:39 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:16:39 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:16:39 user nova-compute[75246]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 (non-flash)
Nov 28 17:16:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[560bdd7f-4a06-46a7-9c05-19058a85ec20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a, portal: 172.16.0.220,3260]
Nov 28 17:16:39 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a, portal: 172.16.0.220,3260] successful.
Nov 28 17:16:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec292240-6e53-4f45-a0bb-df329023b11f]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[178f65f7-92c0-4758-9cd6-5ebef4424bb6]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:16:39 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:16:39 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:16:39 user nova-compute[75246]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 (non-flash)
Nov 28 17:16:39 user nova-compute[75246]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)
Nov 28 17:16:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:16:39 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:16:39 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:16:39 user nova-compute[75246]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 (non-flash)
Nov 28 17:16:39 user nova-compute[75246]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)
Nov 28 17:16:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:16:39 user nova-compute[75246]: INFO nova.compute.manager [None req-0ac22885-512c-4b73-b765-99f633b63192 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Get console output
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1974a957-8bd2-4f98-aba4-e11bb76313ed]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KNaGWDzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:16:39 user nova-compute[75246]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:16:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Updating instance_info_cache with network_info: [{"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-5c199841-2ce5-4f72-a3f1-6d6d0c746505" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26339373334336232', 'path': '/dev/sdf'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339373334336232', 'path': '/dev/sdf'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:16:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-98931639',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-98931639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-98931639',id=37,image_ref='cbd02447-101a-4c8e-921a-e469dd22fc78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIoZdMJ1JbMvQQWSbyYKawFKat7RdC9rtgf9M0YWUoGc+I/HaUK8zJcY84yaB3GE4ECbwkjyO/3LTm+geoPA5izOTdNw6p3KGlwZsDkKo2s9U67150lrLZ+jcKs9E+a+g==',key_name='tempest-keypair-1103969097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe0eebdd39c54a74be8d2e0f9842b165',ramdisk_id='',reservation_id='r-9nozsid7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-389869337',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-389869337',owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:16:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c334f73c5bf1473aadf865c8f032c0cb',uuid=190d2e59-1de9-4b1b-8a0d-cd983f857f7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "address": "fa:16:3e:8e:05:22", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa057f8e-b6", "ovs_interfaceid": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converting VIF {"id": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "address": "fa:16:3e:8e:05:22", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa057f8e-b6", "ovs_interfaceid": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:05:22,bridge_name='br-int',has_traffic_filtering=True,id=aa057f8e-b65b-43d3-8d22-5c29f782178b,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa057f8e-b6') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lazy-loading 'pci_devices' on Instance uuid 190d2e59-1de9-4b1b-8a0d-cd983f857f7e {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:16:40 user nova-compute[75246]:   <uuid>190d2e59-1de9-4b1b-8a0d-cd983f857f7e</uuid>
Nov 28 17:16:40 user nova-compute[75246]:   <name>instance-00000025</name>
Nov 28 17:16:40 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:16:40 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:16:40 user nova-compute[75246]:   <metadata>
Nov 28 17:16:40 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:16:40 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:16:40 user nova-compute[75246]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-98931639</nova:name>
Nov 28 17:16:40 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:16:38</nova:creationTime>
Nov 28 17:16:40 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:16:40 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:16:40 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:16:40 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:16:40 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:16:40 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:16:40 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:16:40 user nova-compute[75246]:       <nova:owner>
Nov 28 17:16:40 user nova-compute[75246]:         <nova:user uuid="c334f73c5bf1473aadf865c8f032c0cb">tempest-TestVolumeBootPattern-389869337-project-member</nova:user>
Nov 28 17:16:40 user nova-compute[75246]:         <nova:project uuid="fe0eebdd39c54a74be8d2e0f9842b165">tempest-TestVolumeBootPattern-389869337</nova:project>
Nov 28 17:16:40 user nova-compute[75246]:       </nova:owner>
Nov 28 17:16:40 user nova-compute[75246]:       <nova:root type="image" uuid="cbd02447-101a-4c8e-921a-e469dd22fc78"/>
Nov 28 17:16:40 user nova-compute[75246]:       <nova:ports>
Nov 28 17:16:40 user nova-compute[75246]:         <nova:port uuid="aa057f8e-b65b-43d3-8d22-5c29f782178b">
Nov 28 17:16:40 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 17:16:40 user nova-compute[75246]:         </nova:port>
Nov 28 17:16:40 user nova-compute[75246]:       </nova:ports>
Nov 28 17:16:40 user nova-compute[75246]:     </nova:instance>
Nov 28 17:16:40 user nova-compute[75246]:   </metadata>
Nov 28 17:16:40 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:16:40 user nova-compute[75246]:     <system>
Nov 28 17:16:40 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:16:40 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:16:40 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:16:40 user nova-compute[75246]:       <entry name="serial">190d2e59-1de9-4b1b-8a0d-cd983f857f7e</entry>
Nov 28 17:16:40 user nova-compute[75246]:       <entry name="uuid">190d2e59-1de9-4b1b-8a0d-cd983f857f7e</entry>
Nov 28 17:16:40 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:16:40 user nova-compute[75246]:     </system>
Nov 28 17:16:40 user nova-compute[75246]:   </sysinfo>
Nov 28 17:16:40 user nova-compute[75246]:   <os>
Nov 28 17:16:40 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:16:40 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:16:40 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:16:40 user nova-compute[75246]:   </os>
Nov 28 17:16:40 user nova-compute[75246]:   <features>
Nov 28 17:16:40 user nova-compute[75246]:     <acpi/>
Nov 28 17:16:40 user nova-compute[75246]:     <apic/>
Nov 28 17:16:40 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:16:40 user nova-compute[75246]:   </features>
Nov 28 17:16:40 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:16:40 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:16:40 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:16:40 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:16:40 user nova-compute[75246]:   </clock>
Nov 28 17:16:40 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:16:40 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:16:40 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:16:40 user nova-compute[75246]:   </cpu>
Nov 28 17:16:40 user nova-compute[75246]:   <devices>
Nov 28 17:16:40 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:16:40 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:16:40 user nova-compute[75246]:       <source dev="/dev/sdf"/>
Nov 28 17:16:40 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:16:40 user nova-compute[75246]:       <serial>e1a7a123-b95b-4581-af6c-7dee729a318a</serial>
Nov 28 17:16:40 user nova-compute[75246]:     </disk>
Nov 28 17:16:40 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:16:40 user nova-compute[75246]:       <mac address="fa:16:3e:8e:05:22"/>
Nov 28 17:16:40 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:16:40 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:16:40 user nova-compute[75246]:       <target dev="tapaa057f8e-b6"/>
Nov 28 17:16:40 user nova-compute[75246]:     </interface>
Nov 28 17:16:40 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:16:40 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/190d2e59-1de9-4b1b-8a0d-cd983f857f7e/console.log" append="off"/>
Nov 28 17:16:40 user nova-compute[75246]:     </serial>
Nov 28 17:16:40 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:16:40 user nova-compute[75246]:     <video>
Nov 28 17:16:40 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:16:40 user nova-compute[75246]:     </video>
Nov 28 17:16:40 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:16:40 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:16:40 user nova-compute[75246]:     </rng>
Nov 28 17:16:40 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:16:40 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:16:40 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:16:40 user nova-compute[75246]:     </memballoon>
Nov 28 17:16:40 user nova-compute[75246]:   </devices>
Nov 28 17:16:40 user nova-compute[75246]: </domain>
Nov 28 17:16:40 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:16:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-98931639',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-98931639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-98931639',id=37,image_ref='cbd02447-101a-4c8e-921a-e469dd22fc78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIoZdMJ1JbMvQQWSbyYKawFKat7RdC9rtgf9M0YWUoGc+I/HaUK8zJcY84yaB3GE4ECbwkjyO/3LTm+geoPA5izOTdNw6p3KGlwZsDkKo2s9U67150lrLZ+jcKs9E+a+g==',key_name='tempest-keypair-1103969097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe0eebdd39c54a74be8d2e0f9842b165',ramdisk_id='',reservation_id='r-9nozsid7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-389869337',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-389869337',owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:16:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c334f73c5bf1473aadf865c8f032c0cb',uuid=190d2e59-1de9-4b1b-8a0d-cd983f857f7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "address": "fa:16:3e:8e:05:22", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa057f8e-b6", "ovs_interfaceid": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converting VIF {"id": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "address": "fa:16:3e:8e:05:22", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa057f8e-b6", "ovs_interfaceid": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:05:22,bridge_name='br-int',has_traffic_filtering=True,id=aa057f8e-b65b-43d3-8d22-5c29f782178b,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa057f8e-b6') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_vif [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:05:22,bridge_name='br-int',has_traffic_filtering=True,id=aa057f8e-b65b-43d3-8d22-5c29f782178b,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa057f8e-b6') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7052ed2d-840d-502d-a1b9-037227e314da', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa057f8e-b6, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa057f8e-b6, col_values=(('qos', UUID('52b898d0-ee47-467e-a2f0-f2ca4106d868')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa057f8e-b6, col_values=(('external_ids', {'iface-id': 'aa057f8e-b65b-43d3-8d22-5c29f782178b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:05:22', 'vm-uuid': '190d2e59-1de9-4b1b-8a0d-cd983f857f7e'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:40 user nova-compute[75246]: INFO os_vif [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:05:22,bridge_name='br-int',has_traffic_filtering=True,id=aa057f8e-b65b-43d3-8d22-5c29f782178b,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa057f8e-b6')
Nov 28 17:16:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] No VIF found with MAC fa:16:3e:8e:05:22, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:16:40 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 953ce3ec-438c-437a-90e8-4178529c1a32 is timed out.
Nov 28 17:16:40 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Successfully detached device vdb from instance 953ce3ec-438c-437a-90e8-4178529c1a32 from the live domain config.
Nov 28 17:16:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DVWvgXuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:16:40 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce40befa-ce5d-4193-9a17-c337455748be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:16:40 user nova-compute[75246]: No targets found.
Nov 28 17:16:40 user nova-compute[75246]: iSNS:
Nov 28 17:16:40 user nova-compute[75246]: No targets found.
Nov 28 17:16:40 user nova-compute[75246]: STATIC:
Nov 28 17:16:40 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e
Nov 28 17:16:40 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:16:40 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:16:40 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a
Nov 28 17:16:40 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:16:40 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:16:40 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4
Nov 28 17:16:40 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:16:40 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:16:40 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158
Nov 28 17:16:40 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:16:40 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:16:40 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3
Nov 28 17:16:40 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:16:40 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:16:40 user nova-compute[75246]: FIRMWARE:
Nov 28 17:16:40 user nova-compute[75246]: No targets found.
Nov 28 17:16:40 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:16:40 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:16:40 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f175b8d0-fc88-4565-9cee-664352b38789]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5e3e0a-136a-4911-baef-38c1bf1bc632]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:16:40 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:16:40 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:16:40 user nova-compute[75246]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 (non-flash)
Nov 28 17:16:40 user nova-compute[75246]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)
Nov 28 17:16:40 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:16:40 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:16:40 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:16:40 user nova-compute[75246]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 (non-flash)
Nov 28 17:16:40 user nova-compute[75246]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)
Nov 28 17:16:40 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d85293f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4'): ({'sdb'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Removing single pathed devices sdb {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9077ea-e275-4f0b-bef2-212865775f18]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc203f4-f634-4c36-9b86-352f868f84ce]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Flushing IO for device /dev/sdb {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8123dcb-b14a-4748-8713-de2c18eb52c8]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[da71074b-5478-49f8-95bc-c802292e0b7c]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[97519a84-6f54-4a04-ba51-ef72067bf883]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55aed80-4945-4f5a-929b-d018226bd673]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4, portal: 172.16.0.220,3260]
Nov 28 17:16:40 user nova-compute[75246]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4, portal: 172.16.0.220,3260] successful.
Nov 28 17:16:40 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e0169b2-12ec-4f65-aba2-edfe7286e1a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[927ae28d-294e-404e-ab42-113543b3d44f]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] <== disconnect_volume: return (349ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:16:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:16:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:41 user nova-compute[75246]: DEBUG nova.objects.instance [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lazy-loading 'flavor' on Instance uuid 953ce3ec-438c-437a-90e8-4178529c1a32 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:16:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8ec40145-0298-4052-a11e-25160e9638bd tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "953ce3ec-438c-437a-90e8-4178529c1a32" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.859s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:41 user nova-compute[75246]: DEBUG nova.compute.manager [req-fad3f6a9-bafc-4547-b9f6-366e3a29157d req-f7fd7fa2-d7d1-4182-9c06-5305840ba620 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Received event network-vif-plugged-aa057f8e-b65b-43d3-8d22-5c29f782178b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:16:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fad3f6a9-bafc-4547-b9f6-366e3a29157d req-f7fd7fa2-d7d1-4182-9c06-5305840ba620 service nova] Acquiring lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fad3f6a9-bafc-4547-b9f6-366e3a29157d req-f7fd7fa2-d7d1-4182-9c06-5305840ba620 service nova] Lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fad3f6a9-bafc-4547-b9f6-366e3a29157d req-f7fd7fa2-d7d1-4182-9c06-5305840ba620 service nova] Lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:41 user nova-compute[75246]: DEBUG nova.compute.manager [req-fad3f6a9-bafc-4547-b9f6-366e3a29157d req-f7fd7fa2-d7d1-4182-9c06-5305840ba620 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] No waiting events found dispatching network-vif-plugged-aa057f8e-b65b-43d3-8d22-5c29f782178b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:16:41 user nova-compute[75246]: WARNING nova.compute.manager [req-fad3f6a9-bafc-4547-b9f6-366e3a29157d req-f7fd7fa2-d7d1-4182-9c06-5305840ba620 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Received unexpected event network-vif-plugged-aa057f8e-b65b-43d3-8d22-5c29f782178b for instance with vm_state building and task_state spawning.
Nov 28 17:16:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:43 user nova-compute[75246]: DEBUG nova.compute.manager [req-cd2fe091-02c6-46ec-a920-e4d4a80017f9 req-da28b763-6050-4883-8164-6f3060836a3a service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Received event network-vif-plugged-aa057f8e-b65b-43d3-8d22-5c29f782178b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:16:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cd2fe091-02c6-46ec-a920-e4d4a80017f9 req-da28b763-6050-4883-8164-6f3060836a3a service nova] Acquiring lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cd2fe091-02c6-46ec-a920-e4d4a80017f9 req-da28b763-6050-4883-8164-6f3060836a3a service nova] Lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cd2fe091-02c6-46ec-a920-e4d4a80017f9 req-da28b763-6050-4883-8164-6f3060836a3a service nova] Lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:43 user nova-compute[75246]: DEBUG nova.compute.manager [req-cd2fe091-02c6-46ec-a920-e4d4a80017f9 req-da28b763-6050-4883-8164-6f3060836a3a service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] No waiting events found dispatching network-vif-plugged-aa057f8e-b65b-43d3-8d22-5c29f782178b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:16:43 user nova-compute[75246]: WARNING nova.compute.manager [req-cd2fe091-02c6-46ec-a920-e4d4a80017f9 req-da28b763-6050-4883-8164-6f3060836a3a service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Received unexpected event network-vif-plugged-aa057f8e-b65b-43d3-8d22-5c29f782178b for instance with vm_state building and task_state spawning.
Nov 28 17:16:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:16:44 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Instance spawned successfully.
Nov 28 17:16:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:16:44 user nova-compute[75246]: INFO nova.compute.manager [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 28 17:16:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:16:44 user nova-compute[75246]: INFO nova.compute.manager [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Took 20.50 seconds to build instance.
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6a9de845-b382-4366-b1c4-c9f6a6116696 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.617s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid e1266470-c182-4c0c-a575-4c5043f54745 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid c94900af-f484-47bf-8627-8aa863334b63 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 0ed72d2a-ca9b-4b99-b422-86fa93af945c {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 5c199841-2ce5-4f72-a3f1-6d6d0c746505 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 90829136-472b-4c45-9607-c28433d05f56 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 1d3f57d8-3580-4c42-8a4c-cef210e19eb4 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 894da7a3-9c67-417e-b0f4-306335a533e6 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 953ce3ec-438c-437a-90e8-4178529c1a32 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 0fb728b1-9a86-412e-b37e-57a072164534 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 9885ad9e-10d1-4b86-afe4-252f543bc2ec {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 190d2e59-1de9-4b1b-8a0d-cd983f857f7e {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "e1266470-c182-4c0c-a575-4c5043f54745" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "e1266470-c182-4c0c-a575-4c5043f54745" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "c94900af-f484-47bf-8627-8aa863334b63" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "c94900af-f484-47bf-8627-8aa863334b63" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "90829136-472b-4c45-9607-c28433d05f56" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "894da7a3-9c67-417e-b0f4-306335a533e6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "894da7a3-9c67-417e-b0f4-306335a533e6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "953ce3ec-438c-437a-90e8-4178529c1a32" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "953ce3ec-438c-437a-90e8-4178529c1a32" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "0fb728b1-9a86-412e-b37e-57a072164534" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "0fb728b1-9a86-412e-b37e-57a072164534" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "c94900af-f484-47bf-8627-8aa863334b63" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "e1266470-c182-4c0c-a575-4c5043f54745" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "90829136-472b-4c45-9607-c28433d05f56" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "894da7a3-9c67-417e-b0f4-306335a533e6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "953ce3ec-438c-437a-90e8-4178529c1a32" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "0fb728b1-9a86-412e-b37e-57a072164534" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:51 user nova-compute[75246]: DEBUG nova.compute.manager [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:16:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:16:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:16:51 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:16:51 user nova-compute[75246]: INFO nova.compute.claims [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Claim successful on node user
Nov 28 17:16:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:51 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:16:51 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:16:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:16:51 user nova-compute[75246]: DEBUG nova.compute.manager [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:16:52 user nova-compute[75246]: DEBUG nova.compute.manager [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:16:52 user nova-compute[75246]: DEBUG nova.network.neutron [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:16:52 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:16:52 user nova-compute[75246]: DEBUG nova.compute.manager [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:16:52 user nova-compute[75246]: INFO nova.virt.block_device [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Booting with blank volume at /dev/vda
Nov 28 17:16:52 user nova-compute[75246]: DEBUG nova.policy [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af8b6c3f092547dbbf3debe96c594590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec5bcef3e2441fba30b593c13d5516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:16:52 user nova-compute[75246]: DEBUG nova.network.neutron [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Successfully created port: a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:16:53 user nova-compute[75246]: DEBUG nova.network.neutron [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Successfully updated port: a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:16:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:16:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquired lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:16:53 user nova-compute[75246]: DEBUG nova.network.neutron [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:16:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c15d1e4-3b84-4a58-99a4-9cbd88ef4e6c req-ae29a2f9-1170-4601-8d2f-066e6316c7ca service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-changed-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:16:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c15d1e4-3b84-4a58-99a4-9cbd88ef4e6c req-ae29a2f9-1170-4601-8d2f-066e6316c7ca service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Refreshing instance network info cache due to event network-changed-a311cb50-be83-4bf0-b889-d02170d667d6. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:16:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c15d1e4-3b84-4a58-99a4-9cbd88ef4e6c req-ae29a2f9-1170-4601-8d2f-066e6316c7ca service nova] Acquiring lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:16:53 user nova-compute[75246]: DEBUG nova.network.neutron [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:16:54 user nova-compute[75246]: DEBUG nova.network.neutron [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Updating instance_info_cache with network_info: [{"id": "a311cb50-be83-4bf0-b889-d02170d667d6", "address": "fa:16:3e:65:bd:fb", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa311cb50-be", "ovs_interfaceid": "a311cb50-be83-4bf0-b889-d02170d667d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:16:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Releasing lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:16:54 user nova-compute[75246]: DEBUG nova.compute.manager [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Instance network_info: |[{"id": "a311cb50-be83-4bf0-b889-d02170d667d6", "address": "fa:16:3e:65:bd:fb", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa311cb50-be", "ovs_interfaceid": "a311cb50-be83-4bf0-b889-d02170d667d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:16:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c15d1e4-3b84-4a58-99a4-9cbd88ef4e6c req-ae29a2f9-1170-4601-8d2f-066e6316c7ca service nova] Acquired lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:16:54 user nova-compute[75246]: DEBUG nova.network.neutron [req-5c15d1e4-3b84-4a58-99a4-9cbd88ef4e6c req-ae29a2f9-1170-4601-8d2f-066e6316c7ca service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Refreshing network info cache for port a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:16:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:54 user nova-compute[75246]: DEBUG nova.network.neutron [req-5c15d1e4-3b84-4a58-99a4-9cbd88ef4e6c req-ae29a2f9-1170-4601-8d2f-066e6316c7ca service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Updated VIF entry in instance network info cache for port a311cb50-be83-4bf0-b889-d02170d667d6. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:16:54 user nova-compute[75246]: DEBUG nova.network.neutron [req-5c15d1e4-3b84-4a58-99a4-9cbd88ef4e6c req-ae29a2f9-1170-4601-8d2f-066e6316c7ca service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Updating instance_info_cache with network_info: [{"id": "a311cb50-be83-4bf0-b889-d02170d667d6", "address": "fa:16:3e:65:bd:fb", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa311cb50-be", "ovs_interfaceid": "a311cb50-be83-4bf0-b889-d02170d667d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:16:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c15d1e4-3b84-4a58-99a4-9cbd88ef4e6c req-ae29a2f9-1170-4601-8d2f-066e6316c7ca service nova] Releasing lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:16:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG os_brick.utils [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bfe614-2dd7-413c-b126-245645d70922]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd31bf45-8947-418e-a1ae-fc6e24c4c2a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f873297-38e7-4952-b1aa-c272e94111a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f2ddb7-8a21-4d30-86e2-0028f4f157f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:16:57 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:16:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[db31af43-4c83-49de-bccf-efe0fab0faeb]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG os_brick.utils [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:16:57 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Updating existing volume attachment record: 45e38b49-ea00-403b-9dea-59caf2543174 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:16:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.compute.manager [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:17:05 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Creating image(s)
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Did not create local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Ensure instance console log exists: /opt/stack/data/nova/instances/a796152e-e8df-41bf-a5ea-ae94d4fa8b41/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Start _get_guest_xml network_info=[{"id": "a311cb50-be83-4bf0-b889-d02170d667d6", "address": "fa:16:3e:65:bd:fb", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa311cb50-be", "ovs_interfaceid": "a311cb50-be83-4bf0-b889-d02170d667d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '45e38b49-ea00-403b-9dea-59caf2543174', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ueoZRldz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a796152e-e8df-41bf-a5ea-ae94d4fa8b41', 'attached_at': '', 'detached_at': '', 'volume_id': '0e71659f-575e-45b1-81fb-67856b67b435', 'serial': '0e71659f-575e-45b1-81fb-67856b67b435'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:17:05 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:17:05 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ueoZRldz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:17:05 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:17:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:17:05 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:17:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:17:05 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:17:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e397c618-e1fe-4bde-9184-587f4dd1a54e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:17:05 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[396c206d-0c16-4dac-8f81-63bbe10ef937]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435] added
Nov 28 17:17:05 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98f9f42-95a5-4b05-943a-70cfe1c605b2]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:17:05 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb259d8-aa82-4ad1-9e04-326a2ad8fc6c]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ueoZRldz {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ueoZRldz" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[145109a7-a1ed-4410-bb8e-a4a85b60d254]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ueoZRldz'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[937db8f4-5734-418d-a079-47cd1bccd144]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb018a58-655d-4d85-b913-500cffc401f8]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:17:06 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:17:06 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:17:06 user nova-compute[75246]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)
Nov 28 17:17:06 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:17:06 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:17:06 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:17:06 user nova-compute[75246]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)
Nov 28 17:17:06 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0087dd2-d294-4e30-83ac-428c6eecc910]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435, portal: 172.16.0.220,3260]
Nov 28 17:17:06 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435, portal: 172.16.0.220,3260] successful.
Nov 28 17:17:06 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6727532-0255-49cd-a6d7-a2932bff5a9e]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccb9bab-5512-441e-9821-68bb2a6bb506]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:17:06 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:17:06 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:17:06 user nova-compute[75246]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)
Nov 28 17:17:06 user nova-compute[75246]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:17:06 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:17:06 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:17:06 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:17:06 user nova-compute[75246]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)
Nov 28 17:17:06 user nova-compute[75246]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:17:06 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[433d594d-217d-4fdf-87ff-1a04fd60ebaa]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ueoZRldz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:17:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26438356536323532', 'path': '/dev/sdb'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438356536323532', 'path': '/dev/sdb'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:16:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1508108904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1508108904',id=38,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faec5bcef3e2441fba30b593c13d5516',ramdisk_id='',reservation_id='r-39xyyd05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-506006079',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:16:52Z,user_data=None,user_id='af8b6c3f092547dbbf3debe96c594590',uuid=a796152e-e8df-41bf-a5ea-ae94d4fa8b41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a311cb50-be83-4bf0-b889-d02170d667d6", "address": "fa:16:3e:65:bd:fb", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa311cb50-be", "ovs_interfaceid": "a311cb50-be83-4bf0-b889-d02170d667d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converting VIF {"id": "a311cb50-be83-4bf0-b889-d02170d667d6", "address": "fa:16:3e:65:bd:fb", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa311cb50-be", "ovs_interfaceid": "a311cb50-be83-4bf0-b889-d02170d667d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:bd:fb,bridge_name='br-int',has_traffic_filtering=True,id=a311cb50-be83-4bf0-b889-d02170d667d6,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa311cb50-be') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG nova.objects.instance [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'pci_devices' on Instance uuid a796152e-e8df-41bf-a5ea-ae94d4fa8b41 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:17:07 user nova-compute[75246]:   <uuid>a796152e-e8df-41bf-a5ea-ae94d4fa8b41</uuid>
Nov 28 17:17:07 user nova-compute[75246]:   <name>instance-00000026</name>
Nov 28 17:17:07 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:17:07 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:17:07 user nova-compute[75246]:   <metadata>
Nov 28 17:17:07 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:17:07 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:17:07 user nova-compute[75246]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1508108904</nova:name>
Nov 28 17:17:07 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:17:05</nova:creationTime>
Nov 28 17:17:07 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:17:07 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:17:07 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:17:07 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:17:07 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:17:07 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:17:07 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:17:07 user nova-compute[75246]:       <nova:owner>
Nov 28 17:17:07 user nova-compute[75246]:         <nova:user uuid="af8b6c3f092547dbbf3debe96c594590">tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member</nova:user>
Nov 28 17:17:07 user nova-compute[75246]:         <nova:project uuid="faec5bcef3e2441fba30b593c13d5516">tempest-ServerBootFromVolumeStableRescueTest-506006079</nova:project>
Nov 28 17:17:07 user nova-compute[75246]:       </nova:owner>
Nov 28 17:17:07 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:17:07 user nova-compute[75246]:       <nova:ports>
Nov 28 17:17:07 user nova-compute[75246]:         <nova:port uuid="a311cb50-be83-4bf0-b889-d02170d667d6">
Nov 28 17:17:07 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 17:17:07 user nova-compute[75246]:         </nova:port>
Nov 28 17:17:07 user nova-compute[75246]:       </nova:ports>
Nov 28 17:17:07 user nova-compute[75246]:     </nova:instance>
Nov 28 17:17:07 user nova-compute[75246]:   </metadata>
Nov 28 17:17:07 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:17:07 user nova-compute[75246]:     <system>
Nov 28 17:17:07 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:17:07 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:17:07 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:17:07 user nova-compute[75246]:       <entry name="serial">a796152e-e8df-41bf-a5ea-ae94d4fa8b41</entry>
Nov 28 17:17:07 user nova-compute[75246]:       <entry name="uuid">a796152e-e8df-41bf-a5ea-ae94d4fa8b41</entry>
Nov 28 17:17:07 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:17:07 user nova-compute[75246]:     </system>
Nov 28 17:17:07 user nova-compute[75246]:   </sysinfo>
Nov 28 17:17:07 user nova-compute[75246]:   <os>
Nov 28 17:17:07 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:17:07 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:17:07 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:17:07 user nova-compute[75246]:   </os>
Nov 28 17:17:07 user nova-compute[75246]:   <features>
Nov 28 17:17:07 user nova-compute[75246]:     <acpi/>
Nov 28 17:17:07 user nova-compute[75246]:     <apic/>
Nov 28 17:17:07 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:17:07 user nova-compute[75246]:   </features>
Nov 28 17:17:07 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:17:07 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:17:07 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:17:07 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:17:07 user nova-compute[75246]:   </clock>
Nov 28 17:17:07 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:17:07 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:17:07 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:17:07 user nova-compute[75246]:   </cpu>
Nov 28 17:17:07 user nova-compute[75246]:   <devices>
Nov 28 17:17:07 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:17:07 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:17:07 user nova-compute[75246]:       <source dev="/dev/sdb"/>
Nov 28 17:17:07 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:17:07 user nova-compute[75246]:       <serial>0e71659f-575e-45b1-81fb-67856b67b435</serial>
Nov 28 17:17:07 user nova-compute[75246]:     </disk>
Nov 28 17:17:07 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:17:07 user nova-compute[75246]:       <mac address="fa:16:3e:65:bd:fb"/>
Nov 28 17:17:07 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:17:07 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:17:07 user nova-compute[75246]:       <target dev="tapa311cb50-be"/>
Nov 28 17:17:07 user nova-compute[75246]:     </interface>
Nov 28 17:17:07 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:17:07 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/a796152e-e8df-41bf-a5ea-ae94d4fa8b41/console.log" append="off"/>
Nov 28 17:17:07 user nova-compute[75246]:     </serial>
Nov 28 17:17:07 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:17:07 user nova-compute[75246]:     <video>
Nov 28 17:17:07 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:17:07 user nova-compute[75246]:     </video>
Nov 28 17:17:07 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:17:07 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:17:07 user nova-compute[75246]:     </rng>
Nov 28 17:17:07 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:17:07 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:17:07 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:17:07 user nova-compute[75246]:     </memballoon>
Nov 28 17:17:07 user nova-compute[75246]:   </devices>
Nov 28 17:17:07 user nova-compute[75246]: </domain>
Nov 28 17:17:07 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:16:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1508108904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1508108904',id=38,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faec5bcef3e2441fba30b593c13d5516',ramdisk_id='',reservation_id='r-39xyyd05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-506006079',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:16:52Z,user_data=None,user_id='af8b6c3f092547dbbf3debe96c594590',uuid=a796152e-e8df-41bf-a5ea-ae94d4fa8b41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a311cb50-be83-4bf0-b889-d02170d667d6", "address": "fa:16:3e:65:bd:fb", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa311cb50-be", "ovs_interfaceid": "a311cb50-be83-4bf0-b889-d02170d667d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converting VIF {"id": "a311cb50-be83-4bf0-b889-d02170d667d6", "address": "fa:16:3e:65:bd:fb", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa311cb50-be", "ovs_interfaceid": "a311cb50-be83-4bf0-b889-d02170d667d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:bd:fb,bridge_name='br-int',has_traffic_filtering=True,id=a311cb50-be83-4bf0-b889-d02170d667d6,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa311cb50-be') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG os_vif [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:bd:fb,bridge_name='br-int',has_traffic_filtering=True,id=a311cb50-be83-4bf0-b889-d02170d667d6,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa311cb50-be') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7b0b210-c3bf-5ea0-9eb6-769b2c99e3da', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa311cb50-be, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa311cb50-be, col_values=(('qos', UUID('4d90b41b-3523-4be3-a196-6f676d35d37b')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa311cb50-be, col_values=(('external_ids', {'iface-id': 'a311cb50-be83-4bf0-b889-d02170d667d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:bd:fb', 'vm-uuid': 'a796152e-e8df-41bf-a5ea-ae94d4fa8b41'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:07 user nova-compute[75246]: INFO os_vif [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:bd:fb,bridge_name='br-int',has_traffic_filtering=True,id=a311cb50-be83-4bf0-b889-d02170d667d6,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa311cb50-be')
Nov 28 17:17:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:17:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] No VIF found with MAC fa:16:3e:65:bd:fb, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:17:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:17:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:08 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:17:08 user nova-compute[75246]: INFO nova.compute.claims [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Claim successful on node user
Nov 28 17:17:08 user nova-compute[75246]: DEBUG nova.compute.manager [req-4871d943-22a6-43fe-b72a-f314fd564eec req-1c68b324-94ec-47c9-8aef-fd722400510e service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4871d943-22a6-43fe-b72a-f314fd564eec req-1c68b324-94ec-47c9-8aef-fd722400510e service nova] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4871d943-22a6-43fe-b72a-f314fd564eec req-1c68b324-94ec-47c9-8aef-fd722400510e service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4871d943-22a6-43fe-b72a-f314fd564eec req-1c68b324-94ec-47c9-8aef-fd722400510e service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:08 user nova-compute[75246]: DEBUG nova.compute.manager [req-4871d943-22a6-43fe-b72a-f314fd564eec req-1c68b324-94ec-47c9-8aef-fd722400510e service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] No waiting events found dispatching network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:17:08 user nova-compute[75246]: WARNING nova.compute.manager [req-4871d943-22a6-43fe-b72a-f314fd564eec req-1c68b324-94ec-47c9-8aef-fd722400510e service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received unexpected event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 for instance with vm_state building and task_state spawning.
Nov 28 17:17:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:17:09 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:17:09 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG nova.policy [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99a104ac894b42fba228f37739da28b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd096414f864a1cb0d72e97161ee28b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:17:09 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Creating image(s)
Nov 28 17:17:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "/opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "/opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "/opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.177s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.189s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk 1073741824" returned: 0 in 0.055s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Cannot resize image /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Ensure instance console log exists: /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Successfully created port: f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-c55e05c5-52ff-4772-805e-d696a1848b02 req-72e71edf-3f83-41d0-a212-97cbd6cd9efb service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Received event network-changed-4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-c55e05c5-52ff-4772-805e-d696a1848b02 req-72e71edf-3f83-41d0-a212-97cbd6cd9efb service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Refreshing instance network info cache due to event network-changed-4cd5853c-099d-4ec5-91b6-475f7c703aeb. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c55e05c5-52ff-4772-805e-d696a1848b02 req-72e71edf-3f83-41d0-a212-97cbd6cd9efb service nova] Acquiring lock "refresh_cache-953ce3ec-438c-437a-90e8-4178529c1a32" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c55e05c5-52ff-4772-805e-d696a1848b02 req-72e71edf-3f83-41d0-a212-97cbd6cd9efb service nova] Acquired lock "refresh_cache-953ce3ec-438c-437a-90e8-4178529c1a32" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG nova.network.neutron [req-c55e05c5-52ff-4772-805e-d696a1848b02 req-72e71edf-3f83-41d0-a212-97cbd6cd9efb service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Refreshing network info cache for port 4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-9ce16177-53c5-4ab6-b5cf-cde5f324b3fe req-453f4a29-c14f-4f98-a192-c0f98120f9ec service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9ce16177-53c5-4ab6-b5cf-cde5f324b3fe req-453f4a29-c14f-4f98-a192-c0f98120f9ec service nova] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9ce16177-53c5-4ab6-b5cf-cde5f324b3fe req-453f4a29-c14f-4f98-a192-c0f98120f9ec service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9ce16177-53c5-4ab6-b5cf-cde5f324b3fe req-453f4a29-c14f-4f98-a192-c0f98120f9ec service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-9ce16177-53c5-4ab6-b5cf-cde5f324b3fe req-453f4a29-c14f-4f98-a192-c0f98120f9ec service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] No waiting events found dispatching network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:17:10 user nova-compute[75246]: WARNING nova.compute.manager [req-9ce16177-53c5-4ab6-b5cf-cde5f324b3fe req-453f4a29-c14f-4f98-a192-c0f98120f9ec service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received unexpected event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 for instance with vm_state building and task_state spawning.
Nov 28 17:17:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "953ce3ec-438c-437a-90e8-4178529c1a32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "953ce3ec-438c-437a-90e8-4178529c1a32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:10 user nova-compute[75246]: INFO nova.compute.manager [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Terminating instance
Nov 28 17:17:10 user nova-compute[75246]: DEBUG nova.compute.manager [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG nova.compute.manager [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:17:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:17:10 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Instance spawned successfully.
Nov 28 17:17:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:17:11 user nova-compute[75246]: INFO nova.compute.manager [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.compute.manager [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-459b9fca-a4ae-4095-854b-cf282c108e2c req-831007dd-5cbe-4f2c-a9a4-944ce11177be service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Received event network-vif-unplugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-459b9fca-a4ae-4095-854b-cf282c108e2c req-831007dd-5cbe-4f2c-a9a4-944ce11177be service nova] Acquiring lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-459b9fca-a4ae-4095-854b-cf282c108e2c req-831007dd-5cbe-4f2c-a9a4-944ce11177be service nova] Lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-459b9fca-a4ae-4095-854b-cf282c108e2c req-831007dd-5cbe-4f2c-a9a4-944ce11177be service nova] Lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-459b9fca-a4ae-4095-854b-cf282c108e2c req-831007dd-5cbe-4f2c-a9a4-944ce11177be service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] No waiting events found dispatching network-vif-unplugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-459b9fca-a4ae-4095-854b-cf282c108e2c req-831007dd-5cbe-4f2c-a9a4-944ce11177be service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Received event network-vif-unplugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:17:11 user nova-compute[75246]: INFO nova.compute.manager [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Took 19.91 seconds to build instance.
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-666893da-108a-4866-9630-9ff8db77caf2 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.034s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Successfully updated port: f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "refresh_cache-5175a016-3237-4e79-bc77-4b72e5402695" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquired lock "refresh_cache-5175a016-3237-4e79-bc77-4b72e5402695" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:11 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Instance destroyed successfully.
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.objects.instance [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lazy-loading 'resources' on Instance uuid 953ce3ec-438c-437a-90e8-4178529c1a32 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:14:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-675220610',display_name='tempest-TestStampPattern-server-675220610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-675220610',id=34,image_ref='0a52cb9e-4028-4c58-bd6f-8a79afe03f65',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnj4hviUDvSX6hriv+L/QlZItoNaDMhnx3xQZWny569+OHLO66OwUH6l0a05JpEbHna9f+mLN7Ii3Ir+MVNbuGgRCX/YzUtBIJTlrG7CTESk7NAniXb5lC2lIImNVOo0A==',key_name='tempest-TestStampPattern-150119392',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:14:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84705237374f40e287bdc39098936027',ramdisk_id='',reservation_id='r-auigz48y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0ed72d2a-ca9b-4b99-b422-86fa93af945c',image_min_disk='1',image_min_ram='0',image_owner_id='84705237374f40e287bdc39098936027',image_owner_project_name='tempest-TestStampPattern-1581372233',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1581372233-project-member',image_user_id='6897bba4a31544f78a2f1911294deb97',owner_project_name='tempest-TestStampPattern-1581372233',owner_user_name='tempest-TestStampPattern-1581372233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:14:23Z,user_data=None,user_id='6897bba4a31544f78a2f1911294deb97',uuid=953ce3ec-438c-437a-90e8-4178529c1a32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "address": "fa:16:3e:bc:39:fe", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5853c-09", "ovs_interfaceid": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Converting VIF {"id": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "address": "fa:16:3e:bc:39:fe", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5853c-09", "ovs_interfaceid": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:39:fe,bridge_name='br-int',has_traffic_filtering=True,id=4cd5853c-099d-4ec5-91b6-475f7c703aeb,network=Network(ce13947d-26bc-4814-afed-38b0697cb13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5853c-09') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG os_vif [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:39:fe,bridge_name='br-int',has_traffic_filtering=True,id=4cd5853c-099d-4ec5-91b6-475f7c703aeb,network=Network(ce13947d-26bc-4814-afed-38b0697cb13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5853c-09') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cd5853c-09, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e375afdb-9e92-4070-ae2a-84f4d39cd068) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:17:11 user nova-compute[75246]: INFO os_vif [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:39:fe,bridge_name='br-int',has_traffic_filtering=True,id=4cd5853c-099d-4ec5-91b6-475f7c703aeb,network=Network(ce13947d-26bc-4814-afed-38b0697cb13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5853c-09')
Nov 28 17:17:11 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Deleting instance files /opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32_del
Nov 28 17:17:11 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Deletion of /opt/stack/data/nova/instances/953ce3ec-438c-437a-90e8-4178529c1a32_del complete
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Updating instance_info_cache with network_info: [{"id": "f457a357-039b-4e32-b72a-9868e81dbb1b", "address": "fa:16:3e:f8:4f:00", "network": {"id": "e7fee231-f986-4a20-8aa4-d9b0d120a12c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1360844364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd096414f864a1cb0d72e97161ee28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf457a357-03", "ovs_interfaceid": "f457a357-039b-4e32-b72a-9868e81dbb1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Releasing lock "refresh_cache-5175a016-3237-4e79-bc77-4b72e5402695" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Instance network_info: |[{"id": "f457a357-039b-4e32-b72a-9868e81dbb1b", "address": "fa:16:3e:f8:4f:00", "network": {"id": "e7fee231-f986-4a20-8aa4-d9b0d120a12c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1360844364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd096414f864a1cb0d72e97161ee28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf457a357-03", "ovs_interfaceid": "f457a357-039b-4e32-b72a-9868e81dbb1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Start _get_guest_xml network_info=[{"id": "f457a357-039b-4e32-b72a-9868e81dbb1b", "address": "fa:16:3e:f8:4f:00", "network": {"id": "e7fee231-f986-4a20-8aa4-d9b0d120a12c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1360844364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd096414f864a1cb0d72e97161ee28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf457a357-03", "ovs_interfaceid": "f457a357-039b-4e32-b72a-9868e81dbb1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:11 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:17:11 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1083182305',display_name='tempest-SnapshotDataIntegrityTests-server-1083182305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1083182305',id=39,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtGj2Il54kVcR0L7hq6lwnW1OotabRjIgcp2FdUWB4em7hCgdx7FdTnfeMmz100Xsxu2WzRDdA6/mGzkEhHCDeZsG/Fy+2FA+UATeIQz/IRhsI5+SvMDCtc5PKx3WsTCw==',key_name='tempest-keypair-744419971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfd096414f864a1cb0d72e97161ee28b',ramdisk_id='',reservation_id='r-yv3doj07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-521360590',owner_user_name='tempest-SnapshotDataIntegrityTests-521360590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:17:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99a104ac894b42fba228f37739da28b9',uuid=5175a016-3237-4e79-bc77-4b72e5402695,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f457a357-039b-4e32-b72a-9868e81dbb1b", "address": "fa:16:3e:f8:4f:00", "network": {"id": "e7fee231-f986-4a20-8aa4-d9b0d120a12c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1360844364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd096414f864a1cb0d72e97161ee28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf457a357-03", "ovs_interfaceid": "f457a357-039b-4e32-b72a-9868e81dbb1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Converting VIF {"id": "f457a357-039b-4e32-b72a-9868e81dbb1b", "address": "fa:16:3e:f8:4f:00", "network": {"id": "e7fee231-f986-4a20-8aa4-d9b0d120a12c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1360844364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd096414f864a1cb0d72e97161ee28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf457a357-03", "ovs_interfaceid": "f457a357-039b-4e32-b72a-9868e81dbb1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4f:00,bridge_name='br-int',has_traffic_filtering=True,id=f457a357-039b-4e32-b72a-9868e81dbb1b,network=Network(e7fee231-f986-4a20-8aa4-d9b0d120a12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf457a357-03') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lazy-loading 'pci_devices' on Instance uuid 5175a016-3237-4e79-bc77-4b72e5402695 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.network.neutron [req-c55e05c5-52ff-4772-805e-d696a1848b02 req-72e71edf-3f83-41d0-a212-97cbd6cd9efb service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Updated VIF entry in instance network info cache for port 4cd5853c-099d-4ec5-91b6-475f7c703aeb. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.network.neutron [req-c55e05c5-52ff-4772-805e-d696a1848b02 req-72e71edf-3f83-41d0-a212-97cbd6cd9efb service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Updating instance_info_cache with network_info: [{"id": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "address": "fa:16:3e:bc:39:fe", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5853c-09", "ovs_interfaceid": "4cd5853c-099d-4ec5-91b6-475f7c703aeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:17:11 user nova-compute[75246]:   <uuid>5175a016-3237-4e79-bc77-4b72e5402695</uuid>
Nov 28 17:17:11 user nova-compute[75246]:   <name>instance-00000027</name>
Nov 28 17:17:11 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:17:11 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:17:11 user nova-compute[75246]:   <metadata>
Nov 28 17:17:11 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:17:11 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:17:11 user nova-compute[75246]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1083182305</nova:name>
Nov 28 17:17:11 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:17:11</nova:creationTime>
Nov 28 17:17:11 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:17:11 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:17:11 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:17:11 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:17:11 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:17:11 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:17:11 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:17:11 user nova-compute[75246]:       <nova:owner>
Nov 28 17:17:11 user nova-compute[75246]:         <nova:user uuid="99a104ac894b42fba228f37739da28b9">tempest-SnapshotDataIntegrityTests-521360590-project-member</nova:user>
Nov 28 17:17:11 user nova-compute[75246]:         <nova:project uuid="bfd096414f864a1cb0d72e97161ee28b">tempest-SnapshotDataIntegrityTests-521360590</nova:project>
Nov 28 17:17:11 user nova-compute[75246]:       </nova:owner>
Nov 28 17:17:11 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:17:11 user nova-compute[75246]:       <nova:ports>
Nov 28 17:17:11 user nova-compute[75246]:         <nova:port uuid="f457a357-039b-4e32-b72a-9868e81dbb1b">
Nov 28 17:17:11 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 17:17:11 user nova-compute[75246]:         </nova:port>
Nov 28 17:17:11 user nova-compute[75246]:       </nova:ports>
Nov 28 17:17:11 user nova-compute[75246]:     </nova:instance>
Nov 28 17:17:11 user nova-compute[75246]:   </metadata>
Nov 28 17:17:11 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:17:11 user nova-compute[75246]:     <system>
Nov 28 17:17:11 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:17:11 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:17:11 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:17:11 user nova-compute[75246]:       <entry name="serial">5175a016-3237-4e79-bc77-4b72e5402695</entry>
Nov 28 17:17:11 user nova-compute[75246]:       <entry name="uuid">5175a016-3237-4e79-bc77-4b72e5402695</entry>
Nov 28 17:17:11 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:17:11 user nova-compute[75246]:     </system>
Nov 28 17:17:11 user nova-compute[75246]:   </sysinfo>
Nov 28 17:17:11 user nova-compute[75246]:   <os>
Nov 28 17:17:11 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:17:11 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:17:11 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:17:11 user nova-compute[75246]:   </os>
Nov 28 17:17:11 user nova-compute[75246]:   <features>
Nov 28 17:17:11 user nova-compute[75246]:     <acpi/>
Nov 28 17:17:11 user nova-compute[75246]:     <apic/>
Nov 28 17:17:11 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:17:11 user nova-compute[75246]:   </features>
Nov 28 17:17:11 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:17:11 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:17:11 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:17:11 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:17:11 user nova-compute[75246]:   </clock>
Nov 28 17:17:11 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:17:11 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:17:11 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:17:11 user nova-compute[75246]:   </cpu>
Nov 28 17:17:11 user nova-compute[75246]:   <devices>
Nov 28 17:17:11 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:17:11 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:17:11 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk"/>
Nov 28 17:17:11 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:17:11 user nova-compute[75246]:     </disk>
Nov 28 17:17:11 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:17:11 user nova-compute[75246]:       <mac address="fa:16:3e:f8:4f:00"/>
Nov 28 17:17:11 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:17:11 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:17:11 user nova-compute[75246]:       <target dev="tapf457a357-03"/>
Nov 28 17:17:11 user nova-compute[75246]:     </interface>
Nov 28 17:17:11 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:17:11 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/console.log" append="off"/>
Nov 28 17:17:11 user nova-compute[75246]:     </serial>
Nov 28 17:17:11 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:17:11 user nova-compute[75246]:     <video>
Nov 28 17:17:11 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:17:11 user nova-compute[75246]:     </video>
Nov 28 17:17:11 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:17:11 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:17:11 user nova-compute[75246]:     </rng>
Nov 28 17:17:11 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:17:11 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:17:11 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:17:11 user nova-compute[75246]:     </memballoon>
Nov 28 17:17:11 user nova-compute[75246]:   </devices>
Nov 28 17:17:11 user nova-compute[75246]: </domain>
Nov 28 17:17:11 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1083182305',display_name='tempest-SnapshotDataIntegrityTests-server-1083182305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1083182305',id=39,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtGj2Il54kVcR0L7hq6lwnW1OotabRjIgcp2FdUWB4em7hCgdx7FdTnfeMmz100Xsxu2WzRDdA6/mGzkEhHCDeZsG/Fy+2FA+UATeIQz/IRhsI5+SvMDCtc5PKx3WsTCw==',key_name='tempest-keypair-744419971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfd096414f864a1cb0d72e97161ee28b',ramdisk_id='',reservation_id='r-yv3doj07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-521360590',owner_user_name='tempest-SnapshotDataIntegrityTests-521360590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:17:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99a104ac894b42fba228f37739da28b9',uuid=5175a016-3237-4e79-bc77-4b72e5402695,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f457a357-039b-4e32-b72a-9868e81dbb1b", "address": "fa:16:3e:f8:4f:00", "network": {"id": "e7fee231-f986-4a20-8aa4-d9b0d120a12c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1360844364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd096414f864a1cb0d72e97161ee28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf457a357-03", "ovs_interfaceid": "f457a357-039b-4e32-b72a-9868e81dbb1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Converting VIF {"id": "f457a357-039b-4e32-b72a-9868e81dbb1b", "address": "fa:16:3e:f8:4f:00", "network": {"id": "e7fee231-f986-4a20-8aa4-d9b0d120a12c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1360844364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd096414f864a1cb0d72e97161ee28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf457a357-03", "ovs_interfaceid": "f457a357-039b-4e32-b72a-9868e81dbb1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4f:00,bridge_name='br-int',has_traffic_filtering=True,id=f457a357-039b-4e32-b72a-9868e81dbb1b,network=Network(e7fee231-f986-4a20-8aa4-d9b0d120a12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf457a357-03') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG os_vif [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4f:00,bridge_name='br-int',has_traffic_filtering=True,id=f457a357-039b-4e32-b72a-9868e81dbb1b,network=Network(e7fee231-f986-4a20-8aa4-d9b0d120a12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf457a357-03') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:17:11 user nova-compute[75246]: INFO nova.compute.manager [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 28 17:17:11 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '586c339a-9009-56c1-a9c3-2d28e8e3ab25', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c55e05c5-52ff-4772-805e-d696a1848b02 req-72e71edf-3f83-41d0-a212-97cbd6cd9efb service nova] Releasing lock "refresh_cache-953ce3ec-438c-437a-90e8-4178529c1a32" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf457a357-03, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf457a357-03, col_values=(('qos', UUID('300bb98f-2961-4c54-8320-4777e0cc7461')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf457a357-03, col_values=(('external_ids', {'iface-id': 'f457a357-039b-4e32-b72a-9868e81dbb1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:4f:00', 'vm-uuid': '5175a016-3237-4e79-bc77-4b72e5402695'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:11 user nova-compute[75246]: INFO os_vif [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4f:00,bridge_name='br-int',has_traffic_filtering=True,id=f457a357-039b-4e32-b72a-9868e81dbb1b,network=Network(e7fee231-f986-4a20-8aa4-d9b0d120a12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf457a357-03')
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:17:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] No VIF found with MAC fa:16:3e:f8:4f:00, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:17:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:12 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:17:12 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Took 0.81 seconds to deallocate network for instance.
Nov 28 17:17:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:12 user nova-compute[75246]: DEBUG nova.compute.manager [req-447f587b-ad97-4b65-8192-cf1e50e32e35 req-771bf61a-fd77-4f0e-9ad8-b7d522e30564 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received event network-changed-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:12 user nova-compute[75246]: DEBUG nova.compute.manager [req-447f587b-ad97-4b65-8192-cf1e50e32e35 req-771bf61a-fd77-4f0e-9ad8-b7d522e30564 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Refreshing instance network info cache due to event network-changed-f457a357-039b-4e32-b72a-9868e81dbb1b. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:17:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-447f587b-ad97-4b65-8192-cf1e50e32e35 req-771bf61a-fd77-4f0e-9ad8-b7d522e30564 service nova] Acquiring lock "refresh_cache-5175a016-3237-4e79-bc77-4b72e5402695" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:17:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-447f587b-ad97-4b65-8192-cf1e50e32e35 req-771bf61a-fd77-4f0e-9ad8-b7d522e30564 service nova] Acquired lock "refresh_cache-5175a016-3237-4e79-bc77-4b72e5402695" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:17:12 user nova-compute[75246]: DEBUG nova.network.neutron [req-447f587b-ad97-4b65-8192-cf1e50e32e35 req-771bf61a-fd77-4f0e-9ad8-b7d522e30564 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Refreshing network info cache for port f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:13 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Deleted allocations for instance 953ce3ec-438c-437a-90e8-4178529c1a32
Nov 28 17:17:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG nova.network.neutron [req-447f587b-ad97-4b65-8192-cf1e50e32e35 req-771bf61a-fd77-4f0e-9ad8-b7d522e30564 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Updated VIF entry in instance network info cache for port f457a357-039b-4e32-b72a-9868e81dbb1b. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG nova.network.neutron [req-447f587b-ad97-4b65-8192-cf1e50e32e35 req-771bf61a-fd77-4f0e-9ad8-b7d522e30564 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Updating instance_info_cache with network_info: [{"id": "f457a357-039b-4e32-b72a-9868e81dbb1b", "address": "fa:16:3e:f8:4f:00", "network": {"id": "e7fee231-f986-4a20-8aa4-d9b0d120a12c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1360844364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd096414f864a1cb0d72e97161ee28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf457a357-03", "ovs_interfaceid": "f457a357-039b-4e32-b72a-9868e81dbb1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-447f587b-ad97-4b65-8192-cf1e50e32e35 req-771bf61a-fd77-4f0e-9ad8-b7d522e30564 service nova] Releasing lock "refresh_cache-5175a016-3237-4e79-bc77-4b72e5402695" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-82e47b82-85e7-4fdb-af78-8ba4baf89a99 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "953ce3ec-438c-437a-90e8-4178529c1a32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.426s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Received event network-vif-plugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] Acquiring lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] Lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] Lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] No waiting events found dispatching network-vif-plugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:17:13 user nova-compute[75246]: WARNING nova.compute.manager [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Received unexpected event network-vif-plugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb for instance with vm_state deleted and task_state None.
Nov 28 17:17:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Received event network-vif-plugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] Acquiring lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] Lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] Lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] No waiting events found dispatching network-vif-plugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:17:13 user nova-compute[75246]: WARNING nova.compute.manager [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Received unexpected event network-vif-plugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb for instance with vm_state deleted and task_state None.
Nov 28 17:17:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Received event network-vif-plugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] Acquiring lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] Lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] Lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] No waiting events found dispatching network-vif-plugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:17:13 user nova-compute[75246]: WARNING nova.compute.manager [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Received unexpected event network-vif-plugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb for instance with vm_state deleted and task_state None.
Nov 28 17:17:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Received event network-vif-deleted-4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Received event network-vif-plugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] Acquiring lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] Lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] Lock "953ce3ec-438c-437a-90e8-4178529c1a32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] No waiting events found dispatching network-vif-plugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:17:13 user nova-compute[75246]: WARNING nova.compute.manager [req-5c381a81-c719-4850-8b52-ce1a9ae160df req-27466602-bfcf-447c-b0cf-82e200d477be service nova] [instance: 953ce3ec-438c-437a-90e8-4178529c1a32] Received unexpected event network-vif-plugged-4cd5853c-099d-4ec5-91b6-475f7c703aeb for instance with vm_state deleted and task_state None.
Nov 28 17:17:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-226a529c-fb70-4ec3-b780-a385f1462e5f req-9d826d02-07ab-4df1-aacc-2fa82a6bd030 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received event network-vif-plugged-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-226a529c-fb70-4ec3-b780-a385f1462e5f req-9d826d02-07ab-4df1-aacc-2fa82a6bd030 service nova] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-226a529c-fb70-4ec3-b780-a385f1462e5f req-9d826d02-07ab-4df1-aacc-2fa82a6bd030 service nova] Lock "5175a016-3237-4e79-bc77-4b72e5402695-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-226a529c-fb70-4ec3-b780-a385f1462e5f req-9d826d02-07ab-4df1-aacc-2fa82a6bd030 service nova] Lock "5175a016-3237-4e79-bc77-4b72e5402695-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG nova.compute.manager [req-226a529c-fb70-4ec3-b780-a385f1462e5f req-9d826d02-07ab-4df1-aacc-2fa82a6bd030 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] No waiting events found dispatching network-vif-plugged-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:17:13 user nova-compute[75246]: WARNING nova.compute.manager [req-226a529c-fb70-4ec3-b780-a385f1462e5f req-9d826d02-07ab-4df1-aacc-2fa82a6bd030 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received unexpected event network-vif-plugged-f457a357-039b-4e32-b72a-9868e81dbb1b for instance with vm_state building and task_state spawning.
Nov 28 17:17:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:15 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:17:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:17:15 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Instance spawned successfully.
Nov 28 17:17:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:17:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:17:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:17:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:17:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:17:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:17:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:17:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-45312a12-2ba9-48ed-af12-6054f279fa21 req-79c3b8e9-114d-45c5-b0be-2b6dc2d80b99 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received event network-vif-plugged-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-45312a12-2ba9-48ed-af12-6054f279fa21 req-79c3b8e9-114d-45c5-b0be-2b6dc2d80b99 service nova] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-45312a12-2ba9-48ed-af12-6054f279fa21 req-79c3b8e9-114d-45c5-b0be-2b6dc2d80b99 service nova] Lock "5175a016-3237-4e79-bc77-4b72e5402695-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-45312a12-2ba9-48ed-af12-6054f279fa21 req-79c3b8e9-114d-45c5-b0be-2b6dc2d80b99 service nova] Lock "5175a016-3237-4e79-bc77-4b72e5402695-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-45312a12-2ba9-48ed-af12-6054f279fa21 req-79c3b8e9-114d-45c5-b0be-2b6dc2d80b99 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] No waiting events found dispatching network-vif-plugged-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:17:15 user nova-compute[75246]: WARNING nova.compute.manager [req-45312a12-2ba9-48ed-af12-6054f279fa21 req-79c3b8e9-114d-45c5-b0be-2b6dc2d80b99 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received unexpected event network-vif-plugged-f457a357-039b-4e32-b72a-9868e81dbb1b for instance with vm_state building and task_state spawning.
Nov 28 17:17:15 user nova-compute[75246]: INFO nova.compute.manager [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 28 17:17:15 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:17:15 user nova-compute[75246]: INFO nova.compute.manager [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Took 6.82 seconds to build instance.
Nov 28 17:17:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3e5b77c7-cf4b-4fff-a05e-8d4f40290cc1 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.927s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:17:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:17:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:17:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:17:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:32 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:17:32 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:17:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:33 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:17:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:17:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:17:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:17:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:17:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:17:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:37 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:17:37 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=7189MB free_disk=25.07220458984375GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance e1266470-c182-4c0c-a575-4c5043f54745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c94900af-f484-47bf-8627-8aa863334b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 0ed72d2a-ca9b-4b99-b422-86fa93af945c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 90829136-472b-4c45-9607-c28433d05f56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 5c199841-2ce5-4f72-a3f1-6d6d0c746505 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 0fb728b1-9a86-412e-b37e-57a072164534 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 9885ad9e-10d1-4b86-afe4-252f543bc2ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 1d3f57d8-3580-4c42-8a4c-cef210e19eb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 190d2e59-1de9-4b1b-8a0d-cd983f857f7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a796152e-e8df-41bf-a5ea-ae94d4fa8b41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 5175a016-3237-4e79-bc77-4b72e5402695 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:17:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:17:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:17:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:17:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:17:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:17:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:17:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:17:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:40 user nova-compute[75246]: INFO nova.compute.manager [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Terminating instance
Nov 28 17:17:40 user nova-compute[75246]: DEBUG nova.compute.manager [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-16a307de-f64c-4b72-9ad3-304f8005746a req-8cd6c5af-6a67-4fa3-8b9b-464b305adcac service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received event network-vif-unplugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-16a307de-f64c-4b72-9ad3-304f8005746a req-8cd6c5af-6a67-4fa3-8b9b-464b305adcac service nova] Acquiring lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-16a307de-f64c-4b72-9ad3-304f8005746a req-8cd6c5af-6a67-4fa3-8b9b-464b305adcac service nova] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-16a307de-f64c-4b72-9ad3-304f8005746a req-8cd6c5af-6a67-4fa3-8b9b-464b305adcac service nova] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-16a307de-f64c-4b72-9ad3-304f8005746a req-8cd6c5af-6a67-4fa3-8b9b-464b305adcac service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] No waiting events found dispatching network-vif-unplugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-16a307de-f64c-4b72-9ad3-304f8005746a req-8cd6c5af-6a67-4fa3-8b9b-464b305adcac service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received event network-vif-unplugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:17:40 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Instance destroyed successfully.
Nov 28 17:17:40 user nova-compute[75246]: DEBUG nova.objects.instance [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lazy-loading 'resources' on Instance uuid 5c199841-2ce5-4f72-a3f1-6d6d0c746505 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:11:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-62421813',display_name='tempest-ServerActionsTestOtherA-server-62421813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-62421813',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5QoCu8z1J19YdF2KrIxtAcllUa+54ECbo+7UcXNC+vRRLTiAkI9KGg17d3KrbHvU7U2QxVzma0Ilz+ryH1d5iWfmR7mKkbwqDpkhmRExCuSVuBHZfoiX/4Pew1wkkhqw==',key_name='tempest-keypair-745476775',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:13:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be06eee4e74a41b799f1df75ea55b955',ramdisk_id='',reservation_id='r-8k4f0rv1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1554281978',owner_user_name='tempest-ServerActionsTestOtherA-1554281978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:14:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39d2eb0837eb4c729fe9ca2964cbe789',uuid=5c199841-2ce5-4f72-a3f1-6d6d0c746505,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converting VIF {"id": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "address": "fa:16:3e:a0:bb:83", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3c2850-37", "ovs_interfaceid": "3f3c2850-37c8-4c04-a0ae-588a394ac8d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=3f3c2850-37c8-4c04-a0ae-588a394ac8d9,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3c2850-37') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG os_vif [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=3f3c2850-37c8-4c04-a0ae-588a394ac8d9,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3c2850-37') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f3c2850-37, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8aa94a78-1cf0-4243-ad73-267c7c10daba) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:40 user nova-compute[75246]: INFO os_vif [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:bb:83,bridge_name='br-int',has_traffic_filtering=True,id=3f3c2850-37c8-4c04-a0ae-588a394ac8d9,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3c2850-37')
Nov 28 17:17:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbXCyWfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:17:40 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:17:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:17:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a61b4b-10c4-49fb-90fe-578151a22bd9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:17:41 user nova-compute[75246]: No targets found.
Nov 28 17:17:41 user nova-compute[75246]: iSNS:
Nov 28 17:17:41 user nova-compute[75246]: No targets found.
Nov 28 17:17:41 user nova-compute[75246]: STATIC:
Nov 28 17:17:41 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e
Nov 28 17:17:41 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:17:41 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:17:41 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a
Nov 28 17:17:41 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:17:41 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:17:41 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158
Nov 28 17:17:41 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:17:41 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:17:41 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:17:41 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:17:41 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:17:41 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3
Nov 28 17:17:41 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:17:41 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:17:41 user nova-compute[75246]: FIRMWARE:
Nov 28 17:17:41 user nova-compute[75246]: No targets found.
Nov 28 17:17:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:17:41 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:17:41 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3353ae-3c23-491d-ba26-2b02a6cfee0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a39eadf-c3e8-45d5-9b0a-f7a28dfe0fa9]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:17:41 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:17:41 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:17:41 user nova-compute[75246]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)
Nov 28 17:17:41 user nova-compute[75246]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:17:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 (non-flash)
Nov 28 17:17:41 user nova-compute[75246]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:17:41 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:17:41 user nova-compute[75246]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)
Nov 28 17:17:41 user nova-compute[75246]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:17:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d815ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3'): ({'sdc'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Removing single pathed devices sdc {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0968c5c0-a087-4d9c-bb8a-9e607fef92cf]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7ae5d0-012e-479b-9521-cf33b7e84fa0]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Flushing IO for device /dev/sdc {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 90829136-472b-4c45-9607-c28433d05f56] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adada74-d0d9-44bc-b6c5-3fcc5cff082d]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30105d0-7092-4c09-8e07-99844070f82f]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[298b0eeb-ab9b-4a11-acde-1fee5c8f59d5]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc505618-3872-49f5-8769-a0311c6f381c]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3, portal: 172.16.0.220,3260]
Nov 28 17:17:41 user nova-compute[75246]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3, portal: 172.16.0.220,3260] successful.
Nov 28 17:17:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c79347f-fc8d-4e2e-a4eb-5a4cf3f7f691]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] <== disconnect_volume: return (333ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:17:41 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Deleting instance files /opt/stack/data/nova/instances/5c199841-2ce5-4f72-a3f1-6d6d0c746505_del
Nov 28 17:17:41 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Deletion of /opt/stack/data/nova/instances/5c199841-2ce5-4f72-a3f1-6d6d0c746505_del complete
Nov 28 17:17:41 user nova-compute[75246]: INFO nova.compute.manager [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 90829136-472b-4c45-9607-c28433d05f56] Updating instance_info_cache with network_info: [{"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:17:41 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 90829136-472b-4c45-9607-c28433d05f56] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:17:42 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:17:42 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Took 0.83 seconds to deallocate network for instance.
Nov 28 17:17:42 user nova-compute[75246]: DEBUG nova.compute.manager [req-63cf734e-6b3e-4504-9554-5242223111a0 req-e0ca310b-0c47-4bb9-95ad-d1fc9b621b61 service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received event network-vif-plugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-63cf734e-6b3e-4504-9554-5242223111a0 req-e0ca310b-0c47-4bb9-95ad-d1fc9b621b61 service nova] Acquiring lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-63cf734e-6b3e-4504-9554-5242223111a0 req-e0ca310b-0c47-4bb9-95ad-d1fc9b621b61 service nova] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-63cf734e-6b3e-4504-9554-5242223111a0 req-e0ca310b-0c47-4bb9-95ad-d1fc9b621b61 service nova] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:42 user nova-compute[75246]: DEBUG nova.compute.manager [req-63cf734e-6b3e-4504-9554-5242223111a0 req-e0ca310b-0c47-4bb9-95ad-d1fc9b621b61 service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] No waiting events found dispatching network-vif-plugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:17:42 user nova-compute[75246]: WARNING nova.compute.manager [req-63cf734e-6b3e-4504-9554-5242223111a0 req-e0ca310b-0c47-4bb9-95ad-d1fc9b621b61 service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received unexpected event network-vif-plugged-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 for instance with vm_state active and task_state deleting.
Nov 28 17:17:42 user nova-compute[75246]: DEBUG nova.compute.manager [req-63cf734e-6b3e-4504-9554-5242223111a0 req-e0ca310b-0c47-4bb9-95ad-d1fc9b621b61 service nova] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Received event network-vif-deleted-3f3c2850-37c8-4c04-a0ae-588a394ac8d9 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:42 user nova-compute[75246]: INFO nova.compute.manager [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Took 0.74 seconds to detach 1 volumes for instance.
Nov 28 17:17:42 user nova-compute[75246]: DEBUG nova.compute.manager [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: 5c199841-2ce5-4f72-a3f1-6d6d0c746505] Deleting volume: 705dc9bc-03ec-4ed6-98c8-f35e1f0ea3e3 {{(pid=75246) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 17:17:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:43 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:17:43 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:17:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:43 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Deleted allocations for instance 5c199841-2ce5-4f72-a3f1-6d6d0c746505
Nov 28 17:17:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-07dde4e3-61ab-49c0-91fa-5b4b42dc881e tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "5c199841-2ce5-4f72-a3f1-6d6d0c746505" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.464s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:17:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:57 user nova-compute[75246]: INFO nova.compute.manager [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Terminating instance
Nov 28 17:17:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:17:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-76a6ede9-1428-42c8-8b92-b0b38a3b15ab req-e576bc63-c3c8-42eb-9e33-25c92096b770 service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Received event network-changed-5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-76a6ede9-1428-42c8-8b92-b0b38a3b15ab req-e576bc63-c3c8-42eb-9e33-25c92096b770 service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Refreshing instance network info cache due to event network-changed-5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:17:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-76a6ede9-1428-42c8-8b92-b0b38a3b15ab req-e576bc63-c3c8-42eb-9e33-25c92096b770 service nova] Acquiring lock "refresh_cache-9885ad9e-10d1-4b86-afe4-252f543bc2ec" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:17:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-76a6ede9-1428-42c8-8b92-b0b38a3b15ab req-e576bc63-c3c8-42eb-9e33-25c92096b770 service nova] Acquired lock "refresh_cache-9885ad9e-10d1-4b86-afe4-252f543bc2ec" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:17:57 user nova-compute[75246]: DEBUG nova.network.neutron [req-76a6ede9-1428-42c8-8b92-b0b38a3b15ab req-e576bc63-c3c8-42eb-9e33-25c92096b770 service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Refreshing network info cache for port 5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:58 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Instance destroyed successfully.
Nov 28 17:17:58 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lazy-loading 'resources' on Instance uuid 1d3f57d8-3580-4c42-8a4c-cef210e19eb4 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T17:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2130907667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2130907667',id=32,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkyQVU4+IKRbdT/9XXp3whOYOZpGrX/8I6qjmkWxKzuwGZbu6+LtoKJ1o0iUy0Plg/S1jnl5rqH3hbqK/R2kiB32pqva3FiYFAbn/9EY1INepDABzQQiQlwaAFWnxd6Tw==',key_name='tempest-keypair-1886774448',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:16:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd94665acd9a4448a1ad1350d71d8f72',ramdisk_id='',reservation_id='r-3eim7bic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726606277',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726606277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ed095223674edebcee82e4183c8ea0',uuid=1d3f57d8-3580-4c42-8a4c-cef210e19eb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converting VIF {"id": "434dbbbd-947d-47c5-a794-4fee8690d835", "address": "fa:16:3e:24:db:6a", "network": {"id": "5c824a90-ca23-40cf-b436-7c1c2e2a1c6b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-539107612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd94665acd9a4448a1ad1350d71d8f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap434dbbbd-94", "ovs_interfaceid": "434dbbbd-947d-47c5-a794-4fee8690d835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:db:6a,bridge_name='br-int',has_traffic_filtering=True,id=434dbbbd-947d-47c5-a794-4fee8690d835,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434dbbbd-94') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG os_vif [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:db:6a,bridge_name='br-int',has_traffic_filtering=True,id=434dbbbd-947d-47c5-a794-4fee8690d835,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434dbbbd-94') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap434dbbbd-94, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43e0fa4e-998a-479c-a5e3-5904d6ce0191) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:58 user nova-compute[75246]: INFO os_vif [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:db:6a,bridge_name='br-int',has_traffic_filtering=True,id=434dbbbd-947d-47c5-a794-4fee8690d835,network=Network(5c824a90-ca23-40cf-b436-7c1c2e2a1c6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap434dbbbd-94')
Nov 28 17:17:58 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Deleting instance files /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4_del
Nov 28 17:17:58 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Deletion of /opt/stack/data/nova/instances/1d3f57d8-3580-4c42-8a4c-cef210e19eb4_del complete
Nov 28 17:17:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:58 user nova-compute[75246]: INFO nova.compute.manager [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Took 0.76 seconds to destroy the instance on the hypervisor.
Nov 28 17:17:58 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG nova.network.neutron [req-76a6ede9-1428-42c8-8b92-b0b38a3b15ab req-e576bc63-c3c8-42eb-9e33-25c92096b770 service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Updated VIF entry in instance network info cache for port 5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG nova.network.neutron [req-76a6ede9-1428-42c8-8b92-b0b38a3b15ab req-e576bc63-c3c8-42eb-9e33-25c92096b770 service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Updating instance_info_cache with network_info: [{"id": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "address": "fa:16:3e:8b:ef:38", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f8bb871-17", "ovs_interfaceid": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-76a6ede9-1428-42c8-8b92-b0b38a3b15ab req-e576bc63-c3c8-42eb-9e33-25c92096b770 service nova] Releasing lock "refresh_cache-9885ad9e-10d1-4b86-afe4-252f543bc2ec" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:17:59 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Took 0.91 seconds to deallocate network for instance.
Nov 28 17:17:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-a9add03c-2d51-464d-a811-7bc3904d9f8c req-25386056-9e95-4fe5-bc31-25a70f4d4e64 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received event network-vif-deleted-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:59 user nova-compute[75246]: INFO nova.compute.manager [req-a9add03c-2d51-464d-a811-7bc3904d9f8c req-25386056-9e95-4fe5-bc31-25a70f4d4e64 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Neutron deleted interface 434dbbbd-947d-47c5-a794-4fee8690d835; detaching it from the instance and deleting it from the info cache
Nov 28 17:17:59 user nova-compute[75246]: DEBUG nova.network.neutron [req-a9add03c-2d51-464d-a811-7bc3904d9f8c req-25386056-9e95-4fe5-bc31-25a70f4d4e64 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-a9add03c-2d51-464d-a811-7bc3904d9f8c req-25386056-9e95-4fe5-bc31-25a70f4d4e64 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Detach interface failed, port_id=434dbbbd-947d-47c5-a794-4fee8690d835, reason: Instance 1d3f57d8-3580-4c42-8a4c-cef210e19eb4 could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:59 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Deleted allocations for instance 1d3f57d8-3580-4c42-8a4c-cef210e19eb4
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6b2da447-bb66-40f8-b789-2d95fca3e42a tempest-AttachVolumeShelveTestJSON-1726606277 tempest-AttachVolumeShelveTestJSON-1726606277-project-member] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.226s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received event network-vif-unplugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] Acquiring lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] No waiting events found dispatching network-vif-unplugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:17:59 user nova-compute[75246]: WARNING nova.compute.manager [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received unexpected event network-vif-unplugged-434dbbbd-947d-47c5-a794-4fee8690d835 for instance with vm_state deleted and task_state None.
Nov 28 17:17:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received event network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] Acquiring lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] No waiting events found dispatching network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:17:59 user nova-compute[75246]: WARNING nova.compute.manager [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received unexpected event network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 for instance with vm_state deleted and task_state None.
Nov 28 17:17:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received event network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] Acquiring lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] No waiting events found dispatching network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:17:59 user nova-compute[75246]: WARNING nova.compute.manager [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received unexpected event network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 for instance with vm_state deleted and task_state None.
Nov 28 17:17:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received event network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] Acquiring lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] No waiting events found dispatching network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:17:59 user nova-compute[75246]: WARNING nova.compute.manager [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received unexpected event network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 for instance with vm_state deleted and task_state None.
Nov 28 17:17:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received event network-vif-unplugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] Acquiring lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] No waiting events found dispatching network-vif-unplugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:17:59 user nova-compute[75246]: WARNING nova.compute.manager [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received unexpected event network-vif-unplugged-434dbbbd-947d-47c5-a794-4fee8690d835 for instance with vm_state deleted and task_state None.
Nov 28 17:17:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received event network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] Acquiring lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] Lock "1d3f57d8-3580-4c42-8a4c-cef210e19eb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:17:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] No waiting events found dispatching network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:17:59 user nova-compute[75246]: WARNING nova.compute.manager [req-5c74d61f-16cc-437c-a50f-3d131925518f req-dddf92a0-57c0-4826-9b2c-e09bf460f387 service nova] [instance: 1d3f57d8-3580-4c42-8a4c-cef210e19eb4] Received unexpected event network-vif-plugged-434dbbbd-947d-47c5-a794-4fee8690d835 for instance with vm_state deleted and task_state None.
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG nova.objects.instance [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lazy-loading 'flavor' on Instance uuid 9885ad9e-10d1-4b86-afe4-252f543bc2ec {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:00 user nova-compute[75246]: INFO nova.compute.manager [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Attaching volume bc3ae79e-01f8-4868-8ee5-265749580237 to /dev/vdb
Nov 28 17:18:00 user nova-compute[75246]: DEBUG os_brick.utils [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea98d39-ea9a-4052-b61b-00c7787a70d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a508cc72-ea6f-4d39-baf8-e12f87980e6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a29527-0713-4b51-b774-c73dadfcbfbc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9d5d4e-d578-4635-aca7-4d15bdeedb8d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:18:00 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:18:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fecaaf-c567-4b2c-ba95-9883d89828cc]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG os_brick.utils [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:18:00 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Updating existing volume attachment record: eef8e6b3-6629-43be-b566-1a0797948fff {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:18:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-75bfe1fb-5ffc-419b-9e38-8df5b3541dc3 req-3bf52a82-c059-4e21-b538-d048ac563492 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received event network-changed-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-75bfe1fb-5ffc-419b-9e38-8df5b3541dc3 req-3bf52a82-c059-4e21-b538-d048ac563492 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Refreshing instance network info cache due to event network-changed-5f6b2b48-5c6d-4528-95dd-e7eb24780e37. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:18:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-75bfe1fb-5ffc-419b-9e38-8df5b3541dc3 req-3bf52a82-c059-4e21-b538-d048ac563492 service nova] Acquiring lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:18:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-75bfe1fb-5ffc-419b-9e38-8df5b3541dc3 req-3bf52a82-c059-4e21-b538-d048ac563492 service nova] Acquired lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:18:03 user nova-compute[75246]: DEBUG nova.network.neutron [req-75bfe1fb-5ffc-419b-9e38-8df5b3541dc3 req-3bf52a82-c059-4e21-b538-d048ac563492 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Refreshing network info cache for port 5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:18:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:03 user nova-compute[75246]: DEBUG nova.network.neutron [req-75bfe1fb-5ffc-419b-9e38-8df5b3541dc3 req-3bf52a82-c059-4e21-b538-d048ac563492 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Updated VIF entry in instance network info cache for port 5f6b2b48-5c6d-4528-95dd-e7eb24780e37. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:18:03 user nova-compute[75246]: DEBUG nova.network.neutron [req-75bfe1fb-5ffc-419b-9e38-8df5b3541dc3 req-3bf52a82-c059-4e21-b538-d048ac563492 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Updating instance_info_cache with network_info: [{"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:18:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-75bfe1fb-5ffc-419b-9e38-8df5b3541dc3 req-3bf52a82-c059-4e21-b538-d048ac563492 service nova] Releasing lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:18:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "90829136-472b-4c45-9607-c28433d05f56" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:03 user nova-compute[75246]: INFO nova.compute.manager [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Detaching volume 97a00ba4-d68c-4715-abeb-e888a22a0158
Nov 28 17:18:03 user nova-compute[75246]: INFO nova.virt.block_device [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Attempting to driver detach volume 97a00ba4-d68c-4715-abeb-e888a22a0158 from mountpoint /dev/vdb
Nov 28 17:18:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Attempting to detach device vdb from instance 90829136-472b-4c45-9607-c28433d05f56 from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:18:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:18:03 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:18:03 user nova-compute[75246]:   <source dev="/dev/sde"/>
Nov 28 17:18:03 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:18:03 user nova-compute[75246]:   <serial>97a00ba4-d68c-4715-abeb-e888a22a0158</serial>
Nov 28 17:18:03 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:18:03 user nova-compute[75246]: </disk>
Nov 28 17:18:03 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:18:03 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Successfully detached device vdb from instance 90829136-472b-4c45-9607-c28433d05f56 from the persistent domain config.
Nov 28 17:18:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 90829136-472b-4c45-9607-c28433d05f56 from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:18:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:18:03 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:18:03 user nova-compute[75246]:   <source dev="/dev/sde"/>
Nov 28 17:18:03 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:18:03 user nova-compute[75246]:   <serial>97a00ba4-d68c-4715-abeb-e888a22a0158</serial>
Nov 28 17:18:03 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:18:03 user nova-compute[75246]: </disk>
Nov 28 17:18:03 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:18:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 90829136-472b-4c45-9607-c28433d05f56 {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:18:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-a251fdee-e298-475c-b4de-6f13a6d51373 req-eb0a4abb-eac6-4278-ad8e-b373a67c4c0b service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received event network-changed-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:05 user nova-compute[75246]: DEBUG nova.compute.manager [req-a251fdee-e298-475c-b4de-6f13a6d51373 req-eb0a4abb-eac6-4278-ad8e-b373a67c4c0b service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Refreshing instance network info cache due to event network-changed-5f6b2b48-5c6d-4528-95dd-e7eb24780e37. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:18:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a251fdee-e298-475c-b4de-6f13a6d51373 req-eb0a4abb-eac6-4278-ad8e-b373a67c4c0b service nova] Acquiring lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:18:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a251fdee-e298-475c-b4de-6f13a6d51373 req-eb0a4abb-eac6-4278-ad8e-b373a67c4c0b service nova] Acquired lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:18:05 user nova-compute[75246]: DEBUG nova.network.neutron [req-a251fdee-e298-475c-b4de-6f13a6d51373 req-eb0a4abb-eac6-4278-ad8e-b373a67c4c0b service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Refreshing network info cache for port 5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:18:05 user nova-compute[75246]: DEBUG nova.network.neutron [req-a251fdee-e298-475c-b4de-6f13a6d51373 req-eb0a4abb-eac6-4278-ad8e-b373a67c4c0b service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Updated VIF entry in instance network info cache for port 5f6b2b48-5c6d-4528-95dd-e7eb24780e37. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:18:05 user nova-compute[75246]: DEBUG nova.network.neutron [req-a251fdee-e298-475c-b4de-6f13a6d51373 req-eb0a4abb-eac6-4278-ad8e-b373a67c4c0b service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Updating instance_info_cache with network_info: [{"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:18:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a251fdee-e298-475c-b4de-6f13a6d51373 req-eb0a4abb-eac6-4278-ad8e-b373a67c4c0b service nova] Releasing lock "refresh_cache-90829136-472b-4c45-9607-c28433d05f56" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:18:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNxulaIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:18:08 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:18:08 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:18:08 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab910ed-5854-4975-a6fe-a3225c5beb1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:18:08 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[40725c35-5b79-4eb1-9ca8-6ded01fbbbb4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237] added
Nov 28 17:18:08 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cb35ff-2c97-4cb9-8b1f-ea37627f73f3]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a96237-41b7-4596-9826-08d054b4f7ec]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNxulaIQ {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNxulaIQ" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebe1409-7cea-4edb-adde-a839bb204c14]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iNxulaIQ'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[67951e12-fe6d-4063-b8c3-72ebaf08aa7d]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[273a9a6d-d7db-434b-b968-96ff3553f883]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:18:08 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:18:08 user nova-compute[75246]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)
Nov 28 17:18:08 user nova-compute[75246]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:18:08 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:18:08 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:18:08 user nova-compute[75246]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)
Nov 28 17:18:08 user nova-compute[75246]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:18:08 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f960891-cdfc-4472-8d33-41886ac549c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237, portal: 172.16.0.220,3260]
Nov 28 17:18:08 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237, portal: 172.16.0.220,3260] successful.
Nov 28 17:18:08 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd37945-5fa5-402f-b942-4c4c2cf4e9f0]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[69118d36-9fe8-4dc1-8a71-d86c1a2f552a]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:18:08 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:18:08 user nova-compute[75246]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)
Nov 28 17:18:08 user nova-compute[75246]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:18:08 user nova-compute[75246]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 (non-flash)
Nov 28 17:18:08 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:18:08 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:18:08 user nova-compute[75246]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)
Nov 28 17:18:08 user nova-compute[75246]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:18:08 user nova-compute[75246]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 (non-flash)
Nov 28 17:18:08 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b659cd9-4a90-4c62-bc8e-51c179145fa8]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:18:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-f26d98f1-f68c-4e2b-833b-31d7678382ab req-2bc973fc-23d1-4681-a8d9-1bc000cd80e7 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Received event network-changed-1e7e447d-e8b6-4a5e-893a-dd06e8818b24 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-f26d98f1-f68c-4e2b-833b-31d7678382ab req-2bc973fc-23d1-4681-a8d9-1bc000cd80e7 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Refreshing instance network info cache due to event network-changed-1e7e447d-e8b6-4a5e-893a-dd06e8818b24. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f26d98f1-f68c-4e2b-833b-31d7678382ab req-2bc973fc-23d1-4681-a8d9-1bc000cd80e7 service nova] Acquiring lock "refresh_cache-0ed72d2a-ca9b-4b99-b422-86fa93af945c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f26d98f1-f68c-4e2b-833b-31d7678382ab req-2bc973fc-23d1-4681-a8d9-1bc000cd80e7 service nova] Acquired lock "refresh_cache-0ed72d2a-ca9b-4b99-b422-86fa93af945c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG nova.network.neutron [req-f26d98f1-f68c-4e2b-833b-31d7678382ab req-2bc973fc-23d1-4681-a8d9-1bc000cd80e7 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Refreshing network info cache for port 1e7e447d-e8b6-4a5e-893a-dd06e8818b24 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:09 user nova-compute[75246]: INFO nova.compute.manager [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Terminating instance
Nov 28 17:18:09 user nova-compute[75246]: DEBUG nova.compute.manager [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG nova.network.neutron [req-f26d98f1-f68c-4e2b-833b-31d7678382ab req-2bc973fc-23d1-4681-a8d9-1bc000cd80e7 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Updated VIF entry in instance network info cache for port 1e7e447d-e8b6-4a5e-893a-dd06e8818b24. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG nova.network.neutron [req-f26d98f1-f68c-4e2b-833b-31d7678382ab req-2bc973fc-23d1-4681-a8d9-1bc000cd80e7 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Updating instance_info_cache with network_info: [{"id": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "address": "fa:16:3e:ef:e7:23", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e447d-e8", "ovs_interfaceid": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f26d98f1-f68c-4e2b-833b-31d7678382ab req-2bc973fc-23d1-4681-a8d9-1bc000cd80e7 service nova] Releasing lock "refresh_cache-0ed72d2a-ca9b-4b99-b422-86fa93af945c" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-c685f17c-1916-46c6-a7b9-8bba0f43b502 req-883bc823-75bd-4801-8232-847ff02bac5f service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Received event network-vif-unplugged-1e7e447d-e8b6-4a5e-893a-dd06e8818b24 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c685f17c-1916-46c6-a7b9-8bba0f43b502 req-883bc823-75bd-4801-8232-847ff02bac5f service nova] Acquiring lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c685f17c-1916-46c6-a7b9-8bba0f43b502 req-883bc823-75bd-4801-8232-847ff02bac5f service nova] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c685f17c-1916-46c6-a7b9-8bba0f43b502 req-883bc823-75bd-4801-8232-847ff02bac5f service nova] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-c685f17c-1916-46c6-a7b9-8bba0f43b502 req-883bc823-75bd-4801-8232-847ff02bac5f service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] No waiting events found dispatching network-vif-unplugged-1e7e447d-e8b6-4a5e-893a-dd06e8818b24 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-c685f17c-1916-46c6-a7b9-8bba0f43b502 req-883bc823-75bd-4801-8232-847ff02bac5f service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Received event network-vif-unplugged-1e7e447d-e8b6-4a5e-893a-dd06e8818b24 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNxulaIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26635363965616238', 'path': '/dev/sdc'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635363965616238', 'path': '/dev/sdc'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG nova.objects.instance [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lazy-loading 'flavor' on Instance uuid 9885ad9e-10d1-4b86-afe4-252f543bc2ec {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:18:09 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:18:09 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:18:09 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:18:09 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:18:09 user nova-compute[75246]:   <serial>bc3ae79e-01f8-4868-8ee5-265749580237</serial>
Nov 28 17:18:09 user nova-compute[75246]: </disk>
Nov 28 17:18:09 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:18:10 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Instance destroyed successfully.
Nov 28 17:18:10 user nova-compute[75246]: DEBUG nova.objects.instance [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lazy-loading 'resources' on Instance uuid 0ed72d2a-ca9b-4b99-b422-86fa93af945c {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:11:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1178057911',display_name='tempest-TestStampPattern-server-1178057911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1178057911',id=26,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnj4hviUDvSX6hriv+L/QlZItoNaDMhnx3xQZWny569+OHLO66OwUH6l0a05JpEbHna9f+mLN7Ii3Ir+MVNbuGgRCX/YzUtBIJTlrG7CTESk7NAniXb5lC2lIImNVOo0A==',key_name='tempest-TestStampPattern-150119392',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:11:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84705237374f40e287bdc39098936027',ramdisk_id='',reservation_id='r-l3hud2uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1581372233',owner_user_name='tempest-TestStampPattern-1581372233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:14:11Z,user_data=None,user_id='6897bba4a31544f78a2f1911294deb97',uuid=0ed72d2a-ca9b-4b99-b422-86fa93af945c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "address": "fa:16:3e:ef:e7:23", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e447d-e8", "ovs_interfaceid": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Converting VIF {"id": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "address": "fa:16:3e:ef:e7:23", "network": {"id": "ce13947d-26bc-4814-afed-38b0697cb13c", "bridge": "br-int", "label": "tempest-TestStampPattern-373018893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84705237374f40e287bdc39098936027", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e447d-e8", "ovs_interfaceid": "1e7e447d-e8b6-4a5e-893a-dd06e8818b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:e7:23,bridge_name='br-int',has_traffic_filtering=True,id=1e7e447d-e8b6-4a5e-893a-dd06e8818b24,network=Network(ce13947d-26bc-4814-afed-38b0697cb13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7e447d-e8') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG os_vif [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:e7:23,bridge_name='br-int',has_traffic_filtering=True,id=1e7e447d-e8b6-4a5e-893a-dd06e8818b24,network=Network(ce13947d-26bc-4814-afed-38b0697cb13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7e447d-e8') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e7e447d-e8, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08d26d20-97e7-4c9e-8f41-848c10b96fff) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:10 user nova-compute[75246]: INFO os_vif [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:e7:23,bridge_name='br-int',has_traffic_filtering=True,id=1e7e447d-e8b6-4a5e-893a-dd06e8818b24,network=Network(ce13947d-26bc-4814-afed-38b0697cb13c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7e447d-e8')
Nov 28 17:18:10 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Deleting instance files /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c_del
Nov 28 17:18:10 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Deletion of /opt/stack/data/nova/instances/0ed72d2a-ca9b-4b99-b422-86fa93af945c_del complete
Nov 28 17:18:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] No VIF found with MAC fa:16:3e:8b:ef:38, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:18:10 user nova-compute[75246]: INFO nova.compute.manager [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 28 17:18:10 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ca6f81d0-3e99-43e2-8ff4-24f868c9a5d2 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.676s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:18:10 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Took 0.44 seconds to deallocate network for instance.
Nov 28 17:18:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:11 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:18:11 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:18:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-1eeb6b6f-dc87-4d10-8aec-cf445ebbd60a req-1ae4b475-3f27-4ab6-a189-99d503237b3d service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Received event network-vif-deleted-1e7e447d-e8b6-4a5e-893a-dd06e8818b24 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:11 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Deleted allocations for instance 0ed72d2a-ca9b-4b99-b422-86fa93af945c
Nov 28 17:18:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-818fd2ca-86c0-4fb3-8e7e-f42c9a22cbd5 tempest-TestStampPattern-1581372233 tempest-TestStampPattern-1581372233-project-member] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.175s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-7958f174-8b98-4598-8350-c4a208c67675 req-49654162-b5aa-4b85-a972-f5a2855b5b77 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Received event network-vif-plugged-1e7e447d-e8b6-4a5e-893a-dd06e8818b24 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7958f174-8b98-4598-8350-c4a208c67675 req-49654162-b5aa-4b85-a972-f5a2855b5b77 service nova] Acquiring lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7958f174-8b98-4598-8350-c4a208c67675 req-49654162-b5aa-4b85-a972-f5a2855b5b77 service nova] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7958f174-8b98-4598-8350-c4a208c67675 req-49654162-b5aa-4b85-a972-f5a2855b5b77 service nova] Lock "0ed72d2a-ca9b-4b99-b422-86fa93af945c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-7958f174-8b98-4598-8350-c4a208c67675 req-49654162-b5aa-4b85-a972-f5a2855b5b77 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] No waiting events found dispatching network-vif-plugged-1e7e447d-e8b6-4a5e-893a-dd06e8818b24 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:18:11 user nova-compute[75246]: WARNING nova.compute.manager [req-7958f174-8b98-4598-8350-c4a208c67675 req-49654162-b5aa-4b85-a972-f5a2855b5b77 service nova] [instance: 0ed72d2a-ca9b-4b99-b422-86fa93af945c] Received unexpected event network-vif-plugged-1e7e447d-e8b6-4a5e-893a-dd06e8818b24 for instance with vm_state deleted and task_state None.
Nov 28 17:18:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:11 user nova-compute[75246]: INFO nova.compute.manager [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Detaching volume bc3ae79e-01f8-4868-8ee5-265749580237
Nov 28 17:18:12 user nova-compute[75246]: INFO nova.virt.block_device [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Attempting to driver detach volume bc3ae79e-01f8-4868-8ee5-265749580237 from mountpoint /dev/vdb
Nov 28 17:18:12 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Attempting to detach device vdb from instance 9885ad9e-10d1-4b86-afe4-252f543bc2ec from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:18:12 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:18:12 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:18:12 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:18:12 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:18:12 user nova-compute[75246]:   <serial>bc3ae79e-01f8-4868-8ee5-265749580237</serial>
Nov 28 17:18:12 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:18:12 user nova-compute[75246]: </disk>
Nov 28 17:18:12 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:18:12 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Successfully detached device vdb from instance 9885ad9e-10d1-4b86-afe4-252f543bc2ec from the persistent domain config.
Nov 28 17:18:12 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9885ad9e-10d1-4b86-afe4-252f543bc2ec from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:18:12 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:18:12 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:18:12 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:18:12 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:18:12 user nova-compute[75246]:   <serial>bc3ae79e-01f8-4868-8ee5-265749580237</serial>
Nov 28 17:18:12 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:18:12 user nova-compute[75246]: </disk>
Nov 28 17:18:12 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:18:12 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9885ad9e-10d1-4b86-afe4-252f543bc2ec {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:18:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-64c017bf-a0c5-4e3c-aa72-8dafbaeaa13b req-aa868bd2-f587-4dbb-bf84-7f1a1d8540d4 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Received event network-changed-aa057f8e-b65b-43d3-8d22-5c29f782178b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:14 user nova-compute[75246]: DEBUG nova.compute.manager [req-64c017bf-a0c5-4e3c-aa72-8dafbaeaa13b req-aa868bd2-f587-4dbb-bf84-7f1a1d8540d4 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Refreshing instance network info cache due to event network-changed-aa057f8e-b65b-43d3-8d22-5c29f782178b. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:18:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-64c017bf-a0c5-4e3c-aa72-8dafbaeaa13b req-aa868bd2-f587-4dbb-bf84-7f1a1d8540d4 service nova] Acquiring lock "refresh_cache-190d2e59-1de9-4b1b-8a0d-cd983f857f7e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:18:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-64c017bf-a0c5-4e3c-aa72-8dafbaeaa13b req-aa868bd2-f587-4dbb-bf84-7f1a1d8540d4 service nova] Acquired lock "refresh_cache-190d2e59-1de9-4b1b-8a0d-cd983f857f7e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:18:14 user nova-compute[75246]: DEBUG nova.network.neutron [req-64c017bf-a0c5-4e3c-aa72-8dafbaeaa13b req-aa868bd2-f587-4dbb-bf84-7f1a1d8540d4 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Refreshing network info cache for port aa057f8e-b65b-43d3-8d22-5c29f782178b {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:18:14 user nova-compute[75246]: DEBUG nova.network.neutron [req-64c017bf-a0c5-4e3c-aa72-8dafbaeaa13b req-aa868bd2-f587-4dbb-bf84-7f1a1d8540d4 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Updated VIF entry in instance network info cache for port aa057f8e-b65b-43d3-8d22-5c29f782178b. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:18:14 user nova-compute[75246]: DEBUG nova.network.neutron [req-64c017bf-a0c5-4e3c-aa72-8dafbaeaa13b req-aa868bd2-f587-4dbb-bf84-7f1a1d8540d4 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Updating instance_info_cache with network_info: [{"id": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "address": "fa:16:3e:8e:05:22", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa057f8e-b6", "ovs_interfaceid": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:18:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-64c017bf-a0c5-4e3c-aa72-8dafbaeaa13b req-aa868bd2-f587-4dbb-bf84-7f1a1d8540d4 service nova] Releasing lock "refresh_cache-190d2e59-1de9-4b1b-8a0d-cd983f857f7e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:15 user nova-compute[75246]: INFO nova.compute.manager [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Terminating instance
Nov 28 17:18:15 user nova-compute[75246]: DEBUG nova.compute.manager [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-0e82af50-2362-4fe1-bcfc-362b0baef438 req-f069cffd-be6b-4266-b8a4-1d08522a62f0 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Received event network-vif-unplugged-aa057f8e-b65b-43d3-8d22-5c29f782178b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0e82af50-2362-4fe1-bcfc-362b0baef438 req-f069cffd-be6b-4266-b8a4-1d08522a62f0 service nova] Acquiring lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0e82af50-2362-4fe1-bcfc-362b0baef438 req-f069cffd-be6b-4266-b8a4-1d08522a62f0 service nova] Lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0e82af50-2362-4fe1-bcfc-362b0baef438 req-f069cffd-be6b-4266-b8a4-1d08522a62f0 service nova] Lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-0e82af50-2362-4fe1-bcfc-362b0baef438 req-f069cffd-be6b-4266-b8a4-1d08522a62f0 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] No waiting events found dispatching network-vif-unplugged-aa057f8e-b65b-43d3-8d22-5c29f782178b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-0e82af50-2362-4fe1-bcfc-362b0baef438 req-f069cffd-be6b-4266-b8a4-1d08522a62f0 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Received event network-vif-unplugged-aa057f8e-b65b-43d3-8d22-5c29f782178b for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:15 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Instance destroyed successfully.
Nov 28 17:18:15 user nova-compute[75246]: DEBUG nova.objects.instance [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lazy-loading 'resources' on Instance uuid 190d2e59-1de9-4b1b-8a0d-cd983f857f7e {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:16:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-98931639',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-98931639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-98931639',id=37,image_ref='cbd02447-101a-4c8e-921a-e469dd22fc78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIoZdMJ1JbMvQQWSbyYKawFKat7RdC9rtgf9M0YWUoGc+I/HaUK8zJcY84yaB3GE4ECbwkjyO/3LTm+geoPA5izOTdNw6p3KGlwZsDkKo2s9U67150lrLZ+jcKs9E+a+g==',key_name='tempest-keypair-1103969097',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:16:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe0eebdd39c54a74be8d2e0f9842b165',ramdisk_id='',reservation_id='r-9nozsid7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-389869337',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-389869337',owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:16:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c334f73c5bf1473aadf865c8f032c0cb',uuid=190d2e59-1de9-4b1b-8a0d-cd983f857f7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "address": "fa:16:3e:8e:05:22", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa057f8e-b6", "ovs_interfaceid": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converting VIF {"id": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "address": "fa:16:3e:8e:05:22", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa057f8e-b6", "ovs_interfaceid": "aa057f8e-b65b-43d3-8d22-5c29f782178b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:05:22,bridge_name='br-int',has_traffic_filtering=True,id=aa057f8e-b65b-43d3-8d22-5c29f782178b,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa057f8e-b6') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG os_vif [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:05:22,bridge_name='br-int',has_traffic_filtering=True,id=aa057f8e-b65b-43d3-8d22-5c29f782178b,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa057f8e-b6') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa057f8e-b6, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52b898d0-ee47-467e-a2f0-f2ca4106d868) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:15 user nova-compute[75246]: INFO os_vif [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:05:22,bridge_name='br-int',has_traffic_filtering=True,id=aa057f8e-b65b-43d3-8d22-5c29f782178b,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa057f8e-b6')
Nov 28 17:18:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KNaGWDzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:18:15 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:18:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[56789292-0481-4651-9068-c4aef6f57dd5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:18:15 user nova-compute[75246]: No targets found.
Nov 28 17:18:15 user nova-compute[75246]: iSNS:
Nov 28 17:18:15 user nova-compute[75246]: No targets found.
Nov 28 17:18:15 user nova-compute[75246]: STATIC:
Nov 28 17:18:15 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237
Nov 28 17:18:15 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:18:15 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:18:15 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e
Nov 28 17:18:15 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:18:15 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:18:15 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a
Nov 28 17:18:15 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:18:15 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:18:15 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158
Nov 28 17:18:15 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:18:15 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:18:15 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:18:15 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:18:15 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:18:15 user nova-compute[75246]: FIRMWARE:
Nov 28 17:18:15 user nova-compute[75246]: No targets found.
Nov 28 17:18:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:18:15 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:18:15 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece8e524-eb57-4db3-9f64-f222481edc93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[765e842c-3bd0-4069-af7c-347f4ff22fd1]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:18:15 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:18:15 user nova-compute[75246]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)
Nov 28 17:18:15 user nova-compute[75246]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:18:15 user nova-compute[75246]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 (non-flash)
Nov 28 17:18:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:18:15 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:18:15 user nova-compute[75246]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a (non-flash)
Nov 28 17:18:15 user nova-compute[75246]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:18:15 user nova-compute[75246]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 (non-flash)
Nov 28 17:18:15 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d8199e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a'): ({'sdf'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Removing single pathed devices sdf {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db64835-efd7-438a-b1cb-b3b34b939209]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9637cb89-6a47-4da6-8357-8b5ff1a44f5e]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Flushing IO for device /dev/sdf {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae163e0-cdfa-49f6-88aa-9c4ceaefb3fe]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0107e165-6c93-4194-938a-d03131f6cc92]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] SCSI volumes sdf have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:18:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c18f66-774e-4eb6-aa5a-934f48ad2e18]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91f87d1-30d9-4575-b282-5a198b4fbc41]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a, portal: 172.16.0.220,3260]
Nov 28 17:18:16 user nova-compute[75246]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a, portal: 172.16.0.220,3260] successful.
Nov 28 17:18:16 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1a7a123-b95b-4581-af6c-7dee729a318a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6353b9-0d10-495e-9fc7-7a63812410b4]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] <== disconnect_volume: return (313ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:18:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Deleting instance files /opt/stack/data/nova/instances/190d2e59-1de9-4b1b-8a0d-cd983f857f7e_del
Nov 28 17:18:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Deletion of /opt/stack/data/nova/instances/190d2e59-1de9-4b1b-8a0d-cd983f857f7e_del complete
Nov 28 17:18:16 user nova-compute[75246]: INFO nova.compute.manager [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 28 17:18:16 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:18:16 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Took 0.69 seconds to deallocate network for instance.
Nov 28 17:18:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-95d89bb7-0eda-45f6-ad8a-ef5513b54730 req-277feeab-d903-4287-a38f-549fbe2c00f0 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Received event network-vif-deleted-aa057f8e-b65b-43d3-8d22-5c29f782178b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:16 user nova-compute[75246]: INFO nova.compute.manager [req-95d89bb7-0eda-45f6-ad8a-ef5513b54730 req-277feeab-d903-4287-a38f-549fbe2c00f0 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Neutron deleted interface aa057f8e-b65b-43d3-8d22-5c29f782178b; detaching it from the instance and deleting it from the info cache
Nov 28 17:18:16 user nova-compute[75246]: DEBUG nova.network.neutron [req-95d89bb7-0eda-45f6-ad8a-ef5513b54730 req-277feeab-d903-4287-a38f-549fbe2c00f0 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:18:16 user nova-compute[75246]: DEBUG nova.compute.manager [req-95d89bb7-0eda-45f6-ad8a-ef5513b54730 req-277feeab-d903-4287-a38f-549fbe2c00f0 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Detach interface failed, port_id=aa057f8e-b65b-43d3-8d22-5c29f782178b, reason: Instance 190d2e59-1de9-4b1b-8a0d-cd983f857f7e could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:18:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-80b2c159-4dd4-463c-8d90-9d0040213a90 req-c4b793ea-2a5f-4ff4-8701-091fe3626b40 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Received event network-vif-plugged-aa057f8e-b65b-43d3-8d22-5c29f782178b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-80b2c159-4dd4-463c-8d90-9d0040213a90 req-c4b793ea-2a5f-4ff4-8701-091fe3626b40 service nova] Acquiring lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-80b2c159-4dd4-463c-8d90-9d0040213a90 req-c4b793ea-2a5f-4ff4-8701-091fe3626b40 service nova] Lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-80b2c159-4dd4-463c-8d90-9d0040213a90 req-c4b793ea-2a5f-4ff4-8701-091fe3626b40 service nova] Lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-80b2c159-4dd4-463c-8d90-9d0040213a90 req-c4b793ea-2a5f-4ff4-8701-091fe3626b40 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] No waiting events found dispatching network-vif-plugged-aa057f8e-b65b-43d3-8d22-5c29f782178b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:18:17 user nova-compute[75246]: WARNING nova.compute.manager [req-80b2c159-4dd4-463c-8d90-9d0040213a90 req-c4b793ea-2a5f-4ff4-8701-091fe3626b40 service nova] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Received unexpected event network-vif-plugged-aa057f8e-b65b-43d3-8d22-5c29f782178b for instance with vm_state active and task_state deleting.
Nov 28 17:18:17 user nova-compute[75246]: INFO nova.compute.manager [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Took 0.89 seconds to detach 1 volumes for instance.
Nov 28 17:18:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 190d2e59-1de9-4b1b-8a0d-cd983f857f7e] Deleting volume: e1a7a123-b95b-4581-af6c-7dee729a318a {{(pid=75246) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 17:18:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:18 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:18:18 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:18:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:18 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Deleted allocations for instance 190d2e59-1de9-4b1b-8a0d-cd983f857f7e
Nov 28 17:18:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-43e5b8dc-d33e-46a5-a769-35c84ca727f3 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "190d2e59-1de9-4b1b-8a0d-cd983f857f7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.281s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:24 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 90829136-472b-4c45-9607-c28433d05f56 is timed out.
Nov 28 17:18:24 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Successfully detached device vdb from instance 90829136-472b-4c45-9607-c28433d05f56 from the live domain config.
Nov 28 17:18:24 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bWeKInFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:18:24 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef64acba-5e70-4e85-b7ee-e5c01b07b4ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:18:24 user nova-compute[75246]: No targets found.
Nov 28 17:18:24 user nova-compute[75246]: iSNS:
Nov 28 17:18:24 user nova-compute[75246]: No targets found.
Nov 28 17:18:24 user nova-compute[75246]: STATIC:
Nov 28 17:18:24 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237
Nov 28 17:18:24 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:18:24 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:18:24 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e
Nov 28 17:18:24 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:18:24 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:18:24 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158
Nov 28 17:18:24 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:18:24 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:18:24 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:18:24 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:18:24 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:18:24 user nova-compute[75246]: FIRMWARE:
Nov 28 17:18:24 user nova-compute[75246]: No targets found.
Nov 28 17:18:24 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:18:24 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:18:24 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cf592b-96fb-475d-a94e-abb4fb06d9fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf875dc-198c-4b5d-b272-d69a17727af9]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:18:24 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:18:24 user nova-compute[75246]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:18:24 user nova-compute[75246]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 (non-flash)
Nov 28 17:18:24 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 (non-flash)
Nov 28 17:18:24 user nova-compute[75246]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:18:24 user nova-compute[75246]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:18:24 user nova-compute[75246]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 (non-flash)
Nov 28 17:18:24 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d87c1900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158'): ({'sde'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Removing single pathed devices sde {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a05465-d11d-4c52-967d-80fbd22cad36]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f30391-4e26-4b09-9485-bd5085c567bf]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Flushing IO for device /dev/sde {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3d1431-5868-4acf-9a2a-38c7659d02f7]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a44627-ecb5-483c-8472-66193daccee6]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] SCSI volumes sde have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6871474d-e74a-492e-9528-db35469ba495]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6039761a-6f6e-490b-a14e-20b85be50e44]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158, portal: 172.16.0.220,3260]
Nov 28 17:18:24 user nova-compute[75246]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158, portal: 172.16.0.220,3260] successful.
Nov 28 17:18:24 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a00ba4-d68c-4715-abeb-e888a22a0158 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca156a78-a502-4159-b188-82d194895428]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] <== disconnect_volume: return (313ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:18:24 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:18:25 user nova-compute[75246]: DEBUG nova.objects.instance [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'flavor' on Instance uuid 90829136-472b-4c45-9607-c28433d05f56 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:18:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fda88fff-1142-4d09-94ab-c61ec4072089 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "90829136-472b-4c45-9607-c28433d05f56" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.974s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:18:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:18:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:32 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9885ad9e-10d1-4b86-afe4-252f543bc2ec is timed out.
Nov 28 17:18:32 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Successfully detached device vdb from instance 9885ad9e-10d1-4b86-afe4-252f543bc2ec from the live domain config.
Nov 28 17:18:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNxulaIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:18:32 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b302db-fb6b-4ff4-8ec8-f27b6d7f5edc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:18:32 user nova-compute[75246]: No targets found.
Nov 28 17:18:32 user nova-compute[75246]: iSNS:
Nov 28 17:18:32 user nova-compute[75246]: No targets found.
Nov 28 17:18:32 user nova-compute[75246]: STATIC:
Nov 28 17:18:32 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237
Nov 28 17:18:32 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:18:32 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:18:32 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e
Nov 28 17:18:32 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:18:32 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:18:32 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:18:32 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:18:32 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:18:32 user nova-compute[75246]: FIRMWARE:
Nov 28 17:18:32 user nova-compute[75246]: No targets found.
Nov 28 17:18:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:18:32 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:18:32 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27e8a99-32c9-485c-8a25-993b518236a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc258e2-2264-415c-a383-e525a5b28970]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:18:32 user nova-compute[75246]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:18:32 user nova-compute[75246]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 (non-flash)
Nov 28 17:18:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:18:32 user nova-compute[75246]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:18:32 user nova-compute[75246]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 (non-flash)
Nov 28 17:18:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d815bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237'): ({'sdc'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Removing single pathed devices sdc {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5047514-f4ec-4ddc-9684-4d498bb6ce8c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5476c2a-6946-405f-a022-79c8de84720c]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Flushing IO for device /dev/sdc {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e9f89a-c360-4433-aa87-35ec43df77a7]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b136ca91-9fca-453b-a4c7-085a8fa39d23]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c624c03a-2167-48b0-b29c-f003413ca6c6]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2853d8-3a25-43ae-8754-ede9e12865a0]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237, portal: 172.16.0.220,3260]
Nov 28 17:18:32 user nova-compute[75246]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237, portal: 172.16.0.220,3260] successful.
Nov 28 17:18:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3ae79e-01f8-4868-8ee5-265749580237 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edc904f-9ac4-49c9-b829-3b6afd2aaf60]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] <== disconnect_volume: return (294ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:18:32 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:18:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:33 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:18:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "e1266470-c182-4c0c-a575-4c5043f54745" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "e1266470-c182-4c0c-a575-4c5043f54745" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "e1266470-c182-4c0c-a575-4c5043f54745-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "e1266470-c182-4c0c-a575-4c5043f54745-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "e1266470-c182-4c0c-a575-4c5043f54745-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:34 user nova-compute[75246]: INFO nova.compute.manager [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Terminating instance
Nov 28 17:18:34 user nova-compute[75246]: DEBUG nova.compute.manager [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-8456f39b-b1f6-4504-bdb8-2f161c0c4257 req-747fcc59-872c-42f2-b3d4-322fcaa60b36 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Received event network-vif-unplugged-459bf491-d464-42b1-be6c-282af882a38d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8456f39b-b1f6-4504-bdb8-2f161c0c4257 req-747fcc59-872c-42f2-b3d4-322fcaa60b36 service nova] Acquiring lock "e1266470-c182-4c0c-a575-4c5043f54745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8456f39b-b1f6-4504-bdb8-2f161c0c4257 req-747fcc59-872c-42f2-b3d4-322fcaa60b36 service nova] Lock "e1266470-c182-4c0c-a575-4c5043f54745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8456f39b-b1f6-4504-bdb8-2f161c0c4257 req-747fcc59-872c-42f2-b3d4-322fcaa60b36 service nova] Lock "e1266470-c182-4c0c-a575-4c5043f54745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-8456f39b-b1f6-4504-bdb8-2f161c0c4257 req-747fcc59-872c-42f2-b3d4-322fcaa60b36 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] No waiting events found dispatching network-vif-unplugged-459bf491-d464-42b1-be6c-282af882a38d {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-8456f39b-b1f6-4504-bdb8-2f161c0c4257 req-747fcc59-872c-42f2-b3d4-322fcaa60b36 service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Received event network-vif-unplugged-459bf491-d464-42b1-be6c-282af882a38d for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG nova.objects.instance [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lazy-loading 'flavor' on Instance uuid 9885ad9e-10d1-4b86-afe4-252f543bc2ec {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fd038a30-cc62-4aa6-bd3d-a135fc3b6063 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.919s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Instance destroyed successfully.
Nov 28 17:18:34 user nova-compute[75246]: DEBUG nova.objects.instance [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lazy-loading 'resources' on Instance uuid e1266470-c182-4c0c-a575-4c5043f54745 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1210409474',display_name='tempest-ServerActionsTestOtherA-server-1210409474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1210409474',id=2,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5QoCu8z1J19YdF2KrIxtAcllUa+54ECbo+7UcXNC+vRRLTiAkI9KGg17d3KrbHvU7U2QxVzma0Ilz+ryH1d5iWfmR7mKkbwqDpkhmRExCuSVuBHZfoiX/4Pew1wkkhqw==',key_name='tempest-keypair-745476775',keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:59:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be06eee4e74a41b799f1df75ea55b955',ramdisk_id='',reservation_id='r-y588jx2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1554281978',owner_user_name='tempest-ServerActionsTestOtherA-1554281978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T16:59:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39d2eb0837eb4c729fe9ca2964cbe789',uuid=e1266470-c182-4c0c-a575-4c5043f54745,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "459bf491-d464-42b1-be6c-282af882a38d", "address": "fa:16:3e:4f:20:c2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459bf491-d4", "ovs_interfaceid": "459bf491-d464-42b1-be6c-282af882a38d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converting VIF {"id": "459bf491-d464-42b1-be6c-282af882a38d", "address": "fa:16:3e:4f:20:c2", "network": {"id": "6c3b4002-f583-4b88-bf32-5f638535c10b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-852273520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be06eee4e74a41b799f1df75ea55b955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap459bf491-d4", "ovs_interfaceid": "459bf491-d464-42b1-be6c-282af882a38d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=459bf491-d464-42b1-be6c-282af882a38d,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459bf491-d4') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG os_vif [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=459bf491-d464-42b1-be6c-282af882a38d,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459bf491-d4') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap459bf491-d4, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdf75c3d-8c6e-4a55-9ee6-68e667c90019) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:34 user nova-compute[75246]: INFO os_vif [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=459bf491-d464-42b1-be6c-282af882a38d,network=Network(6c3b4002-f583-4b88-bf32-5f638535c10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap459bf491-d4')
Nov 28 17:18:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Deleting instance files /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745_del
Nov 28 17:18:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Deletion of /opt/stack/data/nova/instances/e1266470-c182-4c0c-a575-4c5043f54745_del complete
Nov 28 17:18:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:35 user nova-compute[75246]: INFO nova.compute.manager [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 28 17:18:35 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: e1266470-c182-4c0c-a575-4c5043f54745] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:18:35 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Took 0.44 seconds to deallocate network for instance.
Nov 28 17:18:35 user nova-compute[75246]: DEBUG nova.compute.manager [req-0bbd12c2-3ced-4b74-81da-fdcd6986b86b req-84e5ce17-b78c-42cc-a281-ba2cd0f8251e service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Received event network-vif-deleted-459bf491-d464-42b1-be6c-282af882a38d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:35 user nova-compute[75246]: INFO nova.compute.manager [req-0bbd12c2-3ced-4b74-81da-fdcd6986b86b req-84e5ce17-b78c-42cc-a281-ba2cd0f8251e service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Neutron deleted interface 459bf491-d464-42b1-be6c-282af882a38d; detaching it from the instance and deleting it from the info cache
Nov 28 17:18:35 user nova-compute[75246]: DEBUG nova.network.neutron [req-0bbd12c2-3ced-4b74-81da-fdcd6986b86b req-84e5ce17-b78c-42cc-a281-ba2cd0f8251e service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG nova.compute.manager [req-0bbd12c2-3ced-4b74-81da-fdcd6986b86b req-84e5ce17-b78c-42cc-a281-ba2cd0f8251e service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Detach interface failed, port_id=459bf491-d464-42b1-be6c-282af882a38d, reason: Instance e1266470-c182-4c0c-a575-4c5043f54745 could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.006s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:18:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:36 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Deleted allocations for instance e1266470-c182-4c0c-a575-4c5043f54745
Nov 28 17:18:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-93b6b7be-0bd5-4cb5-bf52-33f5513f48e7 tempest-ServerActionsTestOtherA-1554281978 tempest-ServerActionsTestOtherA-1554281978-project-member] Lock "e1266470-c182-4c0c-a575-4c5043f54745" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.007s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-96c979b1-3692-4af3-82db-90706582ec55 req-57a5a450-8b92-4259-bb5d-400f8a6eff2a service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Received event network-vif-plugged-459bf491-d464-42b1-be6c-282af882a38d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-96c979b1-3692-4af3-82db-90706582ec55 req-57a5a450-8b92-4259-bb5d-400f8a6eff2a service nova] Acquiring lock "e1266470-c182-4c0c-a575-4c5043f54745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-96c979b1-3692-4af3-82db-90706582ec55 req-57a5a450-8b92-4259-bb5d-400f8a6eff2a service nova] Lock "e1266470-c182-4c0c-a575-4c5043f54745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-96c979b1-3692-4af3-82db-90706582ec55 req-57a5a450-8b92-4259-bb5d-400f8a6eff2a service nova] Lock "e1266470-c182-4c0c-a575-4c5043f54745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-96c979b1-3692-4af3-82db-90706582ec55 req-57a5a450-8b92-4259-bb5d-400f8a6eff2a service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] No waiting events found dispatching network-vif-plugged-459bf491-d464-42b1-be6c-282af882a38d {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:18:36 user nova-compute[75246]: WARNING nova.compute.manager [req-96c979b1-3692-4af3-82db-90706582ec55 req-57a5a450-8b92-4259-bb5d-400f8a6eff2a service nova] [instance: e1266470-c182-4c0c-a575-4c5043f54745] Received unexpected event network-vif-plugged-459bf491-d464-42b1-be6c-282af882a38d for instance with vm_state deleted and task_state None.
Nov 28 17:18:36 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:18:36 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:18:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=7787MB free_disk=25.22142791748047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c94900af-f484-47bf-8627-8aa863334b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 90829136-472b-4c45-9607-c28433d05f56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 0fb728b1-9a86-412e-b37e-57a072164534 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 9885ad9e-10d1-4b86-afe4-252f543bc2ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a796152e-e8df-41bf-a5ea-ae94d4fa8b41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 5175a016-3237-4e79-bc77-4b72e5402695 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:18:36 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:18:37 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:18:37 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:18:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:18:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:18:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:18:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:18:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:18:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:18:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:18:40 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:18:42 user nova-compute[75246]: INFO nova.compute.manager [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Rescuing
Nov 28 17:18:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:18:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquired lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:18:42 user nova-compute[75246]: DEBUG nova.network.neutron [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:18:42 user nova-compute[75246]: DEBUG nova.network.neutron [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Updating instance_info_cache with network_info: [{"id": "a311cb50-be83-4bf0-b889-d02170d667d6", "address": "fa:16:3e:65:bd:fb", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa311cb50-be", "ovs_interfaceid": "a311cb50-be83-4bf0-b889-d02170d667d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:18:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Releasing lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:18:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:42 user nova-compute[75246]: DEBUG nova.compute.manager [req-98d5e6bc-db08-4862-9511-644b710d29e1 req-2b1265fd-27ce-4e5d-a3f3-b45d07356e22 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-vif-unplugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-98d5e6bc-db08-4862-9511-644b710d29e1 req-2b1265fd-27ce-4e5d-a3f3-b45d07356e22 service nova] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-98d5e6bc-db08-4862-9511-644b710d29e1 req-2b1265fd-27ce-4e5d-a3f3-b45d07356e22 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-98d5e6bc-db08-4862-9511-644b710d29e1 req-2b1265fd-27ce-4e5d-a3f3-b45d07356e22 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:42 user nova-compute[75246]: DEBUG nova.compute.manager [req-98d5e6bc-db08-4862-9511-644b710d29e1 req-2b1265fd-27ce-4e5d-a3f3-b45d07356e22 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] No waiting events found dispatching network-vif-unplugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:18:42 user nova-compute[75246]: WARNING nova.compute.manager [req-98d5e6bc-db08-4862-9511-644b710d29e1 req-2b1265fd-27ce-4e5d-a3f3-b45d07356e22 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received unexpected event network-vif-unplugged-a311cb50-be83-4bf0-b889-d02170d667d6 for instance with vm_state active and task_state rescuing.
Nov 28 17:18:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:18:42 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:18:43 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:18:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:43 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Instance destroyed successfully.
Nov 28 17:18:43 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Attempting a stable device rescue
Nov 28 17:18:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75246) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 17:18:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Instance directory exists: not creating {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 17:18:43 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Creating image(s)
Nov 28 17:18:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "/opt/stack/data/nova/instances/a796152e-e8df-41bf-a5ea-ae94d4fa8b41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "/opt/stack/data/nova/instances/a796152e-e8df-41bf-a5ea-ae94d4fa8b41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "/opt/stack/data/nova/instances/a796152e-e8df-41bf-a5ea-ae94d4fa8b41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:43 user nova-compute[75246]: DEBUG nova.objects.instance [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'trusted_certs' on Instance uuid a796152e-e8df-41bf-a5ea-ae94d4fa8b41 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:18:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "f0741349bd1a14c0c22dd4b3fac72ec41cd4324b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "f0741349bd1a14c0c22dd4b3fac72ec41cd4324b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0741349bd1a14c0c22dd4b3fac72ec41cd4324b.part --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0741349bd1a14c0c22dd4b3fac72ec41cd4324b.part --force-share --output=json" returned: 0 in 0.169s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG nova.virt.images [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] cddf4c20-e6a8-45ea-8e83-0e5fa2fc860d was qcow2, converting to raw {{(pid=75246) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG nova.privsep.utils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75246) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f0741349bd1a14c0c22dd4b3fac72ec41cd4324b.part /opt/stack/data/nova/instances/_base/f0741349bd1a14c0c22dd4b3fac72ec41cd4324b.converted {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] No waiting events found dispatching network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:18:44 user nova-compute[75246]: WARNING nova.compute.manager [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received unexpected event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 for instance with vm_state active and task_state rescuing.
Nov 28 17:18:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] No waiting events found dispatching network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:18:44 user nova-compute[75246]: WARNING nova.compute.manager [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received unexpected event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 for instance with vm_state active and task_state rescuing.
Nov 28 17:18:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] No waiting events found dispatching network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:18:44 user nova-compute[75246]: WARNING nova.compute.manager [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received unexpected event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 for instance with vm_state active and task_state rescuing.
Nov 28 17:18:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-vif-unplugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] No waiting events found dispatching network-vif-unplugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:18:44 user nova-compute[75246]: WARNING nova.compute.manager [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received unexpected event network-vif-unplugged-a311cb50-be83-4bf0-b889-d02170d667d6 for instance with vm_state active and task_state rescuing.
Nov 28 17:18:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] No waiting events found dispatching network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:18:44 user nova-compute[75246]: WARNING nova.compute.manager [req-3a7fdcf7-6f78-4709-bdf8-ad5266a63804 req-60bfc3c7-7e30-41e6-a6cd-f113565b19c3 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received unexpected event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 for instance with vm_state active and task_state rescuing.
Nov 28 17:18:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f0741349bd1a14c0c22dd4b3fac72ec41cd4324b.part /opt/stack/data/nova/instances/_base/f0741349bd1a14c0c22dd4b3fac72ec41cd4324b.converted" returned: 0 in 0.507s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0741349bd1a14c0c22dd4b3fac72ec41cd4324b.converted --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0741349bd1a14c0c22dd4b3fac72ec41cd4324b.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "f0741349bd1a14c0c22dd4b3fac72ec41cd4324b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.929s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "f0741349bd1a14c0c22dd4b3fac72ec41cd4324b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "f0741349bd1a14c0c22dd4b3fac72ec41cd4324b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0741349bd1a14c0c22dd4b3fac72ec41cd4324b --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0741349bd1a14c0c22dd4b3fac72ec41cd4324b --force-share --output=json" returned: 0 in 0.176s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0741349bd1a14c0c22dd4b3fac72ec41cd4324b,backing_fmt=raw /opt/stack/data/nova/instances/a796152e-e8df-41bf-a5ea-ae94d4fa8b41/disk.rescue {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0741349bd1a14c0c22dd4b3fac72ec41cd4324b,backing_fmt=raw /opt/stack/data/nova/instances/a796152e-e8df-41bf-a5ea-ae94d4fa8b41/disk.rescue" returned: 0 in 0.052s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "f0741349bd1a14c0c22dd4b3fac72ec41cd4324b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.objects.instance [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'migration_context' on Instance uuid a796152e-e8df-41bf-a5ea-ae94d4fa8b41 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.objects.base [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Object Instance<a796152e-e8df-41bf-a5ea-ae94d4fa8b41> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Start _get_guest_xml network_info=[{"id": "a311cb50-be83-4bf0-b889-d02170d667d6", "address": "fa:16:3e:65:bd:fb", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "vif_mac": "fa:16:3e:65:bd:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa311cb50-be", "ovs_interfaceid": "a311cb50-be83-4bf0-b889-d02170d667d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cddf4c20-e6a8-45ea-8e83-0e5fa2fc860d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '45e38b49-ea00-403b-9dea-59caf2543174', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ueoZRldz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a796152e-e8df-41bf-a5ea-ae94d4fa8b41', 'attached_at': '', 'detached_at': '', 'volume_id': '0e71659f-575e-45b1-81fb-67856b67b435', 'serial': '0e71659f-575e-45b1-81fb-67856b67b435'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.objects.instance [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'resources' on Instance uuid a796152e-e8df-41bf-a5ea-ae94d4fa8b41 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.objects.base [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Object Instance<a796152e-e8df-41bf-a5ea-ae94d4fa8b41> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.objects.instance [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'numa_topology' on Instance uuid a796152e-e8df-41bf-a5ea-ae94d4fa8b41 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.objects.base [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Object Instance<a796152e-e8df-41bf-a5ea-ae94d4fa8b41> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:18:45 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:18:45 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.objects.instance [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'vcpu_model' on Instance uuid a796152e-e8df-41bf-a5ea-ae94d4fa8b41 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.objects.base [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Object Instance<a796152e-e8df-41bf-a5ea-ae94d4fa8b41> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ueoZRldz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:18:45 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:18:45 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:18:45 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db9322a-8e92-4eec-bb80-1af35ef1ae03]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ueoZRldz\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 17:18:45 user nova-compute[75246]: node.name = iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:18:45 user nova-compute[75246]: node.tpgt = -1
Nov 28 17:18:45 user nova-compute[75246]: node.startup = automatic
Nov 28 17:18:45 user nova-compute[75246]: node.leading_login = No
Nov 28 17:18:45 user nova-compute[75246]: iface.iscsi_ifacename = default
Nov 28 17:18:45 user nova-compute[75246]: iface.net_ifacename = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.ipaddress = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.prefix_len = 0
Nov 28 17:18:45 user nova-compute[75246]: iface.hwaddress = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.transport_name = tcp
Nov 28 17:18:45 user nova-compute[75246]: iface.initiatorname = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.state = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.vlan_id = 0
Nov 28 17:18:45 user nova-compute[75246]: iface.vlan_priority = 0
Nov 28 17:18:45 user nova-compute[75246]: iface.vlan_state = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.iface_num = 0
Nov 28 17:18:45 user nova-compute[75246]: iface.mtu = 0
Nov 28 17:18:45 user nova-compute[75246]: iface.port = 0
Nov 28 17:18:45 user nova-compute[75246]: iface.bootproto = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.subnet_mask = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.gateway = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.dhcp_alt_client_id = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.dhcp_dns = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.dhcp_learn_iqn = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.dhcp_vendor_id_state = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.dhcp_vendor_id = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.dhcp_slp_da = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.fragmentation = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.gratuitous_arp = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.incoming_forwarding = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.tos_state = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.tos = 0
Nov 28 17:18:45 user nova-compute[75246]: iface.ttl = 0
Nov 28 17:18:45 user nova-compute[75246]: iface.delayed_ack = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.tcp_nagle = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.tcp_wsf_state = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.tcp_wsf = 0
Nov 28 17:18:45 user nova-compute[75246]: iface.tcp_timer_scale = 0
Nov 28 17:18:45 user nova-compute[75246]: iface.tcp_timestamp = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.redirect = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.def_task_mgmt_timeout = 0
Nov 28 17:18:45 user nova-compute[75246]: iface.header_digest = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.data_digest = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.immediate_data = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.initial_r2t = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.data_seq_inorder = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.data_pdu_inorder = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.erl = 0
Nov 28 17:18:45 user nova-compute[75246]: iface.max_receive_data_len = 0
Nov 28 17:18:45 user nova-compute[75246]: iface.first_burst_len = 0
Nov 28 17:18:45 user nova-compute[75246]: iface.max_outstanding_r2t = 0
Nov 28 17:18:45 user nova-compute[75246]: iface.max_burst_len = 0
Nov 28 17:18:45 user nova-compute[75246]: iface.chap_auth = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.bidi_chap = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.strict_login_compliance = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.discovery_auth = <empty>
Nov 28 17:18:45 user nova-compute[75246]: iface.discovery_logout = <empty>
Nov 28 17:18:45 user nova-compute[75246]: node.discovery_address = <empty>
Nov 28 17:18:45 user nova-compute[75246]: node.discovery_port = 0
Nov 28 17:18:45 user nova-compute[75246]: node.discovery_type = static
Nov 28 17:18:45 user nova-compute[75246]: node.session.initial_cmdsn = 0
Nov 28 17:18:45 user nova-compute[75246]: node.session.initial_login_retry_max = 8
Nov 28 17:18:45 user nova-compute[75246]: node.session.xmit_thread_priority = -20
Nov 28 17:18:45 user nova-compute[75246]: node.session.cmds_max = 128
Nov 28 17:18:45 user nova-compute[75246]: node.session.queue_depth = 32
Nov 28 17:18:45 user nova-compute[75246]: node.session.nr_sessions = 1
Nov 28 17:18:45 user nova-compute[75246]: node.session.auth.authmethod = CHAP
Nov 28 17:18:45 user nova-compute[75246]: node.session.auth.username = ueoZRldz
Nov 28 17:18:45 user nova-compute[75246]: node.session.auth.password = ***
Nov 28 17:18:45 user nova-compute[75246]: node.session.auth.username_in = <empty>
Nov 28 17:18:45 user nova-compute[75246]: node.session.auth.password_in = <empty>
Nov 28 17:18:45 user nova-compute[75246]: node.session.auth.chap_algs = MD5
Nov 28 17:18:45 user nova-compute[75246]: node.session.timeo.replacement_timeout = 120
Nov 28 17:18:45 user nova-compute[75246]: node.session.err_timeo.abort_timeout = 15
Nov 28 17:18:45 user nova-compute[75246]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 17:18:45 user nova-compute[75246]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 17:18:45 user nova-compute[75246]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 17:18:45 user nova-compute[75246]: node.session.iscsi.FastAbort = Yes
Nov 28 17:18:45 user nova-compute[75246]: node.session.iscsi.InitialR2T = No
Nov 28 17:18:45 user nova-compute[75246]: node.session.iscsi.ImmediateData = Yes
Nov 28 17:18:45 user nova-compute[75246]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 17:18:45 user nova-compute[75246]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 17:18:45 user nova-compute[75246]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 17:18:45 user nova-compute[75246]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 17:18:45 user nova-compute[75246]: node.session.iscsi.MaxConnections = 1
Nov 28 17:18:45 user nova-compute[75246]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 17:18:45 user nova-compute[75246]: node.session.iscsi.ERL = 0
Nov 28 17:18:45 user nova-compute[75246]: node.session.scan = manual
Nov 28 17:18:45 user nova-compute[75246]: node.session.reopen_max = 0
Nov 28 17:18:45 user nova-compute[75246]: node.conn[0].address = 172.16.0.220
Nov 28 17:18:45 user nova-compute[75246]: node.conn[0].port = 3260
Nov 28 17:18:45 user nova-compute[75246]: node.conn[0].startup = manual
Nov 28 17:18:45 user nova-compute[75246]: node.conn[0].tcp.window_size = 524288
Nov 28 17:18:45 user nova-compute[75246]: node.conn[0].tcp.type_of_service = 0
Nov 28 17:18:45 user nova-compute[75246]: node.conn[0].timeo.logout_timeout = 15
Nov 28 17:18:45 user nova-compute[75246]: node.conn[0].timeo.login_timeout = 15
Nov 28 17:18:45 user nova-compute[75246]: node.conn[0].timeo.auth_timeout = 45
Nov 28 17:18:45 user nova-compute[75246]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 17:18:45 user nova-compute[75246]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 17:18:45 user nova-compute[75246]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 17:18:45 user nova-compute[75246]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 17:18:45 user nova-compute[75246]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 17:18:45 user nova-compute[75246]: node.conn[0].iscsi.DataDigest = None
Nov 28 17:18:45 user nova-compute[75246]: node.conn[0].iscsi.IFMarker = No
Nov 28 17:18:45 user nova-compute[75246]: node.conn[0].iscsi.OFMarker = No
Nov 28 17:18:45 user nova-compute[75246]: # END RECORD
Nov 28 17:18:45 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a6757c-5685-4fd5-9278-0aba5ada4496]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa82eb77-567a-4fcc-bdf1-5f37c4501ace]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ueoZRldz {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ueoZRldz" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e78e9d-73ae-4a0a-9c7c-bc8f170ca93d]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ueoZRldz'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c280e0d-2e45-4096-a092-070f3273c7b6]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd1225c-afeb-4452-a648-67b8d5ce35f6]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:18:45 user nova-compute[75246]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:18:45 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:18:45 user nova-compute[75246]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:18:45 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.137s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] HCTL ('33', '0', '0', 0) found on session 41 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0641339a-c2c0-4b90-91f9-e3bec05ce664]: (4, ('0 0 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Searching for a device in session 41 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ueoZRldz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.158s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] <== connect_volume: return (159ms) {'type': 'block', 'scsi_wwn': '26438356536323532', 'path': '/dev/sdb'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438356536323532', 'path': '/dev/sdb'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:16:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1508108904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1508108904',id=38,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:17:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faec5bcef3e2441fba30b593c13d5516',ramdisk_id='',reservation_id='r-39xyyd05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-506006079',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:17:11Z,user_data=None,user_id='af8b6c3f092547dbbf3debe96c594590',uuid=a796152e-e8df-41bf-a5ea-ae94d4fa8b41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a311cb50-be83-4bf0-b889-d02170d667d6", "address": "fa:16:3e:65:bd:fb", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "vif_mac": "fa:16:3e:65:bd:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa311cb50-be", "ovs_interfaceid": "a311cb50-be83-4bf0-b889-d02170d667d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converting VIF {"id": "a311cb50-be83-4bf0-b889-d02170d667d6", "address": "fa:16:3e:65:bd:fb", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "vif_mac": "fa:16:3e:65:bd:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa311cb50-be", "ovs_interfaceid": "a311cb50-be83-4bf0-b889-d02170d667d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:bd:fb,bridge_name='br-int',has_traffic_filtering=True,id=a311cb50-be83-4bf0-b889-d02170d667d6,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa311cb50-be') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.objects.instance [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'pci_devices' on Instance uuid a796152e-e8df-41bf-a5ea-ae94d4fa8b41 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.objects.base [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Object Instance<a796152e-e8df-41bf-a5ea-ae94d4fa8b41> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:18:45 user nova-compute[75246]:   <uuid>a796152e-e8df-41bf-a5ea-ae94d4fa8b41</uuid>
Nov 28 17:18:45 user nova-compute[75246]:   <name>instance-00000026</name>
Nov 28 17:18:45 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:18:45 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:18:45 user nova-compute[75246]:   <metadata>
Nov 28 17:18:45 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:18:45 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:18:45 user nova-compute[75246]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1508108904</nova:name>
Nov 28 17:18:45 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:18:45</nova:creationTime>
Nov 28 17:18:45 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:18:45 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:18:45 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:18:45 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:18:45 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:18:45 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:18:45 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:18:45 user nova-compute[75246]:       <nova:owner>
Nov 28 17:18:45 user nova-compute[75246]:         <nova:user uuid="af8b6c3f092547dbbf3debe96c594590">tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member</nova:user>
Nov 28 17:18:45 user nova-compute[75246]:         <nova:project uuid="faec5bcef3e2441fba30b593c13d5516">tempest-ServerBootFromVolumeStableRescueTest-506006079</nova:project>
Nov 28 17:18:45 user nova-compute[75246]:       </nova:owner>
Nov 28 17:18:45 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:18:45 user nova-compute[75246]:       <nova:ports>
Nov 28 17:18:45 user nova-compute[75246]:         <nova:port uuid="a311cb50-be83-4bf0-b889-d02170d667d6">
Nov 28 17:18:45 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 17:18:45 user nova-compute[75246]:         </nova:port>
Nov 28 17:18:45 user nova-compute[75246]:       </nova:ports>
Nov 28 17:18:45 user nova-compute[75246]:     </nova:instance>
Nov 28 17:18:45 user nova-compute[75246]:   </metadata>
Nov 28 17:18:45 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:18:45 user nova-compute[75246]:     <system>
Nov 28 17:18:45 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:18:45 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:18:45 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:18:45 user nova-compute[75246]:       <entry name="serial">a796152e-e8df-41bf-a5ea-ae94d4fa8b41</entry>
Nov 28 17:18:45 user nova-compute[75246]:       <entry name="uuid">a796152e-e8df-41bf-a5ea-ae94d4fa8b41</entry>
Nov 28 17:18:45 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:18:45 user nova-compute[75246]:     </system>
Nov 28 17:18:45 user nova-compute[75246]:   </sysinfo>
Nov 28 17:18:45 user nova-compute[75246]:   <os>
Nov 28 17:18:45 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:18:45 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:18:45 user nova-compute[75246]:   </os>
Nov 28 17:18:45 user nova-compute[75246]:   <features>
Nov 28 17:18:45 user nova-compute[75246]:     <acpi/>
Nov 28 17:18:45 user nova-compute[75246]:     <apic/>
Nov 28 17:18:45 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:18:45 user nova-compute[75246]:   </features>
Nov 28 17:18:45 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:18:45 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:18:45 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:18:45 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:18:45 user nova-compute[75246]:   </clock>
Nov 28 17:18:45 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:18:45 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:18:45 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:18:45 user nova-compute[75246]:   </cpu>
Nov 28 17:18:45 user nova-compute[75246]:   <devices>
Nov 28 17:18:45 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:18:45 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:18:45 user nova-compute[75246]:       <source dev="/dev/sdb"/>
Nov 28 17:18:45 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:18:45 user nova-compute[75246]:       <serial>0e71659f-575e-45b1-81fb-67856b67b435</serial>
Nov 28 17:18:45 user nova-compute[75246]:     </disk>
Nov 28 17:18:45 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:18:45 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:18:45 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/a796152e-e8df-41bf-a5ea-ae94d4fa8b41/disk.rescue"/>
Nov 28 17:18:45 user nova-compute[75246]:       <target dev="vdb" bus="virtio"/>
Nov 28 17:18:45 user nova-compute[75246]:       <boot order="1"/>
Nov 28 17:18:45 user nova-compute[75246]:     </disk>
Nov 28 17:18:45 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:18:45 user nova-compute[75246]:       <mac address="fa:16:3e:65:bd:fb"/>
Nov 28 17:18:45 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:18:45 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:18:45 user nova-compute[75246]:       <target dev="tapa311cb50-be"/>
Nov 28 17:18:45 user nova-compute[75246]:     </interface>
Nov 28 17:18:45 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:18:45 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/a796152e-e8df-41bf-a5ea-ae94d4fa8b41/console.log" append="off"/>
Nov 28 17:18:45 user nova-compute[75246]:     </serial>
Nov 28 17:18:45 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:18:45 user nova-compute[75246]:     <video>
Nov 28 17:18:45 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:18:45 user nova-compute[75246]:     </video>
Nov 28 17:18:45 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:18:45 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:18:45 user nova-compute[75246]:     </rng>
Nov 28 17:18:45 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:18:45 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:18:45 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:18:45 user nova-compute[75246]:     </memballoon>
Nov 28 17:18:45 user nova-compute[75246]:   </devices>
Nov 28 17:18:45 user nova-compute[75246]: </domain>
Nov 28 17:18:45 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:18:45 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Instance destroyed successfully.
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:18:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] No VIF found with MAC fa:16:3e:65:bd:fb, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:18:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:47 user nova-compute[75246]: DEBUG nova.compute.manager [req-5f06ef00-9078-4786-aac7-d88acc03abea req-3313f1fd-09e2-4eb6-b698-d8cb1ee39d92 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5f06ef00-9078-4786-aac7-d88acc03abea req-3313f1fd-09e2-4eb6-b698-d8cb1ee39d92 service nova] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5f06ef00-9078-4786-aac7-d88acc03abea req-3313f1fd-09e2-4eb6-b698-d8cb1ee39d92 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5f06ef00-9078-4786-aac7-d88acc03abea req-3313f1fd-09e2-4eb6-b698-d8cb1ee39d92 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:47 user nova-compute[75246]: DEBUG nova.compute.manager [req-5f06ef00-9078-4786-aac7-d88acc03abea req-3313f1fd-09e2-4eb6-b698-d8cb1ee39d92 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] No waiting events found dispatching network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:18:47 user nova-compute[75246]: WARNING nova.compute.manager [req-5f06ef00-9078-4786-aac7-d88acc03abea req-3313f1fd-09e2-4eb6-b698-d8cb1ee39d92 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received unexpected event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 for instance with vm_state active and task_state rescuing.
Nov 28 17:18:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-34ee8892-4a24-4d41-9fde-f6939840033d req-16ece8be-ed7f-4cbf-8fff-828be70f6bbe service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-34ee8892-4a24-4d41-9fde-f6939840033d req-16ece8be-ed7f-4cbf-8fff-828be70f6bbe service nova] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-34ee8892-4a24-4d41-9fde-f6939840033d req-16ece8be-ed7f-4cbf-8fff-828be70f6bbe service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-34ee8892-4a24-4d41-9fde-f6939840033d req-16ece8be-ed7f-4cbf-8fff-828be70f6bbe service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-34ee8892-4a24-4d41-9fde-f6939840033d req-16ece8be-ed7f-4cbf-8fff-828be70f6bbe service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] No waiting events found dispatching network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:18:49 user nova-compute[75246]: WARNING nova.compute.manager [req-34ee8892-4a24-4d41-9fde-f6939840033d req-16ece8be-ed7f-4cbf-8fff-828be70f6bbe service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received unexpected event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 for instance with vm_state active and task_state rescuing.
Nov 28 17:18:49 user nova-compute[75246]: DEBUG nova.compute.manager [None req-66761c5c-d2ef-4a20-9c96-38a97163876c tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:18:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "90829136-472b-4c45-9607-c28433d05f56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "90829136-472b-4c45-9607-c28433d05f56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "90829136-472b-4c45-9607-c28433d05f56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:53 user nova-compute[75246]: INFO nova.compute.manager [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Terminating instance
Nov 28 17:18:53 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:18:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG nova.compute.manager [req-28588260-e6f4-45ab-bde6-1dcae8711f81 req-b481aaab-52d8-4248-8161-7df7e68e7fa8 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received event network-vif-unplugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-28588260-e6f4-45ab-bde6-1dcae8711f81 req-b481aaab-52d8-4248-8161-7df7e68e7fa8 service nova] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-28588260-e6f4-45ab-bde6-1dcae8711f81 req-b481aaab-52d8-4248-8161-7df7e68e7fa8 service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-28588260-e6f4-45ab-bde6-1dcae8711f81 req-b481aaab-52d8-4248-8161-7df7e68e7fa8 service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG nova.compute.manager [req-28588260-e6f4-45ab-bde6-1dcae8711f81 req-b481aaab-52d8-4248-8161-7df7e68e7fa8 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] No waiting events found dispatching network-vif-unplugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG nova.compute.manager [req-28588260-e6f4-45ab-bde6-1dcae8711f81 req-b481aaab-52d8-4248-8161-7df7e68e7fa8 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received event network-vif-unplugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:54 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 90829136-472b-4c45-9607-c28433d05f56] Instance destroyed successfully.
Nov 28 17:18:54 user nova-compute[75246]: DEBUG nova.objects.instance [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'resources' on Instance uuid 90829136-472b-4c45-9607-c28433d05f56 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:12:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-904390000',display_name='tempest-ServerRescueNegativeTestJSON-server-904390000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-904390000',id=31,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZ87kIt1XgMGQQZuF6spI0RsdOfKq7otrdj2C3YZOeKitq4qaVEU4L/6TIfjjxxs5HbyoYdyOZFRxRzbLaO4PpN3Qz0YtRnNy3kiitPSO/VFgmaSMKcNRkWPgRAD8B1HQ==',key_name='tempest-keypair-929323611',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:14:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60768e53b1e3414cb05eaaf23d382493',ramdisk_id='',reservation_id='r-x1gqpe35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-220335783',owner_user_name='tempest-ServerRescueNegativeTestJSON-220335783-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:16:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b79c4440e4734a2f82b08de54ed61737',uuid=90829136-472b-4c45-9607-c28433d05f56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converting VIF {"id": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "address": "fa:16:3e:1a:7d:4a", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6b2b48-5c", "ovs_interfaceid": "5f6b2b48-5c6d-4528-95dd-e7eb24780e37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:7d:4a,bridge_name='br-int',has_traffic_filtering=True,id=5f6b2b48-5c6d-4528-95dd-e7eb24780e37,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6b2b48-5c') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG os_vif [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:7d:4a,bridge_name='br-int',has_traffic_filtering=True,id=5f6b2b48-5c6d-4528-95dd-e7eb24780e37,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6b2b48-5c') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f6b2b48-5c, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7abfbd25-ad67-4ce3-946a-48a2c4d73006) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:54 user nova-compute[75246]: INFO os_vif [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:7d:4a,bridge_name='br-int',has_traffic_filtering=True,id=5f6b2b48-5c6d-4528-95dd-e7eb24780e37,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6b2b48-5c')
Nov 28 17:18:54 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Deleting instance files /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56_del
Nov 28 17:18:54 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Deletion of /opt/stack/data/nova/instances/90829136-472b-4c45-9607-c28433d05f56_del complete
Nov 28 17:18:54 user nova-compute[75246]: INFO nova.compute.manager [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: 90829136-472b-4c45-9607-c28433d05f56] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 17:18:54 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 90829136-472b-4c45-9607-c28433d05f56] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:18:54 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 90829136-472b-4c45-9607-c28433d05f56] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:18:55 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 90829136-472b-4c45-9607-c28433d05f56] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:18:55 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 90829136-472b-4c45-9607-c28433d05f56] Took 0.74 seconds to deallocate network for instance.
Nov 28 17:18:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-110a4b51-0c4b-4790-a65c-5e6aa24ca3e0 req-27463e2d-adf1-4766-a325-603ec7037e7d service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received event network-vif-deleted-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:55 user nova-compute[75246]: INFO nova.compute.manager [req-110a4b51-0c4b-4790-a65c-5e6aa24ca3e0 req-27463e2d-adf1-4766-a325-603ec7037e7d service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Neutron deleted interface 5f6b2b48-5c6d-4528-95dd-e7eb24780e37; detaching it from the instance and deleting it from the info cache
Nov 28 17:18:55 user nova-compute[75246]: DEBUG nova.network.neutron [req-110a4b51-0c4b-4790-a65c-5e6aa24ca3e0 req-27463e2d-adf1-4766-a325-603ec7037e7d service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:18:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-110a4b51-0c4b-4790-a65c-5e6aa24ca3e0 req-27463e2d-adf1-4766-a325-603ec7037e7d service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Detach interface failed, port_id=5f6b2b48-5c6d-4528-95dd-e7eb24780e37, reason: Instance 90829136-472b-4c45-9607-c28433d05f56 could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:18:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:55 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:18:55 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:18:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:55 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Deleted allocations for instance 90829136-472b-4c45-9607-c28433d05f56
Nov 28 17:18:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b6d24cea-c1dd-417f-a6f3-df882d0aa743 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "90829136-472b-4c45-9607-c28433d05f56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.164s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:56 user nova-compute[75246]: DEBUG nova.compute.manager [req-f14919f6-8b2c-4404-b30f-6ba73aec9f43 req-8ad2eaea-a5b8-496e-a4f5-262c6371a601 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received event network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:18:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f14919f6-8b2c-4404-b30f-6ba73aec9f43 req-8ad2eaea-a5b8-496e-a4f5-262c6371a601 service nova] Acquiring lock "90829136-472b-4c45-9607-c28433d05f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:18:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f14919f6-8b2c-4404-b30f-6ba73aec9f43 req-8ad2eaea-a5b8-496e-a4f5-262c6371a601 service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:18:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f14919f6-8b2c-4404-b30f-6ba73aec9f43 req-8ad2eaea-a5b8-496e-a4f5-262c6371a601 service nova] Lock "90829136-472b-4c45-9607-c28433d05f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:18:56 user nova-compute[75246]: DEBUG nova.compute.manager [req-f14919f6-8b2c-4404-b30f-6ba73aec9f43 req-8ad2eaea-a5b8-496e-a4f5-262c6371a601 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] No waiting events found dispatching network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:18:56 user nova-compute[75246]: WARNING nova.compute.manager [req-f14919f6-8b2c-4404-b30f-6ba73aec9f43 req-8ad2eaea-a5b8-496e-a4f5-262c6371a601 service nova] [instance: 90829136-472b-4c45-9607-c28433d05f56] Received unexpected event network-vif-plugged-5f6b2b48-5c6d-4528-95dd-e7eb24780e37 for instance with vm_state deleted and task_state None.
Nov 28 17:18:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:18:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-9e508b8c-f937-4f05-9a22-1b975323cd5a req-b4fe0397-918c-40cc-bef8-047a59d4746c service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received event network-changed-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:19:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-9e508b8c-f937-4f05-9a22-1b975323cd5a req-b4fe0397-918c-40cc-bef8-047a59d4746c service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Refreshing instance network info cache due to event network-changed-f457a357-039b-4e32-b72a-9868e81dbb1b. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:19:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e508b8c-f937-4f05-9a22-1b975323cd5a req-b4fe0397-918c-40cc-bef8-047a59d4746c service nova] Acquiring lock "refresh_cache-5175a016-3237-4e79-bc77-4b72e5402695" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:19:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e508b8c-f937-4f05-9a22-1b975323cd5a req-b4fe0397-918c-40cc-bef8-047a59d4746c service nova] Acquired lock "refresh_cache-5175a016-3237-4e79-bc77-4b72e5402695" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:19:00 user nova-compute[75246]: DEBUG nova.network.neutron [req-9e508b8c-f937-4f05-9a22-1b975323cd5a req-b4fe0397-918c-40cc-bef8-047a59d4746c service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Refreshing network info cache for port f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:19:00 user nova-compute[75246]: DEBUG nova.network.neutron [req-9e508b8c-f937-4f05-9a22-1b975323cd5a req-b4fe0397-918c-40cc-bef8-047a59d4746c service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Updated VIF entry in instance network info cache for port f457a357-039b-4e32-b72a-9868e81dbb1b. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:19:00 user nova-compute[75246]: DEBUG nova.network.neutron [req-9e508b8c-f937-4f05-9a22-1b975323cd5a req-b4fe0397-918c-40cc-bef8-047a59d4746c service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Updating instance_info_cache with network_info: [{"id": "f457a357-039b-4e32-b72a-9868e81dbb1b", "address": "fa:16:3e:f8:4f:00", "network": {"id": "e7fee231-f986-4a20-8aa4-d9b0d120a12c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1360844364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd096414f864a1cb0d72e97161ee28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf457a357-03", "ovs_interfaceid": "f457a357-039b-4e32-b72a-9868e81dbb1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:19:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e508b8c-f937-4f05-9a22-1b975323cd5a req-b4fe0397-918c-40cc-bef8-047a59d4746c service nova] Releasing lock "refresh_cache-5175a016-3237-4e79-bc77-4b72e5402695" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:19:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:02 user nova-compute[75246]: INFO nova.compute.manager [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Terminating instance
Nov 28 17:19:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:19:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-53053621-b114-4a97-a139-2a104b499b4c req-e97d792e-0793-4379-95ab-62596df49015 service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Received event network-vif-unplugged-5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:19:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-53053621-b114-4a97-a139-2a104b499b4c req-e97d792e-0793-4379-95ab-62596df49015 service nova] Acquiring lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-53053621-b114-4a97-a139-2a104b499b4c req-e97d792e-0793-4379-95ab-62596df49015 service nova] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-53053621-b114-4a97-a139-2a104b499b4c req-e97d792e-0793-4379-95ab-62596df49015 service nova] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-53053621-b114-4a97-a139-2a104b499b4c req-e97d792e-0793-4379-95ab-62596df49015 service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] No waiting events found dispatching network-vif-unplugged-5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:19:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-53053621-b114-4a97-a139-2a104b499b4c req-e97d792e-0793-4379-95ab-62596df49015 service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Received event network-vif-unplugged-5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:19:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:03 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Instance destroyed successfully.
Nov 28 17:19:03 user nova-compute[75246]: DEBUG nova.objects.instance [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lazy-loading 'resources' on Instance uuid 9885ad9e-10d1-4b86-afe4-252f543bc2ec {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-913953353',display_name='tempest-AttachVolumeNegativeTest-server-913953353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-913953353',id=36,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPrfGpihlwhj1nhbfIh50p6lz5WReDE81fXFguzfNjIlemUS50ubkZEwYGIMpiI8Fc8pq0N3hJxqhksx1+poDXyZqvm89CYPy9K2eekTSU/655XojtqkmY/3CJBo/gF/Q==',key_name='tempest-keypair-776473454',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:16:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d39dde859674409847b50613bcc608b',ramdisk_id='',reservation_id='r-0poqan5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-524813585',owner_user_name='tempest-AttachVolumeNegativeTest-524813585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:16:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ae91a734974162a14d7b4c498c4b8d',uuid=9885ad9e-10d1-4b86-afe4-252f543bc2ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "address": "fa:16:3e:8b:ef:38", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f8bb871-17", "ovs_interfaceid": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converting VIF {"id": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "address": "fa:16:3e:8b:ef:38", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f8bb871-17", "ovs_interfaceid": "5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:ef:38,bridge_name='br-int',has_traffic_filtering=True,id=5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f8bb871-17') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG os_vif [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:ef:38,bridge_name='br-int',has_traffic_filtering=True,id=5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f8bb871-17') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f8bb871-17, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cc3679b-d583-4187-83ad-2e7ce4f25b67) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:19:03 user nova-compute[75246]: INFO os_vif [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:ef:38,bridge_name='br-int',has_traffic_filtering=True,id=5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f8bb871-17')
Nov 28 17:19:03 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Deleting instance files /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec_del
Nov 28 17:19:03 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Deletion of /opt/stack/data/nova/instances/9885ad9e-10d1-4b86-afe4-252f543bc2ec_del complete
Nov 28 17:19:03 user nova-compute[75246]: INFO nova.compute.manager [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 28 17:19:03 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG nova.objects.instance [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lazy-loading 'flavor' on Instance uuid 5175a016-3237-4e79-bc77-4b72e5402695 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:03 user nova-compute[75246]: INFO nova.compute.manager [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Attaching volume ee67dcd5-ce52-4f72-a573-d0f03e6cd810 to /dev/vdb
Nov 28 17:19:04 user nova-compute[75246]: DEBUG os_brick.utils [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[157280e1-828f-439f-8f85-d6248af4575b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7aac88-72b0-4490-82f4-5c63b1e8ff8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dc8b99-8003-4b39-bfc8-962e4cb2c689]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae11c581-6443-4ac1-8364-3be04d6c0943]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:19:04 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eab8fc0-9d23-469c-9426-224a1a4279a3]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG os_brick.utils [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Updating existing volume attachment record: c4abb3c0-233b-4c32-939f-844c8a31c1c5 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:19:04 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Took 1.07 seconds to deallocate network for instance.
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3ac5ee9-a9c9-4707-8dd7-9d3143f1177a req-163e39b6-f920-40a5-a22d-6e8e1ecda615 service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Received event network-vif-plugged-5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3ac5ee9-a9c9-4707-8dd7-9d3143f1177a req-163e39b6-f920-40a5-a22d-6e8e1ecda615 service nova] Acquiring lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3ac5ee9-a9c9-4707-8dd7-9d3143f1177a req-163e39b6-f920-40a5-a22d-6e8e1ecda615 service nova] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3ac5ee9-a9c9-4707-8dd7-9d3143f1177a req-163e39b6-f920-40a5-a22d-6e8e1ecda615 service nova] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3ac5ee9-a9c9-4707-8dd7-9d3143f1177a req-163e39b6-f920-40a5-a22d-6e8e1ecda615 service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] No waiting events found dispatching network-vif-plugged-5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:19:04 user nova-compute[75246]: WARNING nova.compute.manager [req-f3ac5ee9-a9c9-4707-8dd7-9d3143f1177a req-163e39b6-f920-40a5-a22d-6e8e1ecda615 service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Received unexpected event network-vif-plugged-5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 for instance with vm_state deleted and task_state None.
Nov 28 17:19:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3ac5ee9-a9c9-4707-8dd7-9d3143f1177a req-163e39b6-f920-40a5-a22d-6e8e1ecda615 service nova] [instance: 9885ad9e-10d1-4b86-afe4-252f543bc2ec] Received event network-vif-deleted-5f8bb871-17d4-40e9-a9e9-3cfaa76bd2b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:19:04 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Deleted allocations for instance 9885ad9e-10d1-4b86-afe4-252f543bc2ec
Nov 28 17:19:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8833cbf2-8ddb-4664-bc6d-3cf8d9a6b270 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "9885ad9e-10d1-4b86-afe4-252f543bc2ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.484s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "0fb728b1-9a86-412e-b37e-57a072164534" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "0fb728b1-9a86-412e-b37e-57a072164534" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "0fb728b1-9a86-412e-b37e-57a072164534-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "0fb728b1-9a86-412e-b37e-57a072164534-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "0fb728b1-9a86-412e-b37e-57a072164534-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:08 user nova-compute[75246]: INFO nova.compute.manager [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Terminating instance
Nov 28 17:19:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:19:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-a3a1c585-9631-4039-a095-c5f5bb06dae8 req-dc72913b-77e4-4867-add9-5e1de33c28fc service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Received event network-vif-unplugged-14ad7288-2755-4a75-b2a9-b8641b0a0bd4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a3a1c585-9631-4039-a095-c5f5bb06dae8 req-dc72913b-77e4-4867-add9-5e1de33c28fc service nova] Acquiring lock "0fb728b1-9a86-412e-b37e-57a072164534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a3a1c585-9631-4039-a095-c5f5bb06dae8 req-dc72913b-77e4-4867-add9-5e1de33c28fc service nova] Lock "0fb728b1-9a86-412e-b37e-57a072164534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a3a1c585-9631-4039-a095-c5f5bb06dae8 req-dc72913b-77e4-4867-add9-5e1de33c28fc service nova] Lock "0fb728b1-9a86-412e-b37e-57a072164534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-a3a1c585-9631-4039-a095-c5f5bb06dae8 req-dc72913b-77e4-4867-add9-5e1de33c28fc service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] No waiting events found dispatching network-vif-unplugged-14ad7288-2755-4a75-b2a9-b8641b0a0bd4 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-a3a1c585-9631-4039-a095-c5f5bb06dae8 req-dc72913b-77e4-4867-add9-5e1de33c28fc service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Received event network-vif-unplugged-14ad7288-2755-4a75-b2a9-b8641b0a0bd4 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:19:09 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Instance destroyed successfully.
Nov 28 17:19:09 user nova-compute[75246]: DEBUG nova.objects.instance [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lazy-loading 'resources' on Instance uuid 0fb728b1-9a86-412e-b37e-57a072164534 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-233855623',display_name='tempest-TestVolumeBootPattern-volume-backed-server-233855623',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-233855623',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHI4hps3jXqTExNHYhOU8FX7+zIFGGafDIDmvWAxlJwXHL/ifAVZKBKwuDHAKC9+L8QRtHYha80zaIoyL5j4jtGmxCRFwpSUly8+eWBd/sL24pi4FbZh2oSEcLg8NEvRw==',key_name='tempest-keypair-625009801',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:14:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe0eebdd39c54a74be8d2e0f9842b165',ramdisk_id='',reservation_id='r-nblwzgb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-389869337',owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c334f73c5bf1473aadf865c8f032c0cb',uuid=0fb728b1-9a86-412e-b37e-57a072164534,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "address": "fa:16:3e:59:00:36", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ad7288-27", "ovs_interfaceid": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converting VIF {"id": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "address": "fa:16:3e:59:00:36", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14ad7288-27", "ovs_interfaceid": "14ad7288-2755-4a75-b2a9-b8641b0a0bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:00:36,bridge_name='br-int',has_traffic_filtering=True,id=14ad7288-2755-4a75-b2a9-b8641b0a0bd4,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ad7288-27') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_vif [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:00:36,bridge_name='br-int',has_traffic_filtering=True,id=14ad7288-2755-4a75-b2a9-b8641b0a0bd4,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ad7288-27') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14ad7288-27, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=410ed329-5380-4bab-9b71-09926fa2f937) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:19:09 user nova-compute[75246]: INFO os_vif [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:00:36,bridge_name='br-int',has_traffic_filtering=True,id=14ad7288-2755-4a75-b2a9-b8641b0a0bd4,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14ad7288-27')
Nov 28 17:19:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xeUkAREn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:19:09 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ace914d-0efc-4986-89c4-b176cc848db9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:19:09 user nova-compute[75246]: No targets found.
Nov 28 17:19:09 user nova-compute[75246]: iSNS:
Nov 28 17:19:09 user nova-compute[75246]: No targets found.
Nov 28 17:19:09 user nova-compute[75246]: STATIC:
Nov 28 17:19:09 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e
Nov 28 17:19:09 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:19:09 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:19:09 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:19:09 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:19:09 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:19:09 user nova-compute[75246]: FIRMWARE:
Nov 28 17:19:09 user nova-compute[75246]: No targets found.
Nov 28 17:19:09 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:19:09 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:19:09 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed45b708-fb6d-4ed1-b5c1-f5ce0ad747c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf59ef1c-94e1-4c12-a201-73f18709fe4a]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:19:09 user nova-compute[75246]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:19:09 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e (non-flash)
Nov 28 17:19:09 user nova-compute[75246]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:19:09 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d83c0160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e'): ({'sdd'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Removing single pathed devices sdd {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8e7c34-42d0-4773-8b1d-2c598c783c73]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce622a4-7b19-4faa-b491-04161ef231ba]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Flushing IO for device /dev/sdd {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd2335b-78b4-4703-be0b-e062577da197]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.080s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e020be2a-b4e5-4196-a2b8-d502e19b852c]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[174489cc-6ee9-4877-a888-556dccbe1ba5]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71b45e6-5794-43f4-8d1a-9ab9a71718be]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e, portal: 172.16.0.220,3260]
Nov 28 17:19:09 user nova-compute[75246]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e, portal: 172.16.0.220,3260] successful.
Nov 28 17:19:09 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee0101c-6947-4543-a1ee-2ce58ad5e3e3]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] <== disconnect_volume: return (381ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:19:09 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Deleting instance files /opt/stack/data/nova/instances/0fb728b1-9a86-412e-b37e-57a072164534_del
Nov 28 17:19:09 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Deletion of /opt/stack/data/nova/instances/0fb728b1-9a86-412e-b37e-57a072164534_del complete
Nov 28 17:19:09 user nova-compute[75246]: INFO nova.compute.manager [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 28 17:19:09 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:19:09 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:19:11 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Took 1.10 seconds to deallocate network for instance.
Nov 28 17:19:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-7210b6d1-fe61-4e8b-ba9f-5670f192396e req-abc5f780-e112-4f49-8aee-7196320bba03 service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Received event network-vif-deleted-14ad7288-2755-4a75-b2a9-b8641b0a0bd4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-55b73d96-70db-4740-be36-b96aa6c21085 req-f52b7ba7-b0b8-4d17-a45c-08b51de8e9ae service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Received event network-vif-plugged-14ad7288-2755-4a75-b2a9-b8641b0a0bd4 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-55b73d96-70db-4740-be36-b96aa6c21085 req-f52b7ba7-b0b8-4d17-a45c-08b51de8e9ae service nova] Acquiring lock "0fb728b1-9a86-412e-b37e-57a072164534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-55b73d96-70db-4740-be36-b96aa6c21085 req-f52b7ba7-b0b8-4d17-a45c-08b51de8e9ae service nova] Lock "0fb728b1-9a86-412e-b37e-57a072164534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-55b73d96-70db-4740-be36-b96aa6c21085 req-f52b7ba7-b0b8-4d17-a45c-08b51de8e9ae service nova] Lock "0fb728b1-9a86-412e-b37e-57a072164534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG nova.compute.manager [req-55b73d96-70db-4740-be36-b96aa6c21085 req-f52b7ba7-b0b8-4d17-a45c-08b51de8e9ae service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] No waiting events found dispatching network-vif-plugged-14ad7288-2755-4a75-b2a9-b8641b0a0bd4 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:19:11 user nova-compute[75246]: WARNING nova.compute.manager [req-55b73d96-70db-4740-be36-b96aa6c21085 req-f52b7ba7-b0b8-4d17-a45c-08b51de8e9ae service nova] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Received unexpected event network-vif-plugged-14ad7288-2755-4a75-b2a9-b8641b0a0bd4 for instance with vm_state active and task_state deleting.
Nov 28 17:19:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlxPdBJM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:19:11 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:19:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:19:11 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:19:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:19:11 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[077ec414-ca7d-4b5f-80ee-b5fe7de8bc82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:19:11 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cded39d4-59b0-4c22-8251-335a3341b0cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810] added
Nov 28 17:19:11 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[46564fa4-17ba-465c-baa8-00097925ca11]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c352023-63d7-4eb2-8e5a-7a63247f7303]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rlxPdBJM {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rlxPdBJM" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03684bf-be8b-49f4-b5a7-8bc7bd8c815b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rlxPdBJM'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d473cd1e-5bda-4cfb-80c5-6f0ecc940cc5]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7de814-2cdf-4e72-a4cb-c4d4edbd6d13]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:19:11 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:19:11 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f87354e-8576-4e12-9bd3-5b631f1f2fba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810, portal: 172.16.0.220,3260]
Nov 28 17:19:11 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810, portal: 172.16.0.220,3260] successful.
Nov 28 17:19:11 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b530853-25e1-420d-b139-e4daa42526fb]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:19:11 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:11 user nova-compute[75246]: INFO nova.compute.manager [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Took 0.91 seconds to detach 1 volumes for instance.
Nov 28 17:19:11 user nova-compute[75246]: DEBUG nova.compute.manager [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: 0fb728b1-9a86-412e-b37e-57a072164534] Deleting volume: be2f4fe2-c0ac-44f9-92ca-fd37fcc1c06e {{(pid=75246) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 17:19:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f14d2b6-f03e-47f3-822f-ebc087113f69]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:19:12 user nova-compute[75246]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 (non-flash)
Nov 28 17:19:12 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:19:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:19:12 user nova-compute[75246]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 (non-flash)
Nov 28 17:19:12 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:19:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:19:12 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:19:12 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:19:12 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:19:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:12 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:12 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d769b4-3277-4eb7-ad72-061d66ce16a6]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:12 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:19:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:12 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:19:12 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:19:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:12 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Deleted allocations for instance 0fb728b1-9a86-412e-b37e-57a072164534
Nov 28 17:19:12 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-1981f136-10a1-4697-b9bb-888a247f7692 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "0fb728b1-9a86-412e-b37e-57a072164534" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.828s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:13 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:19:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlxPdBJM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:19:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:19:13 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26563663532373862', 'path': '/dev/sdc'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:19:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563663532373862', 'path': '/dev/sdc'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:19:13 user nova-compute[75246]: DEBUG nova.objects.instance [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lazy-loading 'flavor' on Instance uuid 5175a016-3237-4e79-bc77-4b72e5402695 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:19:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:19:13 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:19:13 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:19:13 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:19:13 user nova-compute[75246]:   <serial>ee67dcd5-ce52-4f72-a573-d0f03e6cd810</serial>
Nov 28 17:19:13 user nova-compute[75246]: </disk>
Nov 28 17:19:13 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:19:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:19:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:19:13 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] No VIF found with MAC fa:16:3e:f8:4f:00, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:19:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ddd25e88-8f35-4156-bd13-b065a84ec768 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.644s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:27 user nova-compute[75246]: INFO nova.compute.manager [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Detaching volume ee67dcd5-ce52-4f72-a573-d0f03e6cd810
Nov 28 17:19:27 user nova-compute[75246]: INFO nova.virt.block_device [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Attempting to driver detach volume ee67dcd5-ce52-4f72-a573-d0f03e6cd810 from mountpoint /dev/vdb
Nov 28 17:19:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Attempting to detach device vdb from instance 5175a016-3237-4e79-bc77-4b72e5402695 from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:19:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:19:27 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:19:27 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:19:27 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:19:27 user nova-compute[75246]:   <serial>ee67dcd5-ce52-4f72-a573-d0f03e6cd810</serial>
Nov 28 17:19:27 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:19:27 user nova-compute[75246]: </disk>
Nov 28 17:19:27 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:19:27 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Successfully detached device vdb from instance 5175a016-3237-4e79-bc77-4b72e5402695 from the persistent domain config.
Nov 28 17:19:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5175a016-3237-4e79-bc77-4b72e5402695 from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:19:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:19:27 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:19:27 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:19:27 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:19:27 user nova-compute[75246]:   <serial>ee67dcd5-ce52-4f72-a573-d0f03e6cd810</serial>
Nov 28 17:19:27 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:19:27 user nova-compute[75246]: </disk>
Nov 28 17:19:27 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:19:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5175a016-3237-4e79-bc77-4b72e5402695 {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:19:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:33 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:19:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:34 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:19:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:35 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:19:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:19:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a796152e-e8df-41bf-a5ea-ae94d4fa8b41/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a796152e-e8df-41bf-a5ea-ae94d4fa8b41/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a796152e-e8df-41bf-a5ea-ae94d4fa8b41/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a796152e-e8df-41bf-a5ea-ae94d4fa8b41/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:37 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:19:37 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:19:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8252MB free_disk=25.196075439453125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:19:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c94900af-f484-47bf-8627-8aa863334b63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:19:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:19:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:19:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a796152e-e8df-41bf-a5ea-ae94d4fa8b41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:19:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 5175a016-3237-4e79-bc77-4b72e5402695 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:19:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:19:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:19:38 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:19:38 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:19:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:19:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:19:39 user nova-compute[75246]: INFO nova.compute.claims [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Claim successful on node user
Nov 28 17:19:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG nova.network.neutron [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:19:39 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:19:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG nova.policy [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19ef7d1761e1453192ff17640d5e76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4641269f199d40e7b0950c342f63cedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG nova.compute.manager [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:19:39 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Creating image(s)
Nov 28 17:19:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "/opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "/opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.197s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk 1073741824" returned: 0 in 0.051s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Cannot resize image /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Ensure instance console log exists: /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:40 user nova-compute[75246]: DEBUG nova.network.neutron [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Successfully created port: 82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:19:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:41 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.network.neutron [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Successfully updated port: 82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquired lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.network.neutron [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.compute.manager [req-3467c8da-f483-4cd6-ad1a-45d7d7dbdeaa req-ef5f7e8a-7201-4bf0-be75-d76d7a8712ee service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received event network-changed-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.compute.manager [req-3467c8da-f483-4cd6-ad1a-45d7d7dbdeaa req-ef5f7e8a-7201-4bf0-be75-d76d7a8712ee service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Refreshing instance network info cache due to event network-changed-82c2968b-a7ec-41d6-924f-25ce67ec14b1. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3467c8da-f483-4cd6-ad1a-45d7d7dbdeaa req-ef5f7e8a-7201-4bf0-be75-d76d7a8712ee service nova] Acquiring lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.network.neutron [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.network.neutron [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Updating instance_info_cache with network_info: [{"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Releasing lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.compute.manager [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Instance network_info: |[{"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3467c8da-f483-4cd6-ad1a-45d7d7dbdeaa req-ef5f7e8a-7201-4bf0-be75-d76d7a8712ee service nova] Acquired lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.network.neutron [req-3467c8da-f483-4cd6-ad1a-45d7d7dbdeaa req-ef5f7e8a-7201-4bf0-be75-d76d7a8712ee service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Refreshing network info cache for port 82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Start _get_guest_xml network_info=[{"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:19:42 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:19:42 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2095107296',display_name='tempest-ServerStableDeviceRescueTest-server-2095107296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2095107296',id=40,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDa5uEO1HX+58NWsd53/buxKkPj78W0uZlYn7nLVLGasZGkhXRb5Jz2aA7I2S3wLbUGkObWNp8tsEnWn252BxXEnoOs3Plc1kb2ClU++Ma46Pfe3fpGcAWwTUSSX3xIDQ==',key_name='tempest-keypair-1485453579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4641269f199d40e7b0950c342f63cedf',ramdisk_id='',reservation_id='r-zm04m3my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2071157665',owner_user_name='tempest-ServerStableDeviceRescueTest-2071157665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19ef7d1761e1453192ff17640d5e76c5',uuid=1a520141-ac59-407a-a525-b3fe402e8cd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Converting VIF {"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:10:f8,bridge_name='br-int',has_traffic_filtering=True,id=82c2968b-a7ec-41d6-924f-25ce67ec14b1,network=Network(c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82c2968b-a7') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.objects.instance [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a520141-ac59-407a-a525-b3fe402e8cd5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:19:42 user nova-compute[75246]:   <uuid>1a520141-ac59-407a-a525-b3fe402e8cd5</uuid>
Nov 28 17:19:42 user nova-compute[75246]:   <name>instance-00000028</name>
Nov 28 17:19:42 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:19:42 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:19:42 user nova-compute[75246]:   <metadata>
Nov 28 17:19:42 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:19:42 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:19:42 user nova-compute[75246]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2095107296</nova:name>
Nov 28 17:19:42 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:19:42</nova:creationTime>
Nov 28 17:19:42 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:19:42 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:19:42 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:19:42 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:19:42 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:19:42 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:19:42 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:19:42 user nova-compute[75246]:       <nova:owner>
Nov 28 17:19:42 user nova-compute[75246]:         <nova:user uuid="19ef7d1761e1453192ff17640d5e76c5">tempest-ServerStableDeviceRescueTest-2071157665-project-member</nova:user>
Nov 28 17:19:42 user nova-compute[75246]:         <nova:project uuid="4641269f199d40e7b0950c342f63cedf">tempest-ServerStableDeviceRescueTest-2071157665</nova:project>
Nov 28 17:19:42 user nova-compute[75246]:       </nova:owner>
Nov 28 17:19:42 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:19:42 user nova-compute[75246]:       <nova:ports>
Nov 28 17:19:42 user nova-compute[75246]:         <nova:port uuid="82c2968b-a7ec-41d6-924f-25ce67ec14b1">
Nov 28 17:19:42 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 17:19:42 user nova-compute[75246]:         </nova:port>
Nov 28 17:19:42 user nova-compute[75246]:       </nova:ports>
Nov 28 17:19:42 user nova-compute[75246]:     </nova:instance>
Nov 28 17:19:42 user nova-compute[75246]:   </metadata>
Nov 28 17:19:42 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:19:42 user nova-compute[75246]:     <system>
Nov 28 17:19:42 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:19:42 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:19:42 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:19:42 user nova-compute[75246]:       <entry name="serial">1a520141-ac59-407a-a525-b3fe402e8cd5</entry>
Nov 28 17:19:42 user nova-compute[75246]:       <entry name="uuid">1a520141-ac59-407a-a525-b3fe402e8cd5</entry>
Nov 28 17:19:42 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:19:42 user nova-compute[75246]:     </system>
Nov 28 17:19:42 user nova-compute[75246]:   </sysinfo>
Nov 28 17:19:42 user nova-compute[75246]:   <os>
Nov 28 17:19:42 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:19:42 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:19:42 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:19:42 user nova-compute[75246]:   </os>
Nov 28 17:19:42 user nova-compute[75246]:   <features>
Nov 28 17:19:42 user nova-compute[75246]:     <acpi/>
Nov 28 17:19:42 user nova-compute[75246]:     <apic/>
Nov 28 17:19:42 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:19:42 user nova-compute[75246]:   </features>
Nov 28 17:19:42 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:19:42 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:19:42 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:19:42 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:19:42 user nova-compute[75246]:   </clock>
Nov 28 17:19:42 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:19:42 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:19:42 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:19:42 user nova-compute[75246]:   </cpu>
Nov 28 17:19:42 user nova-compute[75246]:   <devices>
Nov 28 17:19:42 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:19:42 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:19:42 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk"/>
Nov 28 17:19:42 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:19:42 user nova-compute[75246]:     </disk>
Nov 28 17:19:42 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:19:42 user nova-compute[75246]:       <mac address="fa:16:3e:24:10:f8"/>
Nov 28 17:19:42 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:19:42 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:19:42 user nova-compute[75246]:       <target dev="tap82c2968b-a7"/>
Nov 28 17:19:42 user nova-compute[75246]:     </interface>
Nov 28 17:19:42 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:19:42 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/console.log" append="off"/>
Nov 28 17:19:42 user nova-compute[75246]:     </serial>
Nov 28 17:19:42 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:19:42 user nova-compute[75246]:     <video>
Nov 28 17:19:42 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:19:42 user nova-compute[75246]:     </video>
Nov 28 17:19:42 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:19:42 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:19:42 user nova-compute[75246]:     </rng>
Nov 28 17:19:42 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:19:42 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:19:42 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:19:42 user nova-compute[75246]:     </memballoon>
Nov 28 17:19:42 user nova-compute[75246]:   </devices>
Nov 28 17:19:42 user nova-compute[75246]: </domain>
Nov 28 17:19:42 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2095107296',display_name='tempest-ServerStableDeviceRescueTest-server-2095107296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2095107296',id=40,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDa5uEO1HX+58NWsd53/buxKkPj78W0uZlYn7nLVLGasZGkhXRb5Jz2aA7I2S3wLbUGkObWNp8tsEnWn252BxXEnoOs3Plc1kb2ClU++Ma46Pfe3fpGcAWwTUSSX3xIDQ==',key_name='tempest-keypair-1485453579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4641269f199d40e7b0950c342f63cedf',ramdisk_id='',reservation_id='r-zm04m3my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2071157665',owner_user_name='tempest-ServerStableDeviceRescueTest-2071157665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19ef7d1761e1453192ff17640d5e76c5',uuid=1a520141-ac59-407a-a525-b3fe402e8cd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Converting VIF {"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:10:f8,bridge_name='br-int',has_traffic_filtering=True,id=82c2968b-a7ec-41d6-924f-25ce67ec14b1,network=Network(c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82c2968b-a7') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG os_vif [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:10:f8,bridge_name='br-int',has_traffic_filtering=True,id=82c2968b-a7ec-41d6-924f-25ce67ec14b1,network=Network(c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82c2968b-a7') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c80f7b9c-0bd2-5024-94d8-a91613a59bfd', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82c2968b-a7, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82c2968b-a7, col_values=(('qos', UUID('f667434c-8078-4053-aa4f-493599e1db3a')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82c2968b-a7, col_values=(('external_ids', {'iface-id': '82c2968b-a7ec-41d6-924f-25ce67ec14b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:10:f8', 'vm-uuid': '1a520141-ac59-407a-a525-b3fe402e8cd5'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:42 user nova-compute[75246]: INFO os_vif [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:10:f8,bridge_name='br-int',has_traffic_filtering=True,id=82c2968b-a7ec-41d6-924f-25ce67ec14b1,network=Network(c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82c2968b-a7')
Nov 28 17:19:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:19:42 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:19:43 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Skipping network cache update for instance because it is Building. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 28 17:19:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:19:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] No VIF found with MAC fa:16:3e:24:10:f8, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:19:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:19:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:19:43 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: c94900af-f484-47bf-8627-8aa863334b63] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:19:43 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lazy-loading 'info_cache' on Instance uuid c94900af-f484-47bf-8627-8aa863334b63 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:19:43 user nova-compute[75246]: DEBUG nova.network.neutron [req-3467c8da-f483-4cd6-ad1a-45d7d7dbdeaa req-ef5f7e8a-7201-4bf0-be75-d76d7a8712ee service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Updated VIF entry in instance network info cache for port 82c2968b-a7ec-41d6-924f-25ce67ec14b1. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:19:43 user nova-compute[75246]: DEBUG nova.network.neutron [req-3467c8da-f483-4cd6-ad1a-45d7d7dbdeaa req-ef5f7e8a-7201-4bf0-be75-d76d7a8712ee service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Updating instance_info_cache with network_info: [{"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:19:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3467c8da-f483-4cd6-ad1a-45d7d7dbdeaa req-ef5f7e8a-7201-4bf0-be75-d76d7a8712ee service nova] Releasing lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:19:43 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: c94900af-f484-47bf-8627-8aa863334b63] Updating instance_info_cache with network_info: [{"id": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "address": "fa:16:3e:e3:8a:cb", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dca6bfe-f1", "ovs_interfaceid": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:19:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-c94900af-f484-47bf-8627-8aa863334b63" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:19:43 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: c94900af-f484-47bf-8627-8aa863334b63] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:19:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-99f361d8-2aab-4d24-9262-8e9f272f01f2 req-f44d9dc9-4fed-4355-b5eb-e9bc81fe45dd service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received event network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:19:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-99f361d8-2aab-4d24-9262-8e9f272f01f2 req-f44d9dc9-4fed-4355-b5eb-e9bc81fe45dd service nova] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-99f361d8-2aab-4d24-9262-8e9f272f01f2 req-f44d9dc9-4fed-4355-b5eb-e9bc81fe45dd service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-99f361d8-2aab-4d24-9262-8e9f272f01f2 req-f44d9dc9-4fed-4355-b5eb-e9bc81fe45dd service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-99f361d8-2aab-4d24-9262-8e9f272f01f2 req-f44d9dc9-4fed-4355-b5eb-e9bc81fe45dd service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] No waiting events found dispatching network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:19:44 user nova-compute[75246]: WARNING nova.compute.manager [req-99f361d8-2aab-4d24-9262-8e9f272f01f2 req-f44d9dc9-4fed-4355-b5eb-e9bc81fe45dd service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received unexpected event network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 for instance with vm_state building and task_state spawning.
Nov 28 17:19:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquiring lock "d324ffda-861e-47dd-afb5-f034e7b98cb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "d324ffda-861e-47dd-afb5-f034e7b98cb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:45 user nova-compute[75246]: DEBUG nova.compute.manager [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:19:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:19:45 user nova-compute[75246]: INFO nova.compute.claims [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Claim successful on node user
Nov 28 17:19:45 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:19:45 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.compute.manager [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.compute.manager [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.network.neutron [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:19:46 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.compute.manager [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.policy [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e5ebd975fea42b0af369d94360206c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e932cfe5d8b84dff8d8826cd581ce086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.compute.manager [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:19:46 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Creating image(s)
Nov 28 17:19:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquiring lock "/opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "/opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "/opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.183s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.compute.manager [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:19:46 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Instance spawned successfully.
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:46 user nova-compute[75246]: INFO nova.compute.manager [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Took 6.68 seconds to spawn the instance on the hypervisor.
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.compute.manager [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.210s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/disk 1073741824" returned: 0 in 0.076s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-7add3665-e2c0-418a-93b8-b31c2b89a272 req-fe8420a5-fba7-4a6a-a9d6-fa407d2f127a service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received event network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7add3665-e2c0-418a-93b8-b31c2b89a272 req-fe8420a5-fba7-4a6a-a9d6-fa407d2f127a service nova] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7add3665-e2c0-418a-93b8-b31c2b89a272 req-fe8420a5-fba7-4a6a-a9d6-fa407d2f127a service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7add3665-e2c0-418a-93b8-b31c2b89a272 req-fe8420a5-fba7-4a6a-a9d6-fa407d2f127a service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-7add3665-e2c0-418a-93b8-b31c2b89a272 req-fe8420a5-fba7-4a6a-a9d6-fa407d2f127a service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] No waiting events found dispatching network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:19:46 user nova-compute[75246]: WARNING nova.compute.manager [req-7add3665-e2c0-418a-93b8-b31c2b89a272 req-fe8420a5-fba7-4a6a-a9d6-fa407d2f127a service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received unexpected event network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 for instance with vm_state building and task_state spawning.
Nov 28 17:19:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:46 user nova-compute[75246]: INFO nova.compute.manager [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Took 7.42 seconds to build instance.
Nov 28 17:19:46 user nova-compute[75246]: DEBUG nova.network.neutron [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Successfully created port: 40cfd25e-6778-4193-817b-5b831a7e6cd0 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:19:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-610c4269-2a46-419b-949b-ae1eb1b3f280 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.525s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.258s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Cannot resize image /opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Ensure instance console log exists: /opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.network.neutron [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Successfully updated port: 40cfd25e-6778-4193-817b-5b831a7e6cd0 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquiring lock "refresh_cache-d324ffda-861e-47dd-afb5-f034e7b98cb9" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquired lock "refresh_cache-d324ffda-861e-47dd-afb5-f034e7b98cb9" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.network.neutron [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.network.neutron [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:19:47 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5175a016-3237-4e79-bc77-4b72e5402695 is timed out.
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.network.neutron [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Updating instance_info_cache with network_info: [{"id": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "address": "fa:16:3e:bf:5f:3a", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfd25e-67", "ovs_interfaceid": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:19:47 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Successfully detached device vdb from instance 5175a016-3237-4e79-bc77-4b72e5402695 from the live domain config.
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlxPdBJM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:19:47 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:19:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Releasing lock "refresh_cache-d324ffda-861e-47dd-afb5-f034e7b98cb9" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.compute.manager [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Instance network_info: |[{"id": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "address": "fa:16:3e:bf:5f:3a", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfd25e-67", "ovs_interfaceid": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Start _get_guest_xml network_info=[{"id": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "address": "fa:16:3e:bf:5f:3a", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfd25e-67", "ovs_interfaceid": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:19:47 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:19:47 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[121e25bc-809d-4e5a-a72d-59b8a9a42b36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:19:47 user nova-compute[75246]: No targets found.
Nov 28 17:19:47 user nova-compute[75246]: iSNS:
Nov 28 17:19:47 user nova-compute[75246]: No targets found.
Nov 28 17:19:47 user nova-compute[75246]: STATIC:
Nov 28 17:19:47 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810
Nov 28 17:19:47 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:19:47 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:19:47 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:19:47 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:19:47 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:19:47 user nova-compute[75246]: FIRMWARE:
Nov 28 17:19:47 user nova-compute[75246]: No targets found.
Nov 28 17:19:47 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:19:47 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:19:47 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:19:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1677046357',display_name='tempest-VolumesActionsTest-instance-1677046357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1677046357',id=41,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e932cfe5d8b84dff8d8826cd581ce086',ramdisk_id='',reservation_id='r-wk0qu2md',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1657173529',owner_user_name='tempest-VolumesActionsTest-1657173529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:19:46Z,user_data=None,user_id='9e5ebd975fea42b0af369d94360206c7',uuid=d324ffda-861e-47dd-afb5-f034e7b98cb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "address": "fa:16:3e:bf:5f:3a", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfd25e-67", "ovs_interfaceid": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Converting VIF {"id": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "address": "fa:16:3e:bf:5f:3a", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfd25e-67", "ovs_interfaceid": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:5f:3a,bridge_name='br-int',has_traffic_filtering=True,id=40cfd25e-6778-4193-817b-5b831a7e6cd0,network=Network(0d612931-a2ce-4d23-ad5b-5e8c5abf33d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40cfd25e-67') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.objects.instance [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lazy-loading 'pci_devices' on Instance uuid d324ffda-861e-47dd-afb5-f034e7b98cb9 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47048e8-1c43-47f1-b7b5-90c8c1e8cd3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:19:47 user nova-compute[75246]:   <uuid>d324ffda-861e-47dd-afb5-f034e7b98cb9</uuid>
Nov 28 17:19:47 user nova-compute[75246]:   <name>instance-00000029</name>
Nov 28 17:19:47 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:19:47 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:19:47 user nova-compute[75246]:   <metadata>
Nov 28 17:19:47 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:19:47 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:19:47 user nova-compute[75246]:       <nova:name>tempest-VolumesActionsTest-instance-1677046357</nova:name>
Nov 28 17:19:47 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:19:47</nova:creationTime>
Nov 28 17:19:47 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:19:47 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:19:47 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:19:47 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:19:47 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:19:47 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:19:47 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:19:47 user nova-compute[75246]:       <nova:owner>
Nov 28 17:19:47 user nova-compute[75246]:         <nova:user uuid="9e5ebd975fea42b0af369d94360206c7">tempest-VolumesActionsTest-1657173529-project-member</nova:user>
Nov 28 17:19:47 user nova-compute[75246]:         <nova:project uuid="e932cfe5d8b84dff8d8826cd581ce086">tempest-VolumesActionsTest-1657173529</nova:project>
Nov 28 17:19:47 user nova-compute[75246]:       </nova:owner>
Nov 28 17:19:47 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:19:47 user nova-compute[75246]:       <nova:ports>
Nov 28 17:19:47 user nova-compute[75246]:         <nova:port uuid="40cfd25e-6778-4193-817b-5b831a7e6cd0">
Nov 28 17:19:47 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 17:19:47 user nova-compute[75246]:         </nova:port>
Nov 28 17:19:47 user nova-compute[75246]:       </nova:ports>
Nov 28 17:19:47 user nova-compute[75246]:     </nova:instance>
Nov 28 17:19:47 user nova-compute[75246]:   </metadata>
Nov 28 17:19:47 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:19:47 user nova-compute[75246]:     <system>
Nov 28 17:19:47 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:19:47 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:19:47 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:19:47 user nova-compute[75246]:       <entry name="serial">d324ffda-861e-47dd-afb5-f034e7b98cb9</entry>
Nov 28 17:19:47 user nova-compute[75246]:       <entry name="uuid">d324ffda-861e-47dd-afb5-f034e7b98cb9</entry>
Nov 28 17:19:47 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:19:47 user nova-compute[75246]:     </system>
Nov 28 17:19:47 user nova-compute[75246]:   </sysinfo>
Nov 28 17:19:47 user nova-compute[75246]:   <os>
Nov 28 17:19:47 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:19:47 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:19:47 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:19:47 user nova-compute[75246]:   </os>
Nov 28 17:19:47 user nova-compute[75246]:   <features>
Nov 28 17:19:47 user nova-compute[75246]:     <acpi/>
Nov 28 17:19:47 user nova-compute[75246]:     <apic/>
Nov 28 17:19:47 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:19:47 user nova-compute[75246]:   </features>
Nov 28 17:19:47 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:19:47 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:19:47 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:19:47 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:19:47 user nova-compute[75246]:   </clock>
Nov 28 17:19:47 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:19:47 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:19:47 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:19:47 user nova-compute[75246]:   </cpu>
Nov 28 17:19:47 user nova-compute[75246]:   <devices>
Nov 28 17:19:47 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:19:47 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:19:47 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/disk"/>
Nov 28 17:19:47 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:19:47 user nova-compute[75246]:     </disk>
Nov 28 17:19:47 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:19:47 user nova-compute[75246]:       <mac address="fa:16:3e:bf:5f:3a"/>
Nov 28 17:19:47 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:19:47 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:19:47 user nova-compute[75246]:       <target dev="tap40cfd25e-67"/>
Nov 28 17:19:47 user nova-compute[75246]:     </interface>
Nov 28 17:19:47 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:19:47 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/console.log" append="off"/>
Nov 28 17:19:47 user nova-compute[75246]:     </serial>
Nov 28 17:19:47 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:19:47 user nova-compute[75246]:     <video>
Nov 28 17:19:47 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:19:47 user nova-compute[75246]:     </video>
Nov 28 17:19:47 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:19:47 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:19:47 user nova-compute[75246]:     </rng>
Nov 28 17:19:47 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:19:47 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:19:47 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:19:47 user nova-compute[75246]:     </memballoon>
Nov 28 17:19:47 user nova-compute[75246]:   </devices>
Nov 28 17:19:47 user nova-compute[75246]: </domain>
Nov 28 17:19:47 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:19:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1677046357',display_name='tempest-VolumesActionsTest-instance-1677046357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1677046357',id=41,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e932cfe5d8b84dff8d8826cd581ce086',ramdisk_id='',reservation_id='r-wk0qu2md',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1657173529',owner_user_name='tempest-VolumesActionsTest-1657173529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:19:46Z,user_data=None,user_id='9e5ebd975fea42b0af369d94360206c7',uuid=d324ffda-861e-47dd-afb5-f034e7b98cb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "address": "fa:16:3e:bf:5f:3a", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfd25e-67", "ovs_interfaceid": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Converting VIF {"id": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "address": "fa:16:3e:bf:5f:3a", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfd25e-67", "ovs_interfaceid": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:5f:3a,bridge_name='br-int',has_traffic_filtering=True,id=40cfd25e-6778-4193-817b-5b831a7e6cd0,network=Network(0d612931-a2ce-4d23-ad5b-5e8c5abf33d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40cfd25e-67') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG os_vif [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:5f:3a,bridge_name='br-int',has_traffic_filtering=True,id=40cfd25e-6778-4193-817b-5b831a7e6cd0,network=Network(0d612931-a2ce-4d23-ad5b-5e8c5abf33d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40cfd25e-67') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2407ce76-db71-5afa-9d00-6e44d7508baf', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[377c686c-1d2d-4408-88bb-8145cbc983a7]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:19:47 user nova-compute[75246]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 (non-flash)
Nov 28 17:19:47 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:19:47 user nova-compute[75246]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 (non-flash)
Nov 28 17:19:47 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d8362a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810'): ({'sdc'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Removing single pathed devices sdc {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40cfd25e-67, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40cfd25e-67, col_values=(('qos', UUID('70a11425-38b1-424f-b49c-c67b9ba3152a')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40cfd25e-67, col_values=(('external_ids', {'iface-id': '40cfd25e-6778-4193-817b-5b831a7e6cd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:5f:3a', 'vm-uuid': 'd324ffda-861e-47dd-afb5-f034e7b98cb9'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c3cb7b-ec9f-4cc4-b3d7-6b7ccf28670c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:47 user nova-compute[75246]: INFO os_vif [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:5f:3a,bridge_name='br-int',has_traffic_filtering=True,id=40cfd25e-6778-4193-817b-5b831a7e6cd0,network=Network(0d612931-a2ce-4d23-ad5b-5e8c5abf33d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40cfd25e-67')
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c47ce55-df74-4419-8b47-2444b53f56cb]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Flushing IO for device /dev/sdc {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8141efc-113f-496b-9661-576c62c607a5]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:19:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] No VIF found with MAC fa:16:3e:bf:5f:3a, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1542dab1-c35c-4906-92d6-1dac031df819]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83c0b22-b4a1-4499-8794-11c22ea79548]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[773bb525-7832-4362-8535-8886287aecc3]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810, portal: 172.16.0.220,3260]
Nov 28 17:19:48 user nova-compute[75246]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810, portal: 172.16.0.220,3260] successful.
Nov 28 17:19:48 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee67dcd5-ce52-4f72-a573-d0f03e6cd810 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7b0b45-d38b-4266-8b18-60d4e2962781]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] <== disconnect_volume: return (341ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG nova.compute.manager [req-dfe99bed-2a1e-4958-a188-8c1a2ca3700b req-ee79d2ce-606e-4ad9-97a6-09fad2e089bd service nova] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Received event network-changed-40cfd25e-6778-4193-817b-5b831a7e6cd0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG nova.compute.manager [req-dfe99bed-2a1e-4958-a188-8c1a2ca3700b req-ee79d2ce-606e-4ad9-97a6-09fad2e089bd service nova] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Refreshing instance network info cache due to event network-changed-40cfd25e-6778-4193-817b-5b831a7e6cd0. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-dfe99bed-2a1e-4958-a188-8c1a2ca3700b req-ee79d2ce-606e-4ad9-97a6-09fad2e089bd service nova] Acquiring lock "refresh_cache-d324ffda-861e-47dd-afb5-f034e7b98cb9" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-dfe99bed-2a1e-4958-a188-8c1a2ca3700b req-ee79d2ce-606e-4ad9-97a6-09fad2e089bd service nova] Acquired lock "refresh_cache-d324ffda-861e-47dd-afb5-f034e7b98cb9" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:19:48 user nova-compute[75246]: DEBUG nova.network.neutron [req-dfe99bed-2a1e-4958-a188-8c1a2ca3700b req-ee79d2ce-606e-4ad9-97a6-09fad2e089bd service nova] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Refreshing network info cache for port 40cfd25e-6778-4193-817b-5b831a7e6cd0 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:19:49 user nova-compute[75246]: DEBUG nova.objects.instance [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lazy-loading 'flavor' on Instance uuid 5175a016-3237-4e79-bc77-4b72e5402695 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:19:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ccd04968-08a9-4374-9b35-7a0393a94179 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.999s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:49 user nova-compute[75246]: DEBUG nova.network.neutron [req-dfe99bed-2a1e-4958-a188-8c1a2ca3700b req-ee79d2ce-606e-4ad9-97a6-09fad2e089bd service nova] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Updated VIF entry in instance network info cache for port 40cfd25e-6778-4193-817b-5b831a7e6cd0. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:19:49 user nova-compute[75246]: DEBUG nova.network.neutron [req-dfe99bed-2a1e-4958-a188-8c1a2ca3700b req-ee79d2ce-606e-4ad9-97a6-09fad2e089bd service nova] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Updating instance_info_cache with network_info: [{"id": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "address": "fa:16:3e:bf:5f:3a", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfd25e-67", "ovs_interfaceid": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:19:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-dfe99bed-2a1e-4958-a188-8c1a2ca3700b req-ee79d2ce-606e-4ad9-97a6-09fad2e089bd service nova] Releasing lock "refresh_cache-d324ffda-861e-47dd-afb5-f034e7b98cb9" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:19:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-740b24d2-6dbb-41cc-b9dd-8b83476569cc req-47e78f72-7f87-4a3e-a31b-04ac2dd78b2e service nova] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Received event network-vif-plugged-40cfd25e-6778-4193-817b-5b831a7e6cd0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:19:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-740b24d2-6dbb-41cc-b9dd-8b83476569cc req-47e78f72-7f87-4a3e-a31b-04ac2dd78b2e service nova] Acquiring lock "d324ffda-861e-47dd-afb5-f034e7b98cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-740b24d2-6dbb-41cc-b9dd-8b83476569cc req-47e78f72-7f87-4a3e-a31b-04ac2dd78b2e service nova] Lock "d324ffda-861e-47dd-afb5-f034e7b98cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-740b24d2-6dbb-41cc-b9dd-8b83476569cc req-47e78f72-7f87-4a3e-a31b-04ac2dd78b2e service nova] Lock "d324ffda-861e-47dd-afb5-f034e7b98cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-740b24d2-6dbb-41cc-b9dd-8b83476569cc req-47e78f72-7f87-4a3e-a31b-04ac2dd78b2e service nova] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] No waiting events found dispatching network-vif-plugged-40cfd25e-6778-4193-817b-5b831a7e6cd0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:19:49 user nova-compute[75246]: WARNING nova.compute.manager [req-740b24d2-6dbb-41cc-b9dd-8b83476569cc req-47e78f72-7f87-4a3e-a31b-04ac2dd78b2e service nova] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Received unexpected event network-vif-plugged-40cfd25e-6778-4193-817b-5b831a7e6cd0 for instance with vm_state building and task_state spawning.
Nov 28 17:19:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:51 user nova-compute[75246]: DEBUG nova.compute.manager [req-69296f6a-bdd0-496e-9838-2c054bd705e7 req-2b39927a-4907-4e83-a75b-6db50319dde6 service nova] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Received event network-vif-plugged-40cfd25e-6778-4193-817b-5b831a7e6cd0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:19:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-69296f6a-bdd0-496e-9838-2c054bd705e7 req-2b39927a-4907-4e83-a75b-6db50319dde6 service nova] Acquiring lock "d324ffda-861e-47dd-afb5-f034e7b98cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-69296f6a-bdd0-496e-9838-2c054bd705e7 req-2b39927a-4907-4e83-a75b-6db50319dde6 service nova] Lock "d324ffda-861e-47dd-afb5-f034e7b98cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-69296f6a-bdd0-496e-9838-2c054bd705e7 req-2b39927a-4907-4e83-a75b-6db50319dde6 service nova] Lock "d324ffda-861e-47dd-afb5-f034e7b98cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:51 user nova-compute[75246]: DEBUG nova.compute.manager [req-69296f6a-bdd0-496e-9838-2c054bd705e7 req-2b39927a-4907-4e83-a75b-6db50319dde6 service nova] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] No waiting events found dispatching network-vif-plugged-40cfd25e-6778-4193-817b-5b831a7e6cd0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:19:51 user nova-compute[75246]: WARNING nova.compute.manager [req-69296f6a-bdd0-496e-9838-2c054bd705e7 req-2b39927a-4907-4e83-a75b-6db50319dde6 service nova] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Received unexpected event network-vif-plugged-40cfd25e-6778-4193-817b-5b831a7e6cd0 for instance with vm_state building and task_state spawning.
Nov 28 17:19:51 user nova-compute[75246]: DEBUG nova.compute.manager [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:19:51 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:19:51 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Instance spawned successfully.
Nov 28 17:19:51 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:19:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:19:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:19:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:19:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:19:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:19:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:19:52 user nova-compute[75246]: INFO nova.compute.manager [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 28 17:19:52 user nova-compute[75246]: DEBUG nova.compute.manager [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:19:52 user nova-compute[75246]: INFO nova.compute.manager [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Took 6.54 seconds to build instance.
Nov 28 17:19:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-febd6f4f-22c9-42fc-a352-ba7989bfe4b9 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "d324ffda-861e-47dd-afb5-f034e7b98cb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.647s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:53 user nova-compute[75246]: INFO nova.compute.manager [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Terminating instance
Nov 28 17:19:53 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:19:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-f8a969b4-8585-41b8-841f-afdd5d358cfd req-e6682d35-678b-4bfb-b9c0-a47534508dc3 service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Received event network-vif-unplugged-0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:19:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f8a969b4-8585-41b8-841f-afdd5d358cfd req-e6682d35-678b-4bfb-b9c0-a47534508dc3 service nova] Acquiring lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f8a969b4-8585-41b8-841f-afdd5d358cfd req-e6682d35-678b-4bfb-b9c0-a47534508dc3 service nova] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f8a969b4-8585-41b8-841f-afdd5d358cfd req-e6682d35-678b-4bfb-b9c0-a47534508dc3 service nova] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-f8a969b4-8585-41b8-841f-afdd5d358cfd req-e6682d35-678b-4bfb-b9c0-a47534508dc3 service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] No waiting events found dispatching network-vif-unplugged-0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:19:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-f8a969b4-8585-41b8-841f-afdd5d358cfd req-e6682d35-678b-4bfb-b9c0-a47534508dc3 service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Received event network-vif-unplugged-0a3da48f-457a-450f-8102-d758c18d2554 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:19:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:54 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Instance destroyed successfully.
Nov 28 17:19:54 user nova-compute[75246]: DEBUG nova.objects.instance [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'resources' on Instance uuid c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:03:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-917092269',display_name='tempest-ServerRescueNegativeTestJSON-server-917092269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-917092269',id=17,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:05:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60768e53b1e3414cb05eaaf23d382493',ramdisk_id='',reservation_id='r-s8iqr3jc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-220335783',owner_user_name='tempest-ServerRescueNegativeTestJSON-220335783-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:05:43Z,user_data=None,user_id='b79c4440e4734a2f82b08de54ed61737',uuid=c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "0a3da48f-457a-450f-8102-d758c18d2554", "address": "fa:16:3e:a5:be:9f", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a3da48f-45", "ovs_interfaceid": "0a3da48f-457a-450f-8102-d758c18d2554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converting VIF {"id": "0a3da48f-457a-450f-8102-d758c18d2554", "address": "fa:16:3e:a5:be:9f", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a3da48f-45", "ovs_interfaceid": "0a3da48f-457a-450f-8102-d758c18d2554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:be:9f,bridge_name='br-int',has_traffic_filtering=True,id=0a3da48f-457a-450f-8102-d758c18d2554,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a3da48f-45') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG os_vif [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:be:9f,bridge_name='br-int',has_traffic_filtering=True,id=0a3da48f-457a-450f-8102-d758c18d2554,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a3da48f-45') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a3da48f-45, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9128250f-111f-440f-bde0-14c9c4f78dd4) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:19:54 user nova-compute[75246]: INFO os_vif [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:be:9f,bridge_name='br-int',has_traffic_filtering=True,id=0a3da48f-457a-450f-8102-d758c18d2554,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a3da48f-45')
Nov 28 17:19:54 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Deleting instance files /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5_del
Nov 28 17:19:54 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Deletion of /opt/stack/data/nova/instances/c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5_del complete
Nov 28 17:19:54 user nova-compute[75246]: INFO nova.compute.manager [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 28 17:19:54 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:19:54 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Took 0.50 seconds to deallocate network for instance.
Nov 28 17:19:54 user nova-compute[75246]: DEBUG nova.compute.manager [req-1cdcf96e-c601-46eb-a8e4-b713e3ec4bbe req-9cf94b86-374b-4d0a-b745-4101e923b377 service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Received event network-vif-deleted-0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:19:54 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:19:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:55 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Deleted allocations for instance c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5
Nov 28 17:19:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9ca0f924-7f3b-40ce-9502-4f6bf324fb79 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.990s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-afdf867d-f85f-4038-873d-c04e02ffb0e8 req-bf0210c0-6989-4175-b666-9bc0b2ecf5c5 service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Received event network-vif-plugged-0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:19:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-afdf867d-f85f-4038-873d-c04e02ffb0e8 req-bf0210c0-6989-4175-b666-9bc0b2ecf5c5 service nova] Acquiring lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-afdf867d-f85f-4038-873d-c04e02ffb0e8 req-bf0210c0-6989-4175-b666-9bc0b2ecf5c5 service nova] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-afdf867d-f85f-4038-873d-c04e02ffb0e8 req-bf0210c0-6989-4175-b666-9bc0b2ecf5c5 service nova] Lock "c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-afdf867d-f85f-4038-873d-c04e02ffb0e8 req-bf0210c0-6989-4175-b666-9bc0b2ecf5c5 service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] No waiting events found dispatching network-vif-plugged-0a3da48f-457a-450f-8102-d758c18d2554 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:19:55 user nova-compute[75246]: WARNING nova.compute.manager [req-afdf867d-f85f-4038-873d-c04e02ffb0e8 req-bf0210c0-6989-4175-b666-9bc0b2ecf5c5 service nova] [instance: c0c21cce-9cae-4a26-8bd6-bae4a4e38cc5] Received unexpected event network-vif-plugged-0a3da48f-457a-450f-8102-d758c18d2554 for instance with vm_state deleted and task_state None.
Nov 28 17:19:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "81104ec7-670f-417b-926f-9ee8f7c5d659" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:56 user nova-compute[75246]: DEBUG nova.compute.manager [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:19:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:56 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:19:56 user nova-compute[75246]: INFO nova.compute.claims [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Claim successful on node user
Nov 28 17:19:57 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:19:57 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:19:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:19:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:19:57 user nova-compute[75246]: DEBUG nova.network.neutron [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:19:57 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:19:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:19:57 user nova-compute[75246]: DEBUG nova.policy [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03ae91a734974162a14d7b4c498c4b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d39dde859674409847b50613bcc608b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:19:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:19:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:19:57 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Creating image(s)
Nov 28 17:19:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "/opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "/opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "/opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.208s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.183s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk 1073741824" returned: 0 in 0.065s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:58 user nova-compute[75246]: DEBUG nova.network.neutron [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Successfully created port: 790ebd7c-fc6a-4b58-a55c-4b2618528aba {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:19:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.190s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:58 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:19:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:19:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:19:58 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Cannot resize image /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:19:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:19:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Ensure instance console log exists: /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:19:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:19:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:19:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.network.neutron [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Successfully updated port: 790ebd7c-fc6a-4b58-a55c-4b2618528aba {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "refresh_cache-81104ec7-670f-417b-926f-9ee8f7c5d659" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquired lock "refresh_cache-81104ec7-670f-417b-926f-9ee8f7c5d659" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.network.neutron [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-19bac677-24a5-4764-b814-f7df82912374 req-1ed46deb-b34c-4103-a923-4b755a33d873 service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Received event network-changed-790ebd7c-fc6a-4b58-a55c-4b2618528aba {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-19bac677-24a5-4764-b814-f7df82912374 req-1ed46deb-b34c-4103-a923-4b755a33d873 service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Refreshing instance network info cache due to event network-changed-790ebd7c-fc6a-4b58-a55c-4b2618528aba. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-19bac677-24a5-4764-b814-f7df82912374 req-1ed46deb-b34c-4103-a923-4b755a33d873 service nova] Acquiring lock "refresh_cache-81104ec7-670f-417b-926f-9ee8f7c5d659" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.network.neutron [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.network.neutron [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Updating instance_info_cache with network_info: [{"id": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "address": "fa:16:3e:1b:3c:72", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790ebd7c-fc", "ovs_interfaceid": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Releasing lock "refresh_cache-81104ec7-670f-417b-926f-9ee8f7c5d659" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.compute.manager [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Instance network_info: |[{"id": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "address": "fa:16:3e:1b:3c:72", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790ebd7c-fc", "ovs_interfaceid": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-19bac677-24a5-4764-b814-f7df82912374 req-1ed46deb-b34c-4103-a923-4b755a33d873 service nova] Acquired lock "refresh_cache-81104ec7-670f-417b-926f-9ee8f7c5d659" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.network.neutron [req-19bac677-24a5-4764-b814-f7df82912374 req-1ed46deb-b34c-4103-a923-4b755a33d873 service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Refreshing network info cache for port 790ebd7c-fc6a-4b58-a55c-4b2618528aba {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Start _get_guest_xml network_info=[{"id": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "address": "fa:16:3e:1b:3c:72", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790ebd7c-fc", "ovs_interfaceid": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:19:59 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:19:59 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:19:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-37419736',display_name='tempest-AttachVolumeNegativeTest-server-37419736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-37419736',id=42,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTjxXTKyiGyugWA+BNbGzRbIakvzZND7iIsYhAq5DK2kboS5mJv24/8kj8Tn6g0HRoGnBoCmtdSS5uP6x4KMB5Mug8qDeCBuNYZG2jMV9KpQ+kAEkeL4FYXGZzr61pvCw==',key_name='tempest-keypair-741064529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d39dde859674409847b50613bcc608b',ramdisk_id='',reservation_id='r-051kkxnb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-524813585',owner_user_name='tempest-AttachVolumeNegativeTest-524813585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:19:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ae91a734974162a14d7b4c498c4b8d',uuid=81104ec7-670f-417b-926f-9ee8f7c5d659,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "address": "fa:16:3e:1b:3c:72", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790ebd7c-fc", "ovs_interfaceid": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converting VIF {"id": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "address": "fa:16:3e:1b:3c:72", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790ebd7c-fc", "ovs_interfaceid": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:3c:72,bridge_name='br-int',has_traffic_filtering=True,id=790ebd7c-fc6a-4b58-a55c-4b2618528aba,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790ebd7c-fc') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.objects.instance [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lazy-loading 'pci_devices' on Instance uuid 81104ec7-670f-417b-926f-9ee8f7c5d659 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:19:59 user nova-compute[75246]:   <uuid>81104ec7-670f-417b-926f-9ee8f7c5d659</uuid>
Nov 28 17:19:59 user nova-compute[75246]:   <name>instance-0000002a</name>
Nov 28 17:19:59 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:19:59 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:19:59 user nova-compute[75246]:   <metadata>
Nov 28 17:19:59 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:19:59 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:19:59 user nova-compute[75246]:       <nova:name>tempest-AttachVolumeNegativeTest-server-37419736</nova:name>
Nov 28 17:19:59 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:19:59</nova:creationTime>
Nov 28 17:19:59 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:19:59 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:19:59 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:19:59 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:19:59 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:19:59 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:19:59 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:19:59 user nova-compute[75246]:       <nova:owner>
Nov 28 17:19:59 user nova-compute[75246]:         <nova:user uuid="03ae91a734974162a14d7b4c498c4b8d">tempest-AttachVolumeNegativeTest-524813585-project-member</nova:user>
Nov 28 17:19:59 user nova-compute[75246]:         <nova:project uuid="9d39dde859674409847b50613bcc608b">tempest-AttachVolumeNegativeTest-524813585</nova:project>
Nov 28 17:19:59 user nova-compute[75246]:       </nova:owner>
Nov 28 17:19:59 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:19:59 user nova-compute[75246]:       <nova:ports>
Nov 28 17:19:59 user nova-compute[75246]:         <nova:port uuid="790ebd7c-fc6a-4b58-a55c-4b2618528aba">
Nov 28 17:19:59 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 17:19:59 user nova-compute[75246]:         </nova:port>
Nov 28 17:19:59 user nova-compute[75246]:       </nova:ports>
Nov 28 17:19:59 user nova-compute[75246]:     </nova:instance>
Nov 28 17:19:59 user nova-compute[75246]:   </metadata>
Nov 28 17:19:59 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:19:59 user nova-compute[75246]:     <system>
Nov 28 17:19:59 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:19:59 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:19:59 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:19:59 user nova-compute[75246]:       <entry name="serial">81104ec7-670f-417b-926f-9ee8f7c5d659</entry>
Nov 28 17:19:59 user nova-compute[75246]:       <entry name="uuid">81104ec7-670f-417b-926f-9ee8f7c5d659</entry>
Nov 28 17:19:59 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:19:59 user nova-compute[75246]:     </system>
Nov 28 17:19:59 user nova-compute[75246]:   </sysinfo>
Nov 28 17:19:59 user nova-compute[75246]:   <os>
Nov 28 17:19:59 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:19:59 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:19:59 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:19:59 user nova-compute[75246]:   </os>
Nov 28 17:19:59 user nova-compute[75246]:   <features>
Nov 28 17:19:59 user nova-compute[75246]:     <acpi/>
Nov 28 17:19:59 user nova-compute[75246]:     <apic/>
Nov 28 17:19:59 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:19:59 user nova-compute[75246]:   </features>
Nov 28 17:19:59 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:19:59 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:19:59 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:19:59 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:19:59 user nova-compute[75246]:   </clock>
Nov 28 17:19:59 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:19:59 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:19:59 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:19:59 user nova-compute[75246]:   </cpu>
Nov 28 17:19:59 user nova-compute[75246]:   <devices>
Nov 28 17:19:59 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:19:59 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:19:59 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk"/>
Nov 28 17:19:59 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:19:59 user nova-compute[75246]:     </disk>
Nov 28 17:19:59 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:19:59 user nova-compute[75246]:       <mac address="fa:16:3e:1b:3c:72"/>
Nov 28 17:19:59 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:19:59 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:19:59 user nova-compute[75246]:       <target dev="tap790ebd7c-fc"/>
Nov 28 17:19:59 user nova-compute[75246]:     </interface>
Nov 28 17:19:59 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:19:59 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/console.log" append="off"/>
Nov 28 17:19:59 user nova-compute[75246]:     </serial>
Nov 28 17:19:59 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:19:59 user nova-compute[75246]:     <video>
Nov 28 17:19:59 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:19:59 user nova-compute[75246]:     </video>
Nov 28 17:19:59 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:19:59 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:19:59 user nova-compute[75246]:     </rng>
Nov 28 17:19:59 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:19:59 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:19:59 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:19:59 user nova-compute[75246]:     </memballoon>
Nov 28 17:19:59 user nova-compute[75246]:   </devices>
Nov 28 17:19:59 user nova-compute[75246]: </domain>
Nov 28 17:19:59 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:19:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-37419736',display_name='tempest-AttachVolumeNegativeTest-server-37419736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-37419736',id=42,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTjxXTKyiGyugWA+BNbGzRbIakvzZND7iIsYhAq5DK2kboS5mJv24/8kj8Tn6g0HRoGnBoCmtdSS5uP6x4KMB5Mug8qDeCBuNYZG2jMV9KpQ+kAEkeL4FYXGZzr61pvCw==',key_name='tempest-keypair-741064529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d39dde859674409847b50613bcc608b',ramdisk_id='',reservation_id='r-051kkxnb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-524813585',owner_user_name='tempest-AttachVolumeNegativeTest-524813585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:19:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ae91a734974162a14d7b4c498c4b8d',uuid=81104ec7-670f-417b-926f-9ee8f7c5d659,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "address": "fa:16:3e:1b:3c:72", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790ebd7c-fc", "ovs_interfaceid": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converting VIF {"id": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "address": "fa:16:3e:1b:3c:72", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790ebd7c-fc", "ovs_interfaceid": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:3c:72,bridge_name='br-int',has_traffic_filtering=True,id=790ebd7c-fc6a-4b58-a55c-4b2618528aba,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790ebd7c-fc') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG os_vif [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:3c:72,bridge_name='br-int',has_traffic_filtering=True,id=790ebd7c-fc6a-4b58-a55c-4b2618528aba,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790ebd7c-fc') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '911598bc-12c5-5f3b-8bec-5364a2dff4b0', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap790ebd7c-fc, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap790ebd7c-fc, col_values=(('qos', UUID('e87168f3-7535-4aee-9fec-7059d09bf16a')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap790ebd7c-fc, col_values=(('external_ids', {'iface-id': '790ebd7c-fc6a-4b58-a55c-4b2618528aba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:3c:72', 'vm-uuid': '81104ec7-670f-417b-926f-9ee8f7c5d659'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:19:59 user nova-compute[75246]: INFO os_vif [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:3c:72,bridge_name='br-int',has_traffic_filtering=True,id=790ebd7c-fc6a-4b58-a55c-4b2618528aba,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790ebd7c-fc')
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] No VIF found with MAC fa:16:3e:1b:3c:72, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.network.neutron [req-19bac677-24a5-4764-b814-f7df82912374 req-1ed46deb-b34c-4103-a923-4b755a33d873 service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Updated VIF entry in instance network info cache for port 790ebd7c-fc6a-4b58-a55c-4b2618528aba. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG nova.network.neutron [req-19bac677-24a5-4764-b814-f7df82912374 req-1ed46deb-b34c-4103-a923-4b755a33d873 service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Updating instance_info_cache with network_info: [{"id": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "address": "fa:16:3e:1b:3c:72", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790ebd7c-fc", "ovs_interfaceid": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:19:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-19bac677-24a5-4764-b814-f7df82912374 req-1ed46deb-b34c-4103-a923-4b755a33d873 service nova] Releasing lock "refresh_cache-81104ec7-670f-417b-926f-9ee8f7c5d659" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:20:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-b1e447c9-84ba-4fdd-a109-3bde4535bdb0 req-fa17d41f-4448-4fce-a666-1311ebcf633f service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Received event network-vif-plugged-790ebd7c-fc6a-4b58-a55c-4b2618528aba {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:20:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b1e447c9-84ba-4fdd-a109-3bde4535bdb0 req-fa17d41f-4448-4fce-a666-1311ebcf633f service nova] Acquiring lock "81104ec7-670f-417b-926f-9ee8f7c5d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b1e447c9-84ba-4fdd-a109-3bde4535bdb0 req-fa17d41f-4448-4fce-a666-1311ebcf633f service nova] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b1e447c9-84ba-4fdd-a109-3bde4535bdb0 req-fa17d41f-4448-4fce-a666-1311ebcf633f service nova] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-b1e447c9-84ba-4fdd-a109-3bde4535bdb0 req-fa17d41f-4448-4fce-a666-1311ebcf633f service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] No waiting events found dispatching network-vif-plugged-790ebd7c-fc6a-4b58-a55c-4b2618528aba {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:20:01 user nova-compute[75246]: WARNING nova.compute.manager [req-b1e447c9-84ba-4fdd-a109-3bde4535bdb0 req-fa17d41f-4448-4fce-a666-1311ebcf633f service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Received unexpected event network-vif-plugged-790ebd7c-fc6a-4b58-a55c-4b2618528aba for instance with vm_state building and task_state spawning.
Nov 28 17:20:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-59870f6e-df74-4b43-ba9a-a83accb43481 req-2f46f213-727f-485d-b650-8aad07a7da80 service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Received event network-vif-plugged-790ebd7c-fc6a-4b58-a55c-4b2618528aba {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:20:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-59870f6e-df74-4b43-ba9a-a83accb43481 req-2f46f213-727f-485d-b650-8aad07a7da80 service nova] Acquiring lock "81104ec7-670f-417b-926f-9ee8f7c5d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-59870f6e-df74-4b43-ba9a-a83accb43481 req-2f46f213-727f-485d-b650-8aad07a7da80 service nova] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-59870f6e-df74-4b43-ba9a-a83accb43481 req-2f46f213-727f-485d-b650-8aad07a7da80 service nova] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-59870f6e-df74-4b43-ba9a-a83accb43481 req-2f46f213-727f-485d-b650-8aad07a7da80 service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] No waiting events found dispatching network-vif-plugged-790ebd7c-fc6a-4b58-a55c-4b2618528aba {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:20:03 user nova-compute[75246]: WARNING nova.compute.manager [req-59870f6e-df74-4b43-ba9a-a83accb43481 req-2f46f213-727f-485d-b650-8aad07a7da80 service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Received unexpected event network-vif-plugged-790ebd7c-fc6a-4b58-a55c-4b2618528aba for instance with vm_state building and task_state spawning.
Nov 28 17:20:03 user nova-compute[75246]: DEBUG nova.compute.manager [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:20:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:20:03 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Instance spawned successfully.
Nov 28 17:20:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:20:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:20:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:20:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:20:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:20:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:20:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:20:03 user nova-compute[75246]: INFO nova.compute.manager [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 28 17:20:03 user nova-compute[75246]: DEBUG nova.compute.manager [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:20:03 user nova-compute[75246]: INFO nova.compute.manager [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Took 6.83 seconds to build instance.
Nov 28 17:20:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-10e96ff6-ae93-492d-9d4d-5d7a7dff8110 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.960s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "b28b1c5a-d62d-45e4-92a0-22891e57116e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "b28b1c5a-d62d-45e4-92a0-22891e57116e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:20:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:08 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:20:08 user nova-compute[75246]: INFO nova.compute.claims [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Claim successful on node user
Nov 28 17:20:09 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:20:09 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:20:09 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:20:09 user nova-compute[75246]: INFO nova.virt.block_device [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Booting with volume 816a4875-3799-4b5e-aac5-f1461aca0f75 at /dev/vda
Nov 28 17:20:09 user nova-compute[75246]: DEBUG nova.policy [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c334f73c5bf1473aadf865c8f032c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0eebdd39c54a74be8d2e0f9842b165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG os_brick.utils [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5f24d5-b428-49c0-ab5a-c90b60b08234]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed9375b-3f40-4c6a-a7c4-ea51fc1728bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f4d8b9-78bc-4302-b8a0-ff226a680c04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a996bb0-cf72-4707-b4cb-49d265d2f331]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:20:09 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:20:09 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e54592-dfa0-4a22-b342-b0c60e7ff85f]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG os_brick.utils [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:20:09 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Updating existing volume attachment record: f20b4131-fdd8-46cd-a2ab-efa62a572f9c {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:20:10 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Successfully created port: d202eb6d-fad6-4c7b-8f5d-80abb1761aaf {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:20:10 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Successfully updated port: d202eb6d-fad6-4c7b-8f5d-80abb1761aaf {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:20:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "refresh_cache-b28b1c5a-d62d-45e4-92a0-22891e57116e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:20:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquired lock "refresh_cache-b28b1c5a-d62d-45e4-92a0-22891e57116e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:20:10 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:20:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-a49cffc2-355e-44f6-9ad6-130eaa846de1 req-a46ed68e-b13a-4bc4-8c28-719c42448048 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Received event network-changed-d202eb6d-fad6-4c7b-8f5d-80abb1761aaf {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:20:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-a49cffc2-355e-44f6-9ad6-130eaa846de1 req-a46ed68e-b13a-4bc4-8c28-719c42448048 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Refreshing instance network info cache due to event network-changed-d202eb6d-fad6-4c7b-8f5d-80abb1761aaf. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:20:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a49cffc2-355e-44f6-9ad6-130eaa846de1 req-a46ed68e-b13a-4bc4-8c28-719c42448048 service nova] Acquiring lock "refresh_cache-b28b1c5a-d62d-45e4-92a0-22891e57116e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:20:10 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:20:11 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Updating instance_info_cache with network_info: [{"id": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "address": "fa:16:3e:2b:cd:66", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd202eb6d-fa", "ovs_interfaceid": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:20:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Releasing lock "refresh_cache-b28b1c5a-d62d-45e4-92a0-22891e57116e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:20:11 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Instance network_info: |[{"id": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "address": "fa:16:3e:2b:cd:66", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd202eb6d-fa", "ovs_interfaceid": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:20:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a49cffc2-355e-44f6-9ad6-130eaa846de1 req-a46ed68e-b13a-4bc4-8c28-719c42448048 service nova] Acquired lock "refresh_cache-b28b1c5a-d62d-45e4-92a0-22891e57116e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:20:11 user nova-compute[75246]: DEBUG nova.network.neutron [req-a49cffc2-355e-44f6-9ad6-130eaa846de1 req-a46ed68e-b13a-4bc4-8c28-719c42448048 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Refreshing network info cache for port d202eb6d-fad6-4c7b-8f5d-80abb1761aaf {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:20:11 user nova-compute[75246]: DEBUG nova.network.neutron [req-a49cffc2-355e-44f6-9ad6-130eaa846de1 req-a46ed68e-b13a-4bc4-8c28-719c42448048 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Updated VIF entry in instance network info cache for port d202eb6d-fad6-4c7b-8f5d-80abb1761aaf. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:20:11 user nova-compute[75246]: DEBUG nova.network.neutron [req-a49cffc2-355e-44f6-9ad6-130eaa846de1 req-a46ed68e-b13a-4bc4-8c28-719c42448048 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Updating instance_info_cache with network_info: [{"id": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "address": "fa:16:3e:2b:cd:66", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd202eb6d-fa", "ovs_interfaceid": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:20:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a49cffc2-355e-44f6-9ad6-130eaa846de1 req-a46ed68e-b13a-4bc4-8c28-719c42448048 service nova] Releasing lock "refresh_cache-b28b1c5a-d62d-45e4-92a0-22891e57116e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:20:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:20:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Creating image(s)
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Did not create local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Ensure instance console log exists: /opt/stack/data/nova/instances/b28b1c5a-d62d-45e4-92a0-22891e57116e/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Start _get_guest_xml network_info=[{"id": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "address": "fa:16:3e:2b:cd:66", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd202eb6d-fa", "ovs_interfaceid": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'f20b4131-fdd8-46cd-a2ab-efa62a572f9c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goEuwIjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b28b1c5a-d62d-45e4-92a0-22891e57116e', 'attached_at': '', 'detached_at': '', 'volume_id': '816a4875-3799-4b5e-aac5-f1461aca0f75', 'serial': '816a4875-3799-4b5e-aac5-f1461aca0f75'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:20:16 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:20:16 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goEuwIjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:20:16 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:20:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:20:16 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:20:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:20:16 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c868fe8b-877c-403f-ba07-d00573e2360e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:20:16 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d054fcc7-3014-4341-b9bb-77d537cdfc18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75] added
Nov 28 17:20:16 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e376c87c-c8f7-4f08-abea-584a9cd94ad9]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdea231-81ab-4c28-a8a9-f570c4f78a2b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v goEuwIjf {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v goEuwIjf" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae7360f-a609-42cf-9ed1-4ed92b4fe964]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'goEuwIjf'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d14e0a7-9bd2-4158-9fe8-be469c5aee35]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98919ef-2cf0-4cb1-940a-764ef78f8c86]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:20:16 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:20:16 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:20:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[970fb0ad-4a77-479d-8d27-507e46c233f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75, portal: 172.16.0.220,3260]
Nov 28 17:20:17 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75, portal: 172.16.0.220,3260] successful.
Nov 28 17:20:17 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[395225cc-fb12-48b3-9873-6787e694ecd0]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacee87c-9fdd-4354-ad05-23029387f2a7]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:20:17 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:20:17 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:20:17 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:20:17 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d42c9ca-4fee-4e1f-8a8e-81e07224f488]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:17 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goEuwIjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23538666564313061', 'path': '/dev/sdc'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538666564313061', 'path': '/dev/sdc'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-401495269',display_name='tempest-TestVolumeBootPattern-server-401495269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-401495269',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrg6dgmwLxM+qOiUQmkZP+lby3sIcjedzAt6Qr2Vg5lrRzmZuOCIGPTCAvsPt68uI6UbSOJN/oyUTe5OqihGAovpc3vgI5qK/6ApsKxZfDXJBHGmnIe3WgtSfAKkR6e4g==',key_name='tempest-TestVolumeBootPattern-1591090964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe0eebdd39c54a74be8d2e0f9842b165',ramdisk_id='',reservation_id='r-9ec00tga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-389869337',owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:20:10Z,user_data=None,user_id='c334f73c5bf1473aadf865c8f032c0cb',uuid=b28b1c5a-d62d-45e4-92a0-22891e57116e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "address": "fa:16:3e:2b:cd:66", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd202eb6d-fa", "ovs_interfaceid": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converting VIF {"id": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "address": "fa:16:3e:2b:cd:66", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd202eb6d-fa", "ovs_interfaceid": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:cd:66,bridge_name='br-int',has_traffic_filtering=True,id=d202eb6d-fad6-4c7b-8f5d-80abb1761aaf,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd202eb6d-fa') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG nova.objects.instance [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lazy-loading 'pci_devices' on Instance uuid b28b1c5a-d62d-45e4-92a0-22891e57116e {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:20:18 user nova-compute[75246]:   <uuid>b28b1c5a-d62d-45e4-92a0-22891e57116e</uuid>
Nov 28 17:20:18 user nova-compute[75246]:   <name>instance-0000002b</name>
Nov 28 17:20:18 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:20:18 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:20:18 user nova-compute[75246]:   <metadata>
Nov 28 17:20:18 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:20:18 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:20:18 user nova-compute[75246]:       <nova:name>tempest-TestVolumeBootPattern-server-401495269</nova:name>
Nov 28 17:20:18 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:20:16</nova:creationTime>
Nov 28 17:20:18 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:20:18 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:20:18 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:20:18 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:20:18 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:20:18 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:20:18 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:20:18 user nova-compute[75246]:       <nova:owner>
Nov 28 17:20:18 user nova-compute[75246]:         <nova:user uuid="c334f73c5bf1473aadf865c8f032c0cb">tempest-TestVolumeBootPattern-389869337-project-member</nova:user>
Nov 28 17:20:18 user nova-compute[75246]:         <nova:project uuid="fe0eebdd39c54a74be8d2e0f9842b165">tempest-TestVolumeBootPattern-389869337</nova:project>
Nov 28 17:20:18 user nova-compute[75246]:       </nova:owner>
Nov 28 17:20:18 user nova-compute[75246]:       <nova:ports>
Nov 28 17:20:18 user nova-compute[75246]:         <nova:port uuid="d202eb6d-fad6-4c7b-8f5d-80abb1761aaf">
Nov 28 17:20:18 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 17:20:18 user nova-compute[75246]:         </nova:port>
Nov 28 17:20:18 user nova-compute[75246]:       </nova:ports>
Nov 28 17:20:18 user nova-compute[75246]:     </nova:instance>
Nov 28 17:20:18 user nova-compute[75246]:   </metadata>
Nov 28 17:20:18 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:20:18 user nova-compute[75246]:     <system>
Nov 28 17:20:18 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:20:18 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:20:18 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:20:18 user nova-compute[75246]:       <entry name="serial">b28b1c5a-d62d-45e4-92a0-22891e57116e</entry>
Nov 28 17:20:18 user nova-compute[75246]:       <entry name="uuid">b28b1c5a-d62d-45e4-92a0-22891e57116e</entry>
Nov 28 17:20:18 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:20:18 user nova-compute[75246]:     </system>
Nov 28 17:20:18 user nova-compute[75246]:   </sysinfo>
Nov 28 17:20:18 user nova-compute[75246]:   <os>
Nov 28 17:20:18 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:20:18 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:20:18 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:20:18 user nova-compute[75246]:   </os>
Nov 28 17:20:18 user nova-compute[75246]:   <features>
Nov 28 17:20:18 user nova-compute[75246]:     <acpi/>
Nov 28 17:20:18 user nova-compute[75246]:     <apic/>
Nov 28 17:20:18 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:20:18 user nova-compute[75246]:   </features>
Nov 28 17:20:18 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:20:18 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:20:18 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:20:18 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:20:18 user nova-compute[75246]:   </clock>
Nov 28 17:20:18 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:20:18 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:20:18 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:20:18 user nova-compute[75246]:   </cpu>
Nov 28 17:20:18 user nova-compute[75246]:   <devices>
Nov 28 17:20:18 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:20:18 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:20:18 user nova-compute[75246]:       <source dev="/dev/sdc"/>
Nov 28 17:20:18 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:20:18 user nova-compute[75246]:       <serial>816a4875-3799-4b5e-aac5-f1461aca0f75</serial>
Nov 28 17:20:18 user nova-compute[75246]:     </disk>
Nov 28 17:20:18 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:20:18 user nova-compute[75246]:       <mac address="fa:16:3e:2b:cd:66"/>
Nov 28 17:20:18 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:20:18 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:20:18 user nova-compute[75246]:       <target dev="tapd202eb6d-fa"/>
Nov 28 17:20:18 user nova-compute[75246]:     </interface>
Nov 28 17:20:18 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:20:18 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/b28b1c5a-d62d-45e4-92a0-22891e57116e/console.log" append="off"/>
Nov 28 17:20:18 user nova-compute[75246]:     </serial>
Nov 28 17:20:18 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:20:18 user nova-compute[75246]:     <video>
Nov 28 17:20:18 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:20:18 user nova-compute[75246]:     </video>
Nov 28 17:20:18 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:20:18 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:20:18 user nova-compute[75246]:     </rng>
Nov 28 17:20:18 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:20:18 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:20:18 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:20:18 user nova-compute[75246]:     </memballoon>
Nov 28 17:20:18 user nova-compute[75246]:   </devices>
Nov 28 17:20:18 user nova-compute[75246]: </domain>
Nov 28 17:20:18 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-401495269',display_name='tempest-TestVolumeBootPattern-server-401495269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-401495269',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrg6dgmwLxM+qOiUQmkZP+lby3sIcjedzAt6Qr2Vg5lrRzmZuOCIGPTCAvsPt68uI6UbSOJN/oyUTe5OqihGAovpc3vgI5qK/6ApsKxZfDXJBHGmnIe3WgtSfAKkR6e4g==',key_name='tempest-TestVolumeBootPattern-1591090964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe0eebdd39c54a74be8d2e0f9842b165',ramdisk_id='',reservation_id='r-9ec00tga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-389869337',owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:20:10Z,user_data=None,user_id='c334f73c5bf1473aadf865c8f032c0cb',uuid=b28b1c5a-d62d-45e4-92a0-22891e57116e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "address": "fa:16:3e:2b:cd:66", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd202eb6d-fa", "ovs_interfaceid": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converting VIF {"id": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "address": "fa:16:3e:2b:cd:66", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd202eb6d-fa", "ovs_interfaceid": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:cd:66,bridge_name='br-int',has_traffic_filtering=True,id=d202eb6d-fad6-4c7b-8f5d-80abb1761aaf,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd202eb6d-fa') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG os_vif [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:cd:66,bridge_name='br-int',has_traffic_filtering=True,id=d202eb6d-fad6-4c7b-8f5d-80abb1761aaf,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd202eb6d-fa') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '887acec1-1814-5097-bcbd-66024029f76a', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd202eb6d-fa, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd202eb6d-fa, col_values=(('qos', UUID('054e1f29-1a97-4948-baa8-f04546cb041e')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd202eb6d-fa, col_values=(('external_ids', {'iface-id': 'd202eb6d-fad6-4c7b-8f5d-80abb1761aaf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:cd:66', 'vm-uuid': 'b28b1c5a-d62d-45e4-92a0-22891e57116e'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:18 user nova-compute[75246]: INFO os_vif [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:cd:66,bridge_name='br-int',has_traffic_filtering=True,id=d202eb6d-fad6-4c7b-8f5d-80abb1761aaf,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd202eb6d-fa')
Nov 28 17:20:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:20:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] No VIF found with MAC fa:16:3e:2b:cd:66, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:20:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:19 user nova-compute[75246]: DEBUG nova.compute.manager [req-59870a73-5df8-42e5-bda8-f27af738ce91 req-f0a10556-3295-47bc-94fa-462926858361 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Received event network-vif-plugged-d202eb6d-fad6-4c7b-8f5d-80abb1761aaf {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:20:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-59870a73-5df8-42e5-bda8-f27af738ce91 req-f0a10556-3295-47bc-94fa-462926858361 service nova] Acquiring lock "b28b1c5a-d62d-45e4-92a0-22891e57116e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-59870a73-5df8-42e5-bda8-f27af738ce91 req-f0a10556-3295-47bc-94fa-462926858361 service nova] Lock "b28b1c5a-d62d-45e4-92a0-22891e57116e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-59870a73-5df8-42e5-bda8-f27af738ce91 req-f0a10556-3295-47bc-94fa-462926858361 service nova] Lock "b28b1c5a-d62d-45e4-92a0-22891e57116e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:19 user nova-compute[75246]: DEBUG nova.compute.manager [req-59870a73-5df8-42e5-bda8-f27af738ce91 req-f0a10556-3295-47bc-94fa-462926858361 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] No waiting events found dispatching network-vif-plugged-d202eb6d-fad6-4c7b-8f5d-80abb1761aaf {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:20:19 user nova-compute[75246]: WARNING nova.compute.manager [req-59870a73-5df8-42e5-bda8-f27af738ce91 req-f0a10556-3295-47bc-94fa-462926858361 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Received unexpected event network-vif-plugged-d202eb6d-fad6-4c7b-8f5d-80abb1761aaf for instance with vm_state building and task_state spawning.
Nov 28 17:20:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG nova.objects.instance [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lazy-loading 'flavor' on Instance uuid 5175a016-3237-4e79-bc77-4b72e5402695 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:20 user nova-compute[75246]: INFO nova.compute.manager [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Attaching volume afd09eeb-134c-45c6-b4be-2234d0b7f980 to /dev/vdb
Nov 28 17:20:20 user nova-compute[75246]: DEBUG os_brick.utils [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[776ccf1b-5abe-438b-b772-993945bbd26a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fc3638-8209-4160-b130-0b4510610cd1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8690577-aaa3-4370-86cc-57e08ded38ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1305a03-59cf-48aa-b906-57c728ee00d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:20:20 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:20:20 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0385e30-f347-4f93-aa67-136700026dca]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG os_brick.utils [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:20:20 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Updating existing volume attachment record: 7a441f83-347d-49b1-b3db-a25c53c4dd7c {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:20:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:21 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:20:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:20:21 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Instance spawned successfully.
Nov 28 17:20:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:20:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:20:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:20:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:20:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:20:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:20:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:20:21 user nova-compute[75246]: INFO nova.compute.manager [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Took 5.15 seconds to spawn the instance on the hypervisor.
Nov 28 17:20:21 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:20:21 user nova-compute[75246]: DEBUG nova.compute.manager [req-16ad31db-3ba8-4bfc-a1b2-7f62c4074db9 req-84bf7409-f42f-4078-8056-20b75cdec101 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Received event network-vif-plugged-d202eb6d-fad6-4c7b-8f5d-80abb1761aaf {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:20:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-16ad31db-3ba8-4bfc-a1b2-7f62c4074db9 req-84bf7409-f42f-4078-8056-20b75cdec101 service nova] Acquiring lock "b28b1c5a-d62d-45e4-92a0-22891e57116e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-16ad31db-3ba8-4bfc-a1b2-7f62c4074db9 req-84bf7409-f42f-4078-8056-20b75cdec101 service nova] Lock "b28b1c5a-d62d-45e4-92a0-22891e57116e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-16ad31db-3ba8-4bfc-a1b2-7f62c4074db9 req-84bf7409-f42f-4078-8056-20b75cdec101 service nova] Lock "b28b1c5a-d62d-45e4-92a0-22891e57116e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:21 user nova-compute[75246]: DEBUG nova.compute.manager [req-16ad31db-3ba8-4bfc-a1b2-7f62c4074db9 req-84bf7409-f42f-4078-8056-20b75cdec101 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] No waiting events found dispatching network-vif-plugged-d202eb6d-fad6-4c7b-8f5d-80abb1761aaf {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:20:21 user nova-compute[75246]: WARNING nova.compute.manager [req-16ad31db-3ba8-4bfc-a1b2-7f62c4074db9 req-84bf7409-f42f-4078-8056-20b75cdec101 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Received unexpected event network-vif-plugged-d202eb6d-fad6-4c7b-8f5d-80abb1761aaf for instance with vm_state building and task_state spawning.
Nov 28 17:20:21 user nova-compute[75246]: INFO nova.compute.manager [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Took 13.05 seconds to build instance.
Nov 28 17:20:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9b561376-652a-422e-8072-010b21ad222d tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "b28b1c5a-d62d-45e4-92a0-22891e57116e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.142s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drVYkiTw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:20:27 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:20:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:20:27 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:20:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:20:27 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9e89a5-7f6d-4394-9c37-d17c8f8efa6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:20:27 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0ed1b8-0a33-4a33-8f5d-b71752a6b6a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980] added
Nov 28 17:20:27 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2faccd3-0370-465b-978a-baf32150cc28]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[748edbcc-57f0-4f93-ab3d-246a401941f0]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v drVYkiTw {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v drVYkiTw" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4fec7e-e2fa-4337-a64d-52d01e1e7d8f]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'drVYkiTw'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4784313d-b02a-4979-8045-bde201642e2e]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:27 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddb7fc8-b256-4fd8-a73c-cd1aabb7081f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:20:28 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:20:28 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:20:28 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:20:28 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d595aff-dd56-4ae3-aa9a-dd0f44ae6261]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980, portal: 172.16.0.220,3260]
Nov 28 17:20:28 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980, portal: 172.16.0.220,3260] successful.
Nov 28 17:20:28 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afe7112-9720-43ec-8446-ae6da335449b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7608f486-cd61-4105-9756-deb0a304576f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:20:28 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:20:28 user nova-compute[75246]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 (non-flash)
Nov 28 17:20:28 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:20:28 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:20:28 user nova-compute[75246]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 (non-flash)
Nov 28 17:20:28 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b695e2-a12b-46b1-b167-d3eeb0eca3fb]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drVYkiTw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:20:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:29 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:20:29 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26465396264623934', 'path': '/dev/sdd'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:20:29 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465396264623934', 'path': '/dev/sdd'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:20:29 user nova-compute[75246]: DEBUG nova.objects.instance [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lazy-loading 'flavor' on Instance uuid 5175a016-3237-4e79-bc77-4b72e5402695 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:20:29 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:20:29 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:20:29 user nova-compute[75246]:   <source dev="/dev/sdd"/>
Nov 28 17:20:29 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:20:29 user nova-compute[75246]:   <serial>afd09eeb-134c-45c6-b4be-2234d0b7f980</serial>
Nov 28 17:20:29 user nova-compute[75246]: </disk>
Nov 28 17:20:29 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:20:29 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:20:29 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:20:29 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] No VIF found with MAC fa:16:3e:f8:4f:00, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:20:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ba570aca-aab8-4caf-ade3-45298835ead6 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.254s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:30 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:20:30 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 17:20:31 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] There are 0 instances to clean {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 17:20:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:31 user nova-compute[75246]: INFO nova.compute.manager [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Detaching volume afd09eeb-134c-45c6-b4be-2234d0b7f980
Nov 28 17:20:31 user nova-compute[75246]: INFO nova.virt.block_device [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Attempting to driver detach volume afd09eeb-134c-45c6-b4be-2234d0b7f980 from mountpoint /dev/vdb
Nov 28 17:20:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Attempting to detach device vdb from instance 5175a016-3237-4e79-bc77-4b72e5402695 from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:20:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:20:31 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:20:31 user nova-compute[75246]:   <source dev="/dev/sdd"/>
Nov 28 17:20:31 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:20:31 user nova-compute[75246]:   <serial>afd09eeb-134c-45c6-b4be-2234d0b7f980</serial>
Nov 28 17:20:31 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:20:31 user nova-compute[75246]: </disk>
Nov 28 17:20:31 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:20:31 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Successfully detached device vdb from instance 5175a016-3237-4e79-bc77-4b72e5402695 from the persistent domain config.
Nov 28 17:20:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5175a016-3237-4e79-bc77-4b72e5402695 from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:20:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:20:31 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:20:31 user nova-compute[75246]:   <source dev="/dev/sdd"/>
Nov 28 17:20:31 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:20:31 user nova-compute[75246]:   <serial>afd09eeb-134c-45c6-b4be-2234d0b7f980</serial>
Nov 28 17:20:31 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:20:31 user nova-compute[75246]: </disk>
Nov 28 17:20:31 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:20:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5175a016-3237-4e79-bc77-4b72e5402695 {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:20:33 user nova-compute[75246]: INFO nova.compute.manager [None req-0a0ea67a-591d-47a9-9566-3f383ce62f92 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Unrescuing
Nov 28 17:20:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0a0ea67a-591d-47a9-9566-3f383ce62f92 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:20:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0a0ea67a-591d-47a9-9566-3f383ce62f92 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquired lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:20:33 user nova-compute[75246]: DEBUG nova.network.neutron [None req-0a0ea67a-591d-47a9-9566-3f383ce62f92 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:20:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:33 user nova-compute[75246]: DEBUG nova.network.neutron [None req-0a0ea67a-591d-47a9-9566-3f383ce62f92 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Updating instance_info_cache with network_info: [{"id": "a311cb50-be83-4bf0-b889-d02170d667d6", "address": "fa:16:3e:65:bd:fb", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa311cb50-be", "ovs_interfaceid": "a311cb50-be83-4bf0-b889-d02170d667d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:20:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0a0ea67a-591d-47a9-9566-3f383ce62f92 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Releasing lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:20:33 user nova-compute[75246]: DEBUG nova.objects.instance [None req-0a0ea67a-591d-47a9-9566-3f383ce62f92 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'flavor' on Instance uuid a796152e-e8df-41bf-a5ea-ae94d4fa8b41 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:20:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:33 user nova-compute[75246]: DEBUG nova.compute.manager [req-1d9f4396-b50f-4f23-be57-b1de4617acd3 req-585dbd09-072c-4319-9540-0775b2f9033b service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-vif-unplugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:20:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1d9f4396-b50f-4f23-be57-b1de4617acd3 req-585dbd09-072c-4319-9540-0775b2f9033b service nova] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1d9f4396-b50f-4f23-be57-b1de4617acd3 req-585dbd09-072c-4319-9540-0775b2f9033b service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1d9f4396-b50f-4f23-be57-b1de4617acd3 req-585dbd09-072c-4319-9540-0775b2f9033b service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:33 user nova-compute[75246]: DEBUG nova.compute.manager [req-1d9f4396-b50f-4f23-be57-b1de4617acd3 req-585dbd09-072c-4319-9540-0775b2f9033b service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] No waiting events found dispatching network-vif-unplugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:20:33 user nova-compute[75246]: WARNING nova.compute.manager [req-1d9f4396-b50f-4f23-be57-b1de4617acd3 req-585dbd09-072c-4319-9540-0775b2f9033b service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received unexpected event network-vif-unplugged-a311cb50-be83-4bf0-b889-d02170d667d6 for instance with vm_state rescued and task_state unrescuing.
Nov 28 17:20:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Instance destroyed successfully.
Nov 28 17:20:35 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG nova.compute.manager [req-b7e7b8c8-d6bb-4a6f-9750-d97e2acf3349 req-2138bc28-b842-47d8-8753-36b59eb025fd service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b7e7b8c8-d6bb-4a6f-9750-d97e2acf3349 req-2138bc28-b842-47d8-8753-36b59eb025fd service nova] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b7e7b8c8-d6bb-4a6f-9750-d97e2acf3349 req-2138bc28-b842-47d8-8753-36b59eb025fd service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b7e7b8c8-d6bb-4a6f-9750-d97e2acf3349 req-2138bc28-b842-47d8-8753-36b59eb025fd service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG nova.compute.manager [req-b7e7b8c8-d6bb-4a6f-9750-d97e2acf3349 req-2138bc28-b842-47d8-8753-36b59eb025fd service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] No waiting events found dispatching network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:20:35 user nova-compute[75246]: WARNING nova.compute.manager [req-b7e7b8c8-d6bb-4a6f-9750-d97e2acf3349 req-2138bc28-b842-47d8-8753-36b59eb025fd service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received unexpected event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 for instance with vm_state rescued and task_state unrescuing.
Nov 28 17:20:35 user nova-compute[75246]: DEBUG nova.compute.manager [req-b7e7b8c8-d6bb-4a6f-9750-d97e2acf3349 req-2138bc28-b842-47d8-8753-36b59eb025fd service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b7e7b8c8-d6bb-4a6f-9750-d97e2acf3349 req-2138bc28-b842-47d8-8753-36b59eb025fd service nova] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b7e7b8c8-d6bb-4a6f-9750-d97e2acf3349 req-2138bc28-b842-47d8-8753-36b59eb025fd service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b7e7b8c8-d6bb-4a6f-9750-d97e2acf3349 req-2138bc28-b842-47d8-8753-36b59eb025fd service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG nova.compute.manager [req-b7e7b8c8-d6bb-4a6f-9750-d97e2acf3349 req-2138bc28-b842-47d8-8753-36b59eb025fd service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] No waiting events found dispatching network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:20:35 user nova-compute[75246]: WARNING nova.compute.manager [req-b7e7b8c8-d6bb-4a6f-9750-d97e2acf3349 req-2138bc28-b842-47d8-8753-36b59eb025fd service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received unexpected event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 for instance with vm_state rescued and task_state unrescuing.
Nov 28 17:20:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:20:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:20:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:37 user nova-compute[75246]: DEBUG nova.compute.manager [None req-0a0ea67a-591d-47a9-9566-3f383ce62f92 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:20:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:37 user nova-compute[75246]: DEBUG nova.compute.manager [req-249e3f7f-e20b-4e8e-891e-bce349b69b6f req-7725fe30-637b-40db-8094-a351b5a03314 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:20:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-249e3f7f-e20b-4e8e-891e-bce349b69b6f req-7725fe30-637b-40db-8094-a351b5a03314 service nova] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-249e3f7f-e20b-4e8e-891e-bce349b69b6f req-7725fe30-637b-40db-8094-a351b5a03314 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-249e3f7f-e20b-4e8e-891e-bce349b69b6f req-7725fe30-637b-40db-8094-a351b5a03314 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:37 user nova-compute[75246]: DEBUG nova.compute.manager [req-249e3f7f-e20b-4e8e-891e-bce349b69b6f req-7725fe30-637b-40db-8094-a351b5a03314 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] No waiting events found dispatching network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:20:37 user nova-compute[75246]: WARNING nova.compute.manager [req-249e3f7f-e20b-4e8e-891e-bce349b69b6f req-7725fe30-637b-40db-8094-a351b5a03314 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received unexpected event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 for instance with vm_state active and task_state None.
Nov 28 17:20:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:38 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:20:38 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:20:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=7749MB free_disk=25.133651733398438GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c94900af-f484-47bf-8627-8aa863334b63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a796152e-e8df-41bf-a5ea-ae94d4fa8b41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 5175a016-3237-4e79-bc77-4b72e5402695 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 1a520141-ac59-407a-a525-b3fe402e8cd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance d324ffda-861e-47dd-afb5-f034e7b98cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 81104ec7-670f-417b-926f-9ee8f7c5d659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance b28b1c5a-d62d-45e4-92a0-22891e57116e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing inventories for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating ProviderTree inventory for provider 241ad926-9deb-44ba-a618-a49e4ac21089 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating inventory in ProviderTree for provider 241ad926-9deb-44ba-a618-a49e4ac21089 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing aggregate associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, aggregates: None {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 17:20:38 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing trait associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 17:20:39 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:20:39 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:20:39 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:20:39 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.629s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:20:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:20:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:20:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:20:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:20:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:20:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:20:40 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:20:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:20:42 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75246) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 17:20:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "c94900af-f484-47bf-8627-8aa863334b63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "c94900af-f484-47bf-8627-8aa863334b63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "c94900af-f484-47bf-8627-8aa863334b63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:43 user nova-compute[75246]: INFO nova.compute.manager [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Terminating instance
Nov 28 17:20:43 user nova-compute[75246]: DEBUG nova.compute.manager [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:20:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:43 user nova-compute[75246]: DEBUG nova.compute.manager [req-9244f0ac-9ddf-4ef8-be5b-14cff1b457a9 req-80da56a3-19a7-4f11-8ea5-00aa1f806c97 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received event network-vif-unplugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:20:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9244f0ac-9ddf-4ef8-be5b-14cff1b457a9 req-80da56a3-19a7-4f11-8ea5-00aa1f806c97 service nova] Acquiring lock "c94900af-f484-47bf-8627-8aa863334b63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9244f0ac-9ddf-4ef8-be5b-14cff1b457a9 req-80da56a3-19a7-4f11-8ea5-00aa1f806c97 service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9244f0ac-9ddf-4ef8-be5b-14cff1b457a9 req-80da56a3-19a7-4f11-8ea5-00aa1f806c97 service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:43 user nova-compute[75246]: DEBUG nova.compute.manager [req-9244f0ac-9ddf-4ef8-be5b-14cff1b457a9 req-80da56a3-19a7-4f11-8ea5-00aa1f806c97 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] No waiting events found dispatching network-vif-unplugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:20:43 user nova-compute[75246]: DEBUG nova.compute.manager [req-9244f0ac-9ddf-4ef8-be5b-14cff1b457a9 req-80da56a3-19a7-4f11-8ea5-00aa1f806c97 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received event network-vif-unplugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:20:43 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:20:43 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-894da7a3-9c67-417e-b0f4-306335a533e6" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-894da7a3-9c67-417e-b0f4-306335a533e6" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:20:44 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: c94900af-f484-47bf-8627-8aa863334b63] Instance destroyed successfully.
Nov 28 17:20:44 user nova-compute[75246]: DEBUG nova.objects.instance [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lazy-loading 'resources' on Instance uuid c94900af-f484-47bf-8627-8aa863334b63 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2005498461',display_name='tempest-ServerRescueNegativeTestJSON-server-2005498461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2005498461',id=16,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:08:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60768e53b1e3414cb05eaaf23d382493',ramdisk_id='',reservation_id='r-14jvvyem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-220335783',owner_user_name='tempest-ServerRescueNegativeTestJSON-220335783-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:10:25Z,user_data=None,user_id='b79c4440e4734a2f82b08de54ed61737',uuid=c94900af-f484-47bf-8627-8aa863334b63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "address": "fa:16:3e:e3:8a:cb", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dca6bfe-f1", "ovs_interfaceid": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converting VIF {"id": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "address": "fa:16:3e:e3:8a:cb", "network": {"id": "23924971-5b71-4b9f-9625-3122d656d221", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1692647331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60768e53b1e3414cb05eaaf23d382493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dca6bfe-f1", "ovs_interfaceid": "2dca6bfe-f162-4bdd-af7f-af991de90b52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:8a:cb,bridge_name='br-int',has_traffic_filtering=True,id=2dca6bfe-f162-4bdd-af7f-af991de90b52,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dca6bfe-f1') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG os_vif [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:8a:cb,bridge_name='br-int',has_traffic_filtering=True,id=2dca6bfe-f162-4bdd-af7f-af991de90b52,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dca6bfe-f1') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dca6bfe-f1, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe20d084-4f59-456b-8fd7-63da5b0dbd53) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:20:44 user nova-compute[75246]: INFO os_vif [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:8a:cb,bridge_name='br-int',has_traffic_filtering=True,id=2dca6bfe-f162-4bdd-af7f-af991de90b52,network=Network(23924971-5b71-4b9f-9625-3122d656d221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dca6bfe-f1')
Nov 28 17:20:44 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Deleting instance files /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63_del
Nov 28 17:20:44 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Deletion of /opt/stack/data/nova/instances/c94900af-f484-47bf-8627-8aa863334b63_del complete
Nov 28 17:20:44 user nova-compute[75246]: INFO nova.compute.manager [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] [instance: c94900af-f484-47bf-8627-8aa863334b63] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 28 17:20:44 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: c94900af-f484-47bf-8627-8aa863334b63] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: c94900af-f484-47bf-8627-8aa863334b63] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Updating instance_info_cache with network_info: [{"id": "003f5480-4452-4891-8713-532403877f31", "address": "fa:16:3e:8d:b0:79", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap003f5480-44", "ovs_interfaceid": "003f5480-4452-4891-8713-532403877f31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-894da7a3-9c67-417e-b0f4-306335a533e6" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: c94900af-f484-47bf-8627-8aa863334b63] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:20:44 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: c94900af-f484-47bf-8627-8aa863334b63] Took 0.51 seconds to deallocate network for instance.
Nov 28 17:20:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:45 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:20:45 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:20:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:45 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Deleted allocations for instance c94900af-f484-47bf-8627-8aa863334b63
Nov 28 17:20:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-869923da-0fd8-487d-b3d3-95ad2a8d80f0 tempest-ServerRescueNegativeTestJSON-220335783 tempest-ServerRescueNegativeTestJSON-220335783-project-member] Lock "c94900af-f484-47bf-8627-8aa863334b63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.667s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-54dc7f74-763e-4b6f-b386-425e2e7f0017 req-d5b8cf85-5b27-48ca-95be-1d3e6de43707 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received event network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:20:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-54dc7f74-763e-4b6f-b386-425e2e7f0017 req-d5b8cf85-5b27-48ca-95be-1d3e6de43707 service nova] Acquiring lock "c94900af-f484-47bf-8627-8aa863334b63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:20:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-54dc7f74-763e-4b6f-b386-425e2e7f0017 req-d5b8cf85-5b27-48ca-95be-1d3e6de43707 service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:20:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-54dc7f74-763e-4b6f-b386-425e2e7f0017 req-d5b8cf85-5b27-48ca-95be-1d3e6de43707 service nova] Lock "c94900af-f484-47bf-8627-8aa863334b63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-54dc7f74-763e-4b6f-b386-425e2e7f0017 req-d5b8cf85-5b27-48ca-95be-1d3e6de43707 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] No waiting events found dispatching network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:20:45 user nova-compute[75246]: WARNING nova.compute.manager [req-54dc7f74-763e-4b6f-b386-425e2e7f0017 req-d5b8cf85-5b27-48ca-95be-1d3e6de43707 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received unexpected event network-vif-plugged-2dca6bfe-f162-4bdd-af7f-af991de90b52 for instance with vm_state deleted and task_state None.
Nov 28 17:20:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-54dc7f74-763e-4b6f-b386-425e2e7f0017 req-d5b8cf85-5b27-48ca-95be-1d3e6de43707 service nova] [instance: c94900af-f484-47bf-8627-8aa863334b63] Received event network-vif-deleted-2dca6bfe-f162-4bdd-af7f-af991de90b52 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:20:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:52 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5175a016-3237-4e79-bc77-4b72e5402695 is timed out.
Nov 28 17:20:52 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Successfully detached device vdb from instance 5175a016-3237-4e79-bc77-4b72e5402695 from the live domain config.
Nov 28 17:20:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drVYkiTw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:20:52 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c194211-7fa9-45e8-9cb8-41bdd0ec30d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:20:52 user nova-compute[75246]: No targets found.
Nov 28 17:20:52 user nova-compute[75246]: iSNS:
Nov 28 17:20:52 user nova-compute[75246]: No targets found.
Nov 28 17:20:52 user nova-compute[75246]: STATIC:
Nov 28 17:20:52 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75
Nov 28 17:20:52 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:20:52 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:20:52 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980
Nov 28 17:20:52 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:20:52 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:20:52 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:20:52 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:20:52 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:20:52 user nova-compute[75246]: FIRMWARE:
Nov 28 17:20:52 user nova-compute[75246]: No targets found.
Nov 28 17:20:52 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:20:52 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:20:52 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf984a3-e46a-4c1b-b823-19eb29487046]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6236d2e3-bb02-4b48-b246-0d69c8bc5e1d]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:20:52 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:20:52 user nova-compute[75246]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 (non-flash)
Nov 28 17:20:52 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:20:52 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:20:52 user nova-compute[75246]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 (non-flash)
Nov 28 17:20:52 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d85a2dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980'): ({'sdd'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Removing single pathed devices sdd {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81effb2-072f-460a-84cc-dad244429ac7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae21997-569e-4829-a9af-f1f4d82c802c]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Flushing IO for device /dev/sdd {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ec0547-0067-4efc-bdc3-b15eaee5ac6d]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f6a7f8-0393-4cb6-93f7-29ff51b55c96]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac02725-5ff4-4ad5-90dc-f64261973e85]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[37602298-865d-4e2d-a795-7c65fe9ad33f]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980, portal: 172.16.0.220,3260]
Nov 28 17:20:52 user nova-compute[75246]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980, portal: 172.16.0.220,3260] successful.
Nov 28 17:20:52 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd09eeb-134c-45c6-b4be-2234d0b7f980 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73bf59c-dd7f-44aa-9ce2-fe091183d5ac]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] <== disconnect_volume: return (298ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:20:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:20:53 user nova-compute[75246]: DEBUG nova.objects.instance [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lazy-loading 'flavor' on Instance uuid 5175a016-3237-4e79-bc77-4b72e5402695 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:20:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-925af342-ff56-49f6-88bc-8b0b9a04a7da tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.665s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:20:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:20:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:20:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:20:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:20:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:20:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:03 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:21:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:21:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:21:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:21:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:21:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:21:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:21:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:21:24 user nova-compute[75246]: DEBUG nova.objects.instance [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lazy-loading 'flavor' on Instance uuid 5175a016-3237-4e79-bc77-4b72e5402695 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:21:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:21:25 user nova-compute[75246]: INFO nova.compute.manager [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Attaching volume 46b8537a-2ec5-48db-9fb4-3198ad896500 to /dev/vdb
Nov 28 17:21:25 user nova-compute[75246]: DEBUG os_brick.utils [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0eed42f-e667-44ce-a229-aac0f1a8b18d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b1d10d-0d8d-4a48-ac18-761ca1649d6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fa852f-0056-4e22-a195-fc464db7e0ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[274576b9-2f0f-4a6c-a7d8-6c885c5b96d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:21:25 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:21:25 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3125aa7-0aa5-487f-b23f-a794aaef445c]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG os_brick.utils [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:21:25 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Updating existing volume attachment record: 081ffe4d-b7f6-4921-b1f8-4712112e571d {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:21:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-42edfd21-5cd4-421e-b358-80e47148afef req-e5191c3a-61f3-416f-8b45-aa719b0a68e0 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received event network-changed-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:21:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-42edfd21-5cd4-421e-b358-80e47148afef req-e5191c3a-61f3-416f-8b45-aa719b0a68e0 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Refreshing instance network info cache due to event network-changed-82c2968b-a7ec-41d6-924f-25ce67ec14b1. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:21:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-42edfd21-5cd4-421e-b358-80e47148afef req-e5191c3a-61f3-416f-8b45-aa719b0a68e0 service nova] Acquiring lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:21:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-42edfd21-5cd4-421e-b358-80e47148afef req-e5191c3a-61f3-416f-8b45-aa719b0a68e0 service nova] Acquired lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:21:30 user nova-compute[75246]: DEBUG nova.network.neutron [req-42edfd21-5cd4-421e-b358-80e47148afef req-e5191c3a-61f3-416f-8b45-aa719b0a68e0 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Refreshing network info cache for port 82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:21:31 user nova-compute[75246]: DEBUG nova.network.neutron [req-42edfd21-5cd4-421e-b358-80e47148afef req-e5191c3a-61f3-416f-8b45-aa719b0a68e0 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Updated VIF entry in instance network info cache for port 82c2968b-a7ec-41d6-924f-25ce67ec14b1. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:21:31 user nova-compute[75246]: DEBUG nova.network.neutron [req-42edfd21-5cd4-421e-b358-80e47148afef req-e5191c3a-61f3-416f-8b45-aa719b0a68e0 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Updating instance_info_cache with network_info: [{"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:21:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-42edfd21-5cd4-421e-b358-80e47148afef req-e5191c3a-61f3-416f-8b45-aa719b0a68e0 service nova] Releasing lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:21:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:31 user nova-compute[75246]: DEBUG nova.compute.manager [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:21:32 user nova-compute[75246]: INFO nova.compute.manager [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] instance snapshotting
Nov 28 17:21:32 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Beginning live snapshot process
Nov 28 17:21:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZqOvmFNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:21:32 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:21:32 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:21:32 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b869e5-d2a5-40e6-ba81-3d388017636c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:21:32 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa9630c-29ca-420c-888d-3bd781a62f0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500] added
Nov 28 17:21:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[abeb9dba-ad94-4c1a-bf9d-7af3093a2c61]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f2991c-9b24-42c5-94c3-93f13851beec]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZqOvmFNl {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZqOvmFNl" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[765f5222-e703-4f1b-b85f-75334cfaa098]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZqOvmFNl'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0121d4-b227-4fd7-93f6-c98e25571e78]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[97589e4b-a878-41e8-b2d2-59bbba5d40a7]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:21:32 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:21:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:21:32 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:21:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json -f qcow2 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[04750f2f-29e7-437a-826f-f7f8bf1c56a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500, portal: 172.16.0.220,3260]
Nov 28 17:21:32 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500, portal: 172.16.0.220,3260] successful.
Nov 28 17:21:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[412a38df-03bb-4d60-8880-1418d4265569]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ae99ee-d61f-4c6f-a6bb-9dac98e6e86a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:21:32 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:21:32 user nova-compute[75246]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 (non-flash)
Nov 28 17:21:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:21:32 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:21:32 user nova-compute[75246]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 (non-flash)
Nov 28 17:21:32 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[94499147-78e3-4ae6-92d1-d4de1603c68d]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZqOvmFNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json -f qcow2 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.176s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk1y7hz73/d7b8578b33624041b2ac8392b9f72e6f.delta 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:32 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk1y7hz73/d7b8578b33624041b2ac8392b9f72e6f.delta 1073741824" returned: 0 in 0.050s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:32 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 17:21:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:21:33 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23664303236303037', 'path': '/dev/sdd'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:21:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664303236303037', 'path': '/dev/sdd'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:21:33 user nova-compute[75246]: DEBUG nova.objects.instance [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lazy-loading 'flavor' on Instance uuid 5175a016-3237-4e79-bc77-4b72e5402695 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:21:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:21:33 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:21:33 user nova-compute[75246]:   <source dev="/dev/sdd"/>
Nov 28 17:21:33 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:21:33 user nova-compute[75246]:   <serial>46b8537a-2ec5-48db-9fb4-3198ad896500</serial>
Nov 28 17:21:33 user nova-compute[75246]: </disk>
Nov 28 17:21:33 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:21:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:21:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:21:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:21:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] No VIF found with MAC fa:16:3e:f8:4f:00, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:21:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-434198e4-35c1-45ff-acee-0f90b8f2982d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.975s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:21:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:21:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 17:21:34 user nova-compute[75246]: DEBUG nova.privsep.utils [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75246) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 17:21:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk1y7hz73/d7b8578b33624041b2ac8392b9f72e6f.delta /opt/stack/data/nova/instances/snapshots/tmpk1y7hz73/d7b8578b33624041b2ac8392b9f72e6f {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk1y7hz73/d7b8578b33624041b2ac8392b9f72e6f.delta /opt/stack/data/nova/instances/snapshots/tmpk1y7hz73/d7b8578b33624041b2ac8392b9f72e6f" returned: 0 in 0.244s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Snapshot extracted, beginning image upload
Nov 28 17:21:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:34 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:21:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:21:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:21:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:21:35 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:21:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:21:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:21:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:21:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquiring lock "d324ffda-861e-47dd-afb5-f034e7b98cb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "d324ffda-861e-47dd-afb5-f034e7b98cb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquiring lock "d324ffda-861e-47dd-afb5-f034e7b98cb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "d324ffda-861e-47dd-afb5-f034e7b98cb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "d324ffda-861e-47dd-afb5-f034e7b98cb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:21:36 user nova-compute[75246]: INFO nova.compute.manager [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Terminating instance
Nov 28 17:21:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:21:36 user nova-compute[75246]: INFO nova.compute.manager [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Detaching volume 46b8537a-2ec5-48db-9fb4-3198ad896500
Nov 28 17:21:36 user nova-compute[75246]: INFO nova.virt.block_device [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Attempting to driver detach volume 46b8537a-2ec5-48db-9fb4-3198ad896500 from mountpoint /dev/vdb
Nov 28 17:21:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Attempting to detach device vdb from instance 5175a016-3237-4e79-bc77-4b72e5402695 from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:21:36 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:21:36 user nova-compute[75246]:   <source dev="/dev/sdd"/>
Nov 28 17:21:36 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:21:36 user nova-compute[75246]:   <serial>46b8537a-2ec5-48db-9fb4-3198ad896500</serial>
Nov 28 17:21:36 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:21:36 user nova-compute[75246]: </disk>
Nov 28 17:21:36 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:21:36 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Successfully detached device vdb from instance 5175a016-3237-4e79-bc77-4b72e5402695 from the persistent domain config.
Nov 28 17:21:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5175a016-3237-4e79-bc77-4b72e5402695 from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:21:36 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:21:36 user nova-compute[75246]:   <source dev="/dev/sdd"/>
Nov 28 17:21:36 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:21:36 user nova-compute[75246]:   <serial>46b8537a-2ec5-48db-9fb4-3198ad896500</serial>
Nov 28 17:21:36 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:21:36 user nova-compute[75246]: </disk>
Nov 28 17:21:36 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-31fe4753-4679-4423-9018-d02cb8c343c0 req-9571c6cb-9616-42ab-86c5-01627e79ab6c service nova] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Received event network-vif-unplugged-40cfd25e-6778-4193-817b-5b831a7e6cd0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-31fe4753-4679-4423-9018-d02cb8c343c0 req-9571c6cb-9616-42ab-86c5-01627e79ab6c service nova] Acquiring lock "d324ffda-861e-47dd-afb5-f034e7b98cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-31fe4753-4679-4423-9018-d02cb8c343c0 req-9571c6cb-9616-42ab-86c5-01627e79ab6c service nova] Lock "d324ffda-861e-47dd-afb5-f034e7b98cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-31fe4753-4679-4423-9018-d02cb8c343c0 req-9571c6cb-9616-42ab-86c5-01627e79ab6c service nova] Lock "d324ffda-861e-47dd-afb5-f034e7b98cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-31fe4753-4679-4423-9018-d02cb8c343c0 req-9571c6cb-9616-42ab-86c5-01627e79ab6c service nova] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] No waiting events found dispatching network-vif-unplugged-40cfd25e-6778-4193-817b-5b831a7e6cd0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-31fe4753-4679-4423-9018-d02cb8c343c0 req-9571c6cb-9616-42ab-86c5-01627e79ab6c service nova] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Received event network-vif-unplugged-40cfd25e-6778-4193-817b-5b831a7e6cd0 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5175a016-3237-4e79-bc77-4b72e5402695 {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:21:37 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Instance destroyed successfully.
Nov 28 17:21:37 user nova-compute[75246]: DEBUG nova.objects.instance [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lazy-loading 'resources' on Instance uuid d324ffda-861e-47dd-afb5-f034e7b98cb9 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:19:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1677046357',display_name='tempest-VolumesActionsTest-instance-1677046357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1677046357',id=41,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:19:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e932cfe5d8b84dff8d8826cd581ce086',ramdisk_id='',reservation_id='r-wk0qu2md',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1657173529',owner_user_name='tempest-VolumesActionsTest-1657173529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:19:52Z,user_data=None,user_id='9e5ebd975fea42b0af369d94360206c7',uuid=d324ffda-861e-47dd-afb5-f034e7b98cb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "address": "fa:16:3e:bf:5f:3a", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfd25e-67", "ovs_interfaceid": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Converting VIF {"id": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "address": "fa:16:3e:bf:5f:3a", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40cfd25e-67", "ovs_interfaceid": "40cfd25e-6778-4193-817b-5b831a7e6cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:5f:3a,bridge_name='br-int',has_traffic_filtering=True,id=40cfd25e-6778-4193-817b-5b831a7e6cd0,network=Network(0d612931-a2ce-4d23-ad5b-5e8c5abf33d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40cfd25e-67') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG os_vif [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:5f:3a,bridge_name='br-int',has_traffic_filtering=True,id=40cfd25e-6778-4193-817b-5b831a7e6cd0,network=Network(0d612931-a2ce-4d23-ad5b-5e8c5abf33d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40cfd25e-67') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40cfd25e-67, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70a11425-38b1-424f-b49c-c67b9ba3152a) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:37 user nova-compute[75246]: INFO os_vif [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:5f:3a,bridge_name='br-int',has_traffic_filtering=True,id=40cfd25e-6778-4193-817b-5b831a7e6cd0,network=Network(0d612931-a2ce-4d23-ad5b-5e8c5abf33d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40cfd25e-67')
Nov 28 17:21:37 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Deleting instance files /opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9_del
Nov 28 17:21:37 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Deletion of /opt/stack/data/nova/instances/d324ffda-861e-47dd-afb5-f034e7b98cb9_del complete
Nov 28 17:21:37 user nova-compute[75246]: INFO nova.compute.manager [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 28 17:21:37 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:37 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:21:37 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:21:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8069MB free_disk=25.10479736328125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:21:37 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Snapshot image upload complete
Nov 28 17:21:37 user nova-compute[75246]: INFO nova.compute.manager [None req-0f5d2ba9-ad72-4203-bf49-f4605094e73b tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Took 5.67 seconds to snapshot the instance on the hypervisor.
Nov 28 17:21:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a796152e-e8df-41bf-a5ea-ae94d4fa8b41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 5175a016-3237-4e79-bc77-4b72e5402695 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 1a520141-ac59-407a-a525-b3fe402e8cd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance d324ffda-861e-47dd-afb5-f034e7b98cb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 81104ec7-670f-417b-926f-9ee8f7c5d659 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance b28b1c5a-d62d-45e4-92a0-22891e57116e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:21:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:21:38 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:21:38 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:21:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:21:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:21:38 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:21:38 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Took 0.94 seconds to deallocate network for instance.
Nov 28 17:21:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:21:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:21:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-28f08043-7bcf-4c7c-a61e-4716b85509c8 req-4729666d-8ec8-42c7-a42f-3c6b55ee6265 service nova] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Received event network-vif-deleted-40cfd25e-6778-4193-817b-5b831a7e6cd0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:21:38 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:21:38 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:21:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:21:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-b42595b3-c9be-4fdd-ad82-e6e5f5e54b3c req-cad6b674-3554-4ffa-b619-2254a4d1c4cc service nova] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Received event network-vif-plugged-40cfd25e-6778-4193-817b-5b831a7e6cd0 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:21:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b42595b3-c9be-4fdd-ad82-e6e5f5e54b3c req-cad6b674-3554-4ffa-b619-2254a4d1c4cc service nova] Acquiring lock "d324ffda-861e-47dd-afb5-f034e7b98cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:21:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b42595b3-c9be-4fdd-ad82-e6e5f5e54b3c req-cad6b674-3554-4ffa-b619-2254a4d1c4cc service nova] Lock "d324ffda-861e-47dd-afb5-f034e7b98cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:21:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b42595b3-c9be-4fdd-ad82-e6e5f5e54b3c req-cad6b674-3554-4ffa-b619-2254a4d1c4cc service nova] Lock "d324ffda-861e-47dd-afb5-f034e7b98cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:21:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-b42595b3-c9be-4fdd-ad82-e6e5f5e54b3c req-cad6b674-3554-4ffa-b619-2254a4d1c4cc service nova] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] No waiting events found dispatching network-vif-plugged-40cfd25e-6778-4193-817b-5b831a7e6cd0 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:21:38 user nova-compute[75246]: WARNING nova.compute.manager [req-b42595b3-c9be-4fdd-ad82-e6e5f5e54b3c req-cad6b674-3554-4ffa-b619-2254a4d1c4cc service nova] [instance: d324ffda-861e-47dd-afb5-f034e7b98cb9] Received unexpected event network-vif-plugged-40cfd25e-6778-4193-817b-5b831a7e6cd0 for instance with vm_state deleted and task_state None.
Nov 28 17:21:38 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Deleted allocations for instance d324ffda-861e-47dd-afb5-f034e7b98cb9
Nov 28 17:21:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-e0cf0284-c2ea-40d5-a24d-090337758369 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "d324ffda-861e-47dd-afb5-f034e7b98cb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.556s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:21:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:21:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:21:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:21:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:21:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:21:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:21:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:41 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:21:41 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:21:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:45 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:21:45 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:21:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:21:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:21:46 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:21:46 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Updating instance_info_cache with network_info: [{"id": "a311cb50-be83-4bf0-b889-d02170d667d6", "address": "fa:16:3e:65:bd:fb", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa311cb50-be", "ovs_interfaceid": "a311cb50-be83-4bf0-b889-d02170d667d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:21:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:21:46 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:21:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:47 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:21:47 user nova-compute[75246]: DEBUG nova.compute.manager [req-c8b60491-03fd-4faf-a1c7-adb3c2c90b05 req-21ba909e-f296-41ab-ab72-e1090f514979 service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Received event network-changed-790ebd7c-fc6a-4b58-a55c-4b2618528aba {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:21:47 user nova-compute[75246]: DEBUG nova.compute.manager [req-c8b60491-03fd-4faf-a1c7-adb3c2c90b05 req-21ba909e-f296-41ab-ab72-e1090f514979 service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Refreshing instance network info cache due to event network-changed-790ebd7c-fc6a-4b58-a55c-4b2618528aba. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:21:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c8b60491-03fd-4faf-a1c7-adb3c2c90b05 req-21ba909e-f296-41ab-ab72-e1090f514979 service nova] Acquiring lock "refresh_cache-81104ec7-670f-417b-926f-9ee8f7c5d659" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:21:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c8b60491-03fd-4faf-a1c7-adb3c2c90b05 req-21ba909e-f296-41ab-ab72-e1090f514979 service nova] Acquired lock "refresh_cache-81104ec7-670f-417b-926f-9ee8f7c5d659" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:21:47 user nova-compute[75246]: DEBUG nova.network.neutron [req-c8b60491-03fd-4faf-a1c7-adb3c2c90b05 req-21ba909e-f296-41ab-ab72-e1090f514979 service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Refreshing network info cache for port 790ebd7c-fc6a-4b58-a55c-4b2618528aba {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:21:48 user nova-compute[75246]: DEBUG nova.network.neutron [req-c8b60491-03fd-4faf-a1c7-adb3c2c90b05 req-21ba909e-f296-41ab-ab72-e1090f514979 service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Updated VIF entry in instance network info cache for port 790ebd7c-fc6a-4b58-a55c-4b2618528aba. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:21:48 user nova-compute[75246]: DEBUG nova.network.neutron [req-c8b60491-03fd-4faf-a1c7-adb3c2c90b05 req-21ba909e-f296-41ab-ab72-e1090f514979 service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Updating instance_info_cache with network_info: [{"id": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "address": "fa:16:3e:1b:3c:72", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790ebd7c-fc", "ovs_interfaceid": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:21:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c8b60491-03fd-4faf-a1c7-adb3c2c90b05 req-21ba909e-f296-41ab-ab72-e1090f514979 service nova] Releasing lock "refresh_cache-81104ec7-670f-417b-926f-9ee8f7c5d659" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "81104ec7-670f-417b-926f-9ee8f7c5d659" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG nova.objects.instance [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lazy-loading 'flavor' on Instance uuid 81104ec7-670f-417b-926f-9ee8f7c5d659 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "81104ec7-670f-417b-926f-9ee8f7c5d659" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:21:50 user nova-compute[75246]: INFO nova.compute.manager [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Attaching volume a60ebb90-7150-41c3-85e0-9a9dae646a6d to /dev/vdb
Nov 28 17:21:50 user nova-compute[75246]: DEBUG os_brick.utils [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6630929b-671d-4b06-a1de-00ac301c7d9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10a5c0b-798f-4c09-952e-cdfbaa200243]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[06110fa7-7dfa-468f-9f4c-de390ec47080]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f3273d-9ac2-4709-8d40-eab357767b81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:21:50 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:21:50 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec87675c-5f86-4d6a-8f09-fb4db3941927]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG os_brick.utils [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:21:50 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Updating existing volume attachment record: f72e44f5-6780-4895-88b1-1ad192a7a5d3 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:21:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:57 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5175a016-3237-4e79-bc77-4b72e5402695 is timed out.
Nov 28 17:21:57 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Successfully detached device vdb from instance 5175a016-3237-4e79-bc77-4b72e5402695 from the live domain config.
Nov 28 17:21:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZqOvmFNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:21:57 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7cfb2c-5c9a-437e-9f8b-4fb743ada60f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:21:57 user nova-compute[75246]: No targets found.
Nov 28 17:21:57 user nova-compute[75246]: iSNS:
Nov 28 17:21:57 user nova-compute[75246]: No targets found.
Nov 28 17:21:57 user nova-compute[75246]: STATIC:
Nov 28 17:21:57 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75
Nov 28 17:21:57 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:21:57 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:21:57 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500
Nov 28 17:21:57 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:21:57 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:21:57 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:21:57 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:21:57 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:21:57 user nova-compute[75246]: FIRMWARE:
Nov 28 17:21:57 user nova-compute[75246]: No targets found.
Nov 28 17:21:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:21:57 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:21:57 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9775645-8dcd-4326-b124-1cd4f27467c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97cf788-f49a-40e8-9743-7c896e7ae30a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:21:57 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:21:57 user nova-compute[75246]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 (non-flash)
Nov 28 17:21:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:21:57 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:21:57 user nova-compute[75246]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 (non-flash)
Nov 28 17:21:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d83c1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500'): ({'sdd'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Removing single pathed devices sdd {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3520b8-c3df-43c8-a9f8-c585b9d67d01]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52613a3-2282-46a1-a964-b4feb5bf9483]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Flushing IO for device /dev/sdd {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae55eb0e-18ec-4337-a0a8-5d1fef2b9473]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5ab1ab-e763-47df-860a-a065c9ce2e6d]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fca608-a2ce-4c7b-a8b0-287ad2b4681e]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c9dcff-8db4-4f47-9d87-64d290e02a31]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500, portal: 172.16.0.220,3260]
Nov 28 17:21:57 user nova-compute[75246]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500, portal: 172.16.0.220,3260] successful.
Nov 28 17:21:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b8537a-2ec5-48db-9fb4-3198ad896500 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f8adf9-401b-4476-89c9-841e1f44b3d4]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] <== disconnect_volume: return (288ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:21:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qadnOvTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:21:58 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:21:58 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:21:58 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4638e3-2d5d-4b2a-8530-7b68d4e9598a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:21:58 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c79e91-bcf4-47b2-a7d8-49012458f2bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d] added
Nov 28 17:21:58 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5e296e-2aca-4019-9f79-dedfeba86785]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b380d4-a1f2-4c15-be6a-180c7b80430d]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qadnOvTZ {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qadnOvTZ" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d57bc5-a6cf-4473-a97a-efc5fcf71d7a]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qadnOvTZ'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06dd189-c739-41d9-828e-4f269a2c2109]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG nova.objects.instance [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lazy-loading 'flavor' on Instance uuid 5175a016-3237-4e79-bc77-4b72e5402695 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f807e8d2-dd4a-4a90-b2b1-f4c61fbb791a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:21:58 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:21:58 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:21:58 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:21:58 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a42d3de4-5753-43a1-90cc-c6f7c1625f87 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.023s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f3ce87-2943-4207-9237-a21ff295abb8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d, portal: 172.16.0.220,3260]
Nov 28 17:21:58 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d, portal: 172.16.0.220,3260] successful.
Nov 28 17:21:58 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32fe711-922e-4682-8a34-4f6c5c48a9cf]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a729dc-470e-4684-bfa7-1968ff196e3b]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:21:58 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:21:58 user nova-compute[75246]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d (non-flash)
Nov 28 17:21:58 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:21:58 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:21:58 user nova-compute[75246]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d (non-flash)
Nov 28 17:21:58 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df13767-f5f4-4611-91a7-4248e4ba3e84]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:21:58 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qadnOvTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:21:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:21:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26438313432633166', 'path': '/dev/sdd'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:21:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438313432633166', 'path': '/dev/sdd'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:21:59 user nova-compute[75246]: DEBUG nova.objects.instance [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lazy-loading 'flavor' on Instance uuid 81104ec7-670f-417b-926f-9ee8f7c5d659 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:21:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:21:59 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:21:59 user nova-compute[75246]:   <source dev="/dev/sdd"/>
Nov 28 17:21:59 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:21:59 user nova-compute[75246]:   <serial>a60ebb90-7150-41c3-85e0-9a9dae646a6d</serial>
Nov 28 17:21:59 user nova-compute[75246]: </disk>
Nov 28 17:21:59 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:21:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:21:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:21:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] No VIF found with MAC fa:16:3e:1b:3c:72, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:22:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8a7480c1-c6de-4621-9e63-c2373a19e0ce tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.250s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "81104ec7-670f-417b-926f-9ee8f7c5d659" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:01 user nova-compute[75246]: INFO nova.compute.manager [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Detaching volume a60ebb90-7150-41c3-85e0-9a9dae646a6d
Nov 28 17:22:01 user nova-compute[75246]: INFO nova.virt.block_device [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Attempting to driver detach volume a60ebb90-7150-41c3-85e0-9a9dae646a6d from mountpoint /dev/vdb
Nov 28 17:22:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Attempting to detach device vdb from instance 81104ec7-670f-417b-926f-9ee8f7c5d659 from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:22:01 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:22:01 user nova-compute[75246]:   <source dev="/dev/sdd"/>
Nov 28 17:22:01 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:22:01 user nova-compute[75246]:   <serial>a60ebb90-7150-41c3-85e0-9a9dae646a6d</serial>
Nov 28 17:22:01 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:22:01 user nova-compute[75246]: </disk>
Nov 28 17:22:01 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:22:01 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Successfully detached device vdb from instance 81104ec7-670f-417b-926f-9ee8f7c5d659 from the persistent domain config.
Nov 28 17:22:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 81104ec7-670f-417b-926f-9ee8f7c5d659 from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:22:01 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:22:01 user nova-compute[75246]:   <source dev="/dev/sdd"/>
Nov 28 17:22:01 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:22:01 user nova-compute[75246]:   <serial>a60ebb90-7150-41c3-85e0-9a9dae646a6d</serial>
Nov 28 17:22:01 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:22:01 user nova-compute[75246]: </disk>
Nov 28 17:22:01 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-c0ea39b1-6261-46c7-95a0-ac642d19fcf9 req-ff3eaedb-eddd-40c7-840d-25c35b297383 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Received event network-changed-d202eb6d-fad6-4c7b-8f5d-80abb1761aaf {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG nova.compute.manager [req-c0ea39b1-6261-46c7-95a0-ac642d19fcf9 req-ff3eaedb-eddd-40c7-840d-25c35b297383 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Refreshing instance network info cache due to event network-changed-d202eb6d-fad6-4c7b-8f5d-80abb1761aaf. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c0ea39b1-6261-46c7-95a0-ac642d19fcf9 req-ff3eaedb-eddd-40c7-840d-25c35b297383 service nova] Acquiring lock "refresh_cache-b28b1c5a-d62d-45e4-92a0-22891e57116e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c0ea39b1-6261-46c7-95a0-ac642d19fcf9 req-ff3eaedb-eddd-40c7-840d-25c35b297383 service nova] Acquired lock "refresh_cache-b28b1c5a-d62d-45e4-92a0-22891e57116e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG nova.network.neutron [req-c0ea39b1-6261-46c7-95a0-ac642d19fcf9 req-ff3eaedb-eddd-40c7-840d-25c35b297383 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Refreshing network info cache for port d202eb6d-fad6-4c7b-8f5d-80abb1761aaf {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 81104ec7-670f-417b-926f-9ee8f7c5d659 {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG nova.network.neutron [req-c0ea39b1-6261-46c7-95a0-ac642d19fcf9 req-ff3eaedb-eddd-40c7-840d-25c35b297383 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Updated VIF entry in instance network info cache for port d202eb6d-fad6-4c7b-8f5d-80abb1761aaf. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG nova.network.neutron [req-c0ea39b1-6261-46c7-95a0-ac642d19fcf9 req-ff3eaedb-eddd-40c7-840d-25c35b297383 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Updating instance_info_cache with network_info: [{"id": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "address": "fa:16:3e:2b:cd:66", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd202eb6d-fa", "ovs_interfaceid": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c0ea39b1-6261-46c7-95a0-ac642d19fcf9 req-ff3eaedb-eddd-40c7-840d-25c35b297383 service nova] Releasing lock "refresh_cache-b28b1c5a-d62d-45e4-92a0-22891e57116e" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "b28b1c5a-d62d-45e4-92a0-22891e57116e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "b28b1c5a-d62d-45e4-92a0-22891e57116e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "b28b1c5a-d62d-45e4-92a0-22891e57116e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "b28b1c5a-d62d-45e4-92a0-22891e57116e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "b28b1c5a-d62d-45e4-92a0-22891e57116e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:01 user nova-compute[75246]: INFO nova.compute.manager [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Terminating instance
Nov 28 17:22:01 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-9b6cf979-c381-47df-928c-aff0fb53e72c req-76f17de8-e82c-49ce-b0ab-8dab34d7c164 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Received event network-vif-unplugged-d202eb6d-fad6-4c7b-8f5d-80abb1761aaf {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9b6cf979-c381-47df-928c-aff0fb53e72c req-76f17de8-e82c-49ce-b0ab-8dab34d7c164 service nova] Acquiring lock "b28b1c5a-d62d-45e4-92a0-22891e57116e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9b6cf979-c381-47df-928c-aff0fb53e72c req-76f17de8-e82c-49ce-b0ab-8dab34d7c164 service nova] Lock "b28b1c5a-d62d-45e4-92a0-22891e57116e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9b6cf979-c381-47df-928c-aff0fb53e72c req-76f17de8-e82c-49ce-b0ab-8dab34d7c164 service nova] Lock "b28b1c5a-d62d-45e4-92a0-22891e57116e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-9b6cf979-c381-47df-928c-aff0fb53e72c req-76f17de8-e82c-49ce-b0ab-8dab34d7c164 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] No waiting events found dispatching network-vif-unplugged-d202eb6d-fad6-4c7b-8f5d-80abb1761aaf {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-9b6cf979-c381-47df-928c-aff0fb53e72c req-76f17de8-e82c-49ce-b0ab-8dab34d7c164 service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Received event network-vif-unplugged-d202eb6d-fad6-4c7b-8f5d-80abb1761aaf for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:22:02 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Instance destroyed successfully.
Nov 28 17:22:02 user nova-compute[75246]: DEBUG nova.objects.instance [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lazy-loading 'resources' on Instance uuid b28b1c5a-d62d-45e4-92a0-22891e57116e {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-401495269',display_name='tempest-TestVolumeBootPattern-server-401495269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-401495269',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrg6dgmwLxM+qOiUQmkZP+lby3sIcjedzAt6Qr2Vg5lrRzmZuOCIGPTCAvsPt68uI6UbSOJN/oyUTe5OqihGAovpc3vgI5qK/6ApsKxZfDXJBHGmnIe3WgtSfAKkR6e4g==',key_name='tempest-TestVolumeBootPattern-1591090964',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:20:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe0eebdd39c54a74be8d2e0f9842b165',ramdisk_id='',reservation_id='r-9ec00tga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-389869337',owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:20:22Z,user_data=None,user_id='c334f73c5bf1473aadf865c8f032c0cb',uuid=b28b1c5a-d62d-45e4-92a0-22891e57116e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "address": "fa:16:3e:2b:cd:66", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd202eb6d-fa", "ovs_interfaceid": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converting VIF {"id": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "address": "fa:16:3e:2b:cd:66", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd202eb6d-fa", "ovs_interfaceid": "d202eb6d-fad6-4c7b-8f5d-80abb1761aaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:cd:66,bridge_name='br-int',has_traffic_filtering=True,id=d202eb6d-fad6-4c7b-8f5d-80abb1761aaf,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd202eb6d-fa') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG os_vif [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:cd:66,bridge_name='br-int',has_traffic_filtering=True,id=d202eb6d-fad6-4c7b-8f5d-80abb1761aaf,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd202eb6d-fa') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd202eb6d-fa, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=054e1f29-1a97-4948-baa8-f04546cb041e) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:02 user nova-compute[75246]: INFO os_vif [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:cd:66,bridge_name='br-int',has_traffic_filtering=True,id=d202eb6d-fad6-4c7b-8f5d-80abb1761aaf,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd202eb6d-fa')
Nov 28 17:22:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goEuwIjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:22:02 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:22:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c856f66-c864-4ff0-8834-51503e30c535]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:22:02 user nova-compute[75246]: No targets found.
Nov 28 17:22:02 user nova-compute[75246]: iSNS:
Nov 28 17:22:02 user nova-compute[75246]: No targets found.
Nov 28 17:22:02 user nova-compute[75246]: STATIC:
Nov 28 17:22:02 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75
Nov 28 17:22:02 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:22:02 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:22:02 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d
Nov 28 17:22:02 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:22:02 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:22:02 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:22:02 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:22:02 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:22:02 user nova-compute[75246]: FIRMWARE:
Nov 28 17:22:02 user nova-compute[75246]: No targets found.
Nov 28 17:22:02 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:22:02 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:22:02 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab836928-7a72-4a85-8270-1ff4270ccf21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7bbe63-c6dd-4da8-b2a9-3b1b7df4175a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:22:02 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:22:02 user nova-compute[75246]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d (non-flash)
Nov 28 17:22:02 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:22:02 user nova-compute[75246]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:22:02 user nova-compute[75246]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d (non-flash)
Nov 28 17:22:02 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d8199900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75'): ({'sdc'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Removing single pathed devices sdc {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d5931f-4a7b-41b4-8b8e-fcc42b760e67]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d891d1-686c-4265-91d8-218b500d7d41]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Flushing IO for device /dev/sdc {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[785f09e7-8718-4aa9-9a55-9c5f2c40c32d]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[01987a95-a535-45a4-9ac8-3ac3aebafdbe]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:22:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42deb40-0a4f-4fd0-aada-9d05cc657bc3]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:22:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6aef6f-e8e5-446f-8251-dfbe419c853f]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75, portal: 172.16.0.220,3260]
Nov 28 17:22:03 user nova-compute[75246]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75, portal: 172.16.0.220,3260] successful.
Nov 28 17:22:03 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:22:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:03 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1282fdae-4604-4a86-a746-9d275070ef9d]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:22:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:22:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] <== disconnect_volume: return (342ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:22:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:22:03 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Deleting instance files /opt/stack/data/nova/instances/b28b1c5a-d62d-45e4-92a0-22891e57116e_del
Nov 28 17:22:03 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Deletion of /opt/stack/data/nova/instances/b28b1c5a-d62d-45e4-92a0-22891e57116e_del complete
Nov 28 17:22:03 user nova-compute[75246]: INFO nova.compute.manager [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 28 17:22:03 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:22:03 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:22:03 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:22:03 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:22:03 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Took 0.75 seconds to deallocate network for instance.
Nov 28 17:22:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-aef157dd-9279-4c49-acf0-978f4b0f8fe0 req-b91e61c2-a988-49e9-9a82-7924bd4940fd service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Received event network-vif-plugged-d202eb6d-fad6-4c7b-8f5d-80abb1761aaf {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:22:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-aef157dd-9279-4c49-acf0-978f4b0f8fe0 req-b91e61c2-a988-49e9-9a82-7924bd4940fd service nova] Acquiring lock "b28b1c5a-d62d-45e4-92a0-22891e57116e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-aef157dd-9279-4c49-acf0-978f4b0f8fe0 req-b91e61c2-a988-49e9-9a82-7924bd4940fd service nova] Lock "b28b1c5a-d62d-45e4-92a0-22891e57116e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-aef157dd-9279-4c49-acf0-978f4b0f8fe0 req-b91e61c2-a988-49e9-9a82-7924bd4940fd service nova] Lock "b28b1c5a-d62d-45e4-92a0-22891e57116e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-aef157dd-9279-4c49-acf0-978f4b0f8fe0 req-b91e61c2-a988-49e9-9a82-7924bd4940fd service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] No waiting events found dispatching network-vif-plugged-d202eb6d-fad6-4c7b-8f5d-80abb1761aaf {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:22:04 user nova-compute[75246]: WARNING nova.compute.manager [req-aef157dd-9279-4c49-acf0-978f4b0f8fe0 req-b91e61c2-a988-49e9-9a82-7924bd4940fd service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Received unexpected event network-vif-plugged-d202eb6d-fad6-4c7b-8f5d-80abb1761aaf for instance with vm_state active and task_state deleting.
Nov 28 17:22:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-aef157dd-9279-4c49-acf0-978f4b0f8fe0 req-b91e61c2-a988-49e9-9a82-7924bd4940fd service nova] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Received event network-vif-deleted-d202eb6d-fad6-4c7b-8f5d-80abb1761aaf {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:22:04 user nova-compute[75246]: INFO nova.compute.manager [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: b28b1c5a-d62d-45e4-92a0-22891e57116e] Took 0.75 seconds to detach 1 volumes for instance.
Nov 28 17:22:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:04 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:22:05 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:22:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:05 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Deleted allocations for instance b28b1c5a-d62d-45e4-92a0-22891e57116e
Nov 28 17:22:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9d69ee59-7e13-4b4b-86c8-e6687b5c3a51 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "b28b1c5a-d62d-45e4-92a0-22891e57116e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.194s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:22:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:21 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 81104ec7-670f-417b-926f-9ee8f7c5d659 is timed out.
Nov 28 17:22:21 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Successfully detached device vdb from instance 81104ec7-670f-417b-926f-9ee8f7c5d659 from the live domain config.
Nov 28 17:22:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qadnOvTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:22:21 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dd26bb-d246-4cff-92a6-f2be5b645128]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:22:21 user nova-compute[75246]: No targets found.
Nov 28 17:22:21 user nova-compute[75246]: iSNS:
Nov 28 17:22:21 user nova-compute[75246]: No targets found.
Nov 28 17:22:21 user nova-compute[75246]: STATIC:
Nov 28 17:22:21 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d
Nov 28 17:22:21 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:22:21 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:22:21 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:22:21 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:22:21 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:22:21 user nova-compute[75246]: FIRMWARE:
Nov 28 17:22:21 user nova-compute[75246]: No targets found.
Nov 28 17:22:21 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:22:21 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:22:21 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9340c628-a462-49b4-b526-2c4fdde3f8e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3453058-c527-4f13-9d46-c44622ddcdb6]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:22:21 user nova-compute[75246]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d (non-flash)
Nov 28 17:22:21 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:22:21 user nova-compute[75246]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d (non-flash)
Nov 28 17:22:21 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4b867c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d'): ({'sdd'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Removing single pathed devices sdd {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71b5ef6-e114-45b2-9eb3-5772065ae618]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f540768-f311-4be2-9912-6e48691fd6c7]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Flushing IO for device /dev/sdd {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa76d9b7-7c62-4fcb-9ea5-5af75b61b87f]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf4f909-5e47-43cb-8f0f-326fd8e871dc]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e321c0f6-6d6d-4e3d-98db-9a964b4530b2]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff6d09f-db65-4a78-9617-888fff40ba35]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d, portal: 172.16.0.220,3260]
Nov 28 17:22:21 user nova-compute[75246]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d, portal: 172.16.0.220,3260] successful.
Nov 28 17:22:21 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ebb90-7150-41c3-85e0-9a9dae646a6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5411a7-5cc7-428b-a0ac-2238d25978cb]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] <== disconnect_volume: return (285ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:22:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:22:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:23 user nova-compute[75246]: DEBUG nova.objects.instance [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lazy-loading 'flavor' on Instance uuid 81104ec7-670f-417b-926f-9ee8f7c5d659 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:22:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2c218913-6795-46a6-a843-de3a79f138b7 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.704s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:24 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:22:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:25 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:22:25 user nova-compute[75246]: INFO nova.compute.claims [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Claim successful on node user
Nov 28 17:22:25 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:22:25 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:22:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:25 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:22:25 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:22:25 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:22:25 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:22:25 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:22:25 user nova-compute[75246]: DEBUG nova.policy [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af8b6c3f092547dbbf3debe96c594590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec5bcef3e2441fba30b593c13d5516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:22:25 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:22:25 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:22:25 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Creating image(s)
Nov 28 17:22:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "/opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "/opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:25 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.196s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Successfully created port: 53e83fee-b8ec-4d6a-a3ce-d831c58e7e86 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk 1073741824" returned: 0 in 0.067s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.207s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Cannot resize image /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Ensure instance console log exists: /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Successfully updated port: 53e83fee-b8ec-4d6a-a3ce-d831c58e7e86 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "refresh_cache-ae257aa8-78c3-499e-a5cf-1021deefe6d8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquired lock "refresh_cache-ae257aa8-78c3-499e-a5cf-1021deefe6d8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-4e932d5d-243f-4a14-ba70-d50a9134afa5 req-21259acf-b681-4614-9548-a7e1e5ba59ca service nova] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Received event network-changed-53e83fee-b8ec-4d6a-a3ce-d831c58e7e86 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG nova.compute.manager [req-4e932d5d-243f-4a14-ba70-d50a9134afa5 req-21259acf-b681-4614-9548-a7e1e5ba59ca service nova] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Refreshing instance network info cache due to event network-changed-53e83fee-b8ec-4d6a-a3ce-d831c58e7e86. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4e932d5d-243f-4a14-ba70-d50a9134afa5 req-21259acf-b681-4614-9548-a7e1e5ba59ca service nova] Acquiring lock "refresh_cache-ae257aa8-78c3-499e-a5cf-1021deefe6d8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:22:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Updating instance_info_cache with network_info: [{"id": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "address": "fa:16:3e:1e:ed:6e", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e83fee-b8", "ovs_interfaceid": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Releasing lock "refresh_cache-ae257aa8-78c3-499e-a5cf-1021deefe6d8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Instance network_info: |[{"id": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "address": "fa:16:3e:1e:ed:6e", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e83fee-b8", "ovs_interfaceid": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4e932d5d-243f-4a14-ba70-d50a9134afa5 req-21259acf-b681-4614-9548-a7e1e5ba59ca service nova] Acquired lock "refresh_cache-ae257aa8-78c3-499e-a5cf-1021deefe6d8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.network.neutron [req-4e932d5d-243f-4a14-ba70-d50a9134afa5 req-21259acf-b681-4614-9548-a7e1e5ba59ca service nova] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Refreshing network info cache for port 53e83fee-b8ec-4d6a-a3ce-d831c58e7e86 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Start _get_guest_xml network_info=[{"id": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "address": "fa:16:3e:1e:ed:6e", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e83fee-b8", "ovs_interfaceid": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:22:27 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:22:27 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1576074089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1576074089',id=44,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faec5bcef3e2441fba30b593c13d5516',ramdisk_id='',reservation_id='r-wotnwtc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-506006079',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:22:26Z,user_data=None,user_id='af8b6c3f092547dbbf3debe96c594590',uuid=ae257aa8-78c3-499e-a5cf-1021deefe6d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "address": "fa:16:3e:1e:ed:6e", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e83fee-b8", "ovs_interfaceid": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converting VIF {"id": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "address": "fa:16:3e:1e:ed:6e", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e83fee-b8", "ovs_interfaceid": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=53e83fee-b8ec-4d6a-a3ce-d831c58e7e86,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e83fee-b8') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'pci_devices' on Instance uuid ae257aa8-78c3-499e-a5cf-1021deefe6d8 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:22:27 user nova-compute[75246]:   <uuid>ae257aa8-78c3-499e-a5cf-1021deefe6d8</uuid>
Nov 28 17:22:27 user nova-compute[75246]:   <name>instance-0000002c</name>
Nov 28 17:22:27 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:22:27 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:22:27 user nova-compute[75246]:   <metadata>
Nov 28 17:22:27 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:22:27 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:22:27 user nova-compute[75246]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1576074089</nova:name>
Nov 28 17:22:27 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:22:27</nova:creationTime>
Nov 28 17:22:27 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:22:27 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:22:27 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:22:27 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:22:27 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:22:27 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:22:27 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:22:27 user nova-compute[75246]:       <nova:owner>
Nov 28 17:22:27 user nova-compute[75246]:         <nova:user uuid="af8b6c3f092547dbbf3debe96c594590">tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member</nova:user>
Nov 28 17:22:27 user nova-compute[75246]:         <nova:project uuid="faec5bcef3e2441fba30b593c13d5516">tempest-ServerBootFromVolumeStableRescueTest-506006079</nova:project>
Nov 28 17:22:27 user nova-compute[75246]:       </nova:owner>
Nov 28 17:22:27 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:22:27 user nova-compute[75246]:       <nova:ports>
Nov 28 17:22:27 user nova-compute[75246]:         <nova:port uuid="53e83fee-b8ec-4d6a-a3ce-d831c58e7e86">
Nov 28 17:22:27 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 17:22:27 user nova-compute[75246]:         </nova:port>
Nov 28 17:22:27 user nova-compute[75246]:       </nova:ports>
Nov 28 17:22:27 user nova-compute[75246]:     </nova:instance>
Nov 28 17:22:27 user nova-compute[75246]:   </metadata>
Nov 28 17:22:27 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:22:27 user nova-compute[75246]:     <system>
Nov 28 17:22:27 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:22:27 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:22:27 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:22:27 user nova-compute[75246]:       <entry name="serial">ae257aa8-78c3-499e-a5cf-1021deefe6d8</entry>
Nov 28 17:22:27 user nova-compute[75246]:       <entry name="uuid">ae257aa8-78c3-499e-a5cf-1021deefe6d8</entry>
Nov 28 17:22:27 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:22:27 user nova-compute[75246]:     </system>
Nov 28 17:22:27 user nova-compute[75246]:   </sysinfo>
Nov 28 17:22:27 user nova-compute[75246]:   <os>
Nov 28 17:22:27 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:22:27 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:22:27 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:22:27 user nova-compute[75246]:   </os>
Nov 28 17:22:27 user nova-compute[75246]:   <features>
Nov 28 17:22:27 user nova-compute[75246]:     <acpi/>
Nov 28 17:22:27 user nova-compute[75246]:     <apic/>
Nov 28 17:22:27 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:22:27 user nova-compute[75246]:   </features>
Nov 28 17:22:27 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:22:27 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:22:27 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:22:27 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:22:27 user nova-compute[75246]:   </clock>
Nov 28 17:22:27 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:22:27 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:22:27 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:22:27 user nova-compute[75246]:   </cpu>
Nov 28 17:22:27 user nova-compute[75246]:   <devices>
Nov 28 17:22:27 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:22:27 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:22:27 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk"/>
Nov 28 17:22:27 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:22:27 user nova-compute[75246]:     </disk>
Nov 28 17:22:27 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:22:27 user nova-compute[75246]:       <mac address="fa:16:3e:1e:ed:6e"/>
Nov 28 17:22:27 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:22:27 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:22:27 user nova-compute[75246]:       <target dev="tap53e83fee-b8"/>
Nov 28 17:22:27 user nova-compute[75246]:     </interface>
Nov 28 17:22:27 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:22:27 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/console.log" append="off"/>
Nov 28 17:22:27 user nova-compute[75246]:     </serial>
Nov 28 17:22:27 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:22:27 user nova-compute[75246]:     <video>
Nov 28 17:22:27 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:22:27 user nova-compute[75246]:     </video>
Nov 28 17:22:27 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:22:27 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:22:27 user nova-compute[75246]:     </rng>
Nov 28 17:22:27 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:22:27 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:22:27 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:22:27 user nova-compute[75246]:     </memballoon>
Nov 28 17:22:27 user nova-compute[75246]:   </devices>
Nov 28 17:22:27 user nova-compute[75246]: </domain>
Nov 28 17:22:27 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1576074089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1576074089',id=44,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faec5bcef3e2441fba30b593c13d5516',ramdisk_id='',reservation_id='r-wotnwtc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-506006079',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:22:26Z,user_data=None,user_id='af8b6c3f092547dbbf3debe96c594590',uuid=ae257aa8-78c3-499e-a5cf-1021deefe6d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "address": "fa:16:3e:1e:ed:6e", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e83fee-b8", "ovs_interfaceid": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converting VIF {"id": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "address": "fa:16:3e:1e:ed:6e", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e83fee-b8", "ovs_interfaceid": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=53e83fee-b8ec-4d6a-a3ce-d831c58e7e86,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e83fee-b8') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG os_vif [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=53e83fee-b8ec-4d6a-a3ce-d831c58e7e86,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e83fee-b8') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '928fb6c6-835a-595c-8069-b05dd9c384c8', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53e83fee-b8, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53e83fee-b8, col_values=(('qos', UUID('66f5a60c-5f37-4541-abb9-3ccb42fa53cd')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53e83fee-b8, col_values=(('external_ids', {'iface-id': '53e83fee-b8ec-4d6a-a3ce-d831c58e7e86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:ed:6e', 'vm-uuid': 'ae257aa8-78c3-499e-a5cf-1021deefe6d8'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:27 user nova-compute[75246]: INFO os_vif [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=53e83fee-b8ec-4d6a-a3ce-d831c58e7e86,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e83fee-b8')
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] No VIF found with MAC fa:16:3e:1e:ed:6e, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.network.neutron [req-4e932d5d-243f-4a14-ba70-d50a9134afa5 req-21259acf-b681-4614-9548-a7e1e5ba59ca service nova] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Updated VIF entry in instance network info cache for port 53e83fee-b8ec-4d6a-a3ce-d831c58e7e86. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.network.neutron [req-4e932d5d-243f-4a14-ba70-d50a9134afa5 req-21259acf-b681-4614-9548-a7e1e5ba59ca service nova] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Updating instance_info_cache with network_info: [{"id": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "address": "fa:16:3e:1e:ed:6e", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e83fee-b8", "ovs_interfaceid": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4e932d5d-243f-4a14-ba70-d50a9134afa5 req-21259acf-b681-4614-9548-a7e1e5ba59ca service nova] Releasing lock "refresh_cache-ae257aa8-78c3-499e-a5cf-1021deefe6d8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquiring lock "96c4a3c2-590a-4166-88a3-6bf785237097" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "96c4a3c2-590a-4166-88a3-6bf785237097" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.compute.manager [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:27 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:22:27 user nova-compute[75246]: INFO nova.compute.claims [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Claim successful on node user
Nov 28 17:22:28 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG nova.compute.manager [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG nova.compute.manager [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG nova.network.neutron [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:22:28 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:22:28 user nova-compute[75246]: DEBUG nova.compute.manager [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG nova.policy [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e5ebd975fea42b0af369d94360206c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e932cfe5d8b84dff8d8826cd581ce086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG nova.compute.manager [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:22:28 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Creating image(s)
Nov 28 17:22:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquiring lock "/opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "/opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "/opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.189s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG nova.compute.manager [req-ddb42a37-ef18-48ca-a84d-e4c1b0287048 req-2840808b-e5fc-4808-b180-151b03a6bb44 service nova] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Received event network-vif-plugged-53e83fee-b8ec-4d6a-a3ce-d831c58e7e86 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ddb42a37-ef18-48ca-a84d-e4c1b0287048 req-2840808b-e5fc-4808-b180-151b03a6bb44 service nova] Acquiring lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ddb42a37-ef18-48ca-a84d-e4c1b0287048 req-2840808b-e5fc-4808-b180-151b03a6bb44 service nova] Lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ddb42a37-ef18-48ca-a84d-e4c1b0287048 req-2840808b-e5fc-4808-b180-151b03a6bb44 service nova] Lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG nova.compute.manager [req-ddb42a37-ef18-48ca-a84d-e4c1b0287048 req-2840808b-e5fc-4808-b180-151b03a6bb44 service nova] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] No waiting events found dispatching network-vif-plugged-53e83fee-b8ec-4d6a-a3ce-d831c58e7e86 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:22:28 user nova-compute[75246]: WARNING nova.compute.manager [req-ddb42a37-ef18-48ca-a84d-e4c1b0287048 req-2840808b-e5fc-4808-b180-151b03a6bb44 service nova] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Received unexpected event network-vif-plugged-53e83fee-b8ec-4d6a-a3ce-d831c58e7e86 for instance with vm_state building and task_state spawning.
Nov 28 17:22:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.186s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:28 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/disk 1073741824" returned: 0 in 0.054s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Cannot resize image /opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Ensure instance console log exists: /opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG nova.network.neutron [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Successfully created port: 60f463a9-2f06-47e3-a6ff-746ccbf480d5 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG nova.objects.instance [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lazy-loading 'flavor' on Instance uuid 5175a016-3237-4e79-bc77-4b72e5402695 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:29 user nova-compute[75246]: INFO nova.compute.manager [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Attaching volume 2820efd5-b045-48b9-a0ce-ed89bfac30d2 to /dev/vdb
Nov 28 17:22:29 user nova-compute[75246]: DEBUG os_brick.utils [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9bab08-351c-4b38-a773-d19be238b1ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:29 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f9d749-6fd2-4e17-b2d7-f435fa082ee1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b7c0b1-bf4a-4f83-884d-df3f63531219]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[250e292a-07f0-4141-bde4-557195698023]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:22:30 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:22:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcce7ba-16ba-4072-aeb0-7f62e5132d14]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG os_brick.utils [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Updating existing volume attachment record: 03866993-68af-4716-88e4-fbd725cea56e {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.network.neutron [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Successfully updated port: 60f463a9-2f06-47e3-a6ff-746ccbf480d5 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquiring lock "refresh_cache-96c4a3c2-590a-4166-88a3-6bf785237097" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquired lock "refresh_cache-96c4a3c2-590a-4166-88a3-6bf785237097" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.network.neutron [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.network.neutron [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.network.neutron [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Updating instance_info_cache with network_info: [{"id": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "address": "fa:16:3e:16:a3:f7", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f463a9-2f", "ovs_interfaceid": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Releasing lock "refresh_cache-96c4a3c2-590a-4166-88a3-6bf785237097" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.compute.manager [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Instance network_info: |[{"id": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "address": "fa:16:3e:16:a3:f7", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f463a9-2f", "ovs_interfaceid": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Start _get_guest_xml network_info=[{"id": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "address": "fa:16:3e:16:a3:f7", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f463a9-2f", "ovs_interfaceid": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:22:30 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:22:30 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-307637786',display_name='tempest-VolumesActionsTest-instance-307637786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-307637786',id=45,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e932cfe5d8b84dff8d8826cd581ce086',ramdisk_id='',reservation_id='r-ejsw9re8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1657173529',owner_user_name='tempest-VolumesActionsTest-1657173529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:22:29Z,user_data=None,user_id='9e5ebd975fea42b0af369d94360206c7',uuid=96c4a3c2-590a-4166-88a3-6bf785237097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "address": "fa:16:3e:16:a3:f7", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f463a9-2f", "ovs_interfaceid": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Converting VIF {"id": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "address": "fa:16:3e:16:a3:f7", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f463a9-2f", "ovs_interfaceid": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a3:f7,bridge_name='br-int',has_traffic_filtering=True,id=60f463a9-2f06-47e3-a6ff-746ccbf480d5,network=Network(0d612931-a2ce-4d23-ad5b-5e8c5abf33d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f463a9-2f') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.objects.instance [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lazy-loading 'pci_devices' on Instance uuid 96c4a3c2-590a-4166-88a3-6bf785237097 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:22:30 user nova-compute[75246]:   <uuid>96c4a3c2-590a-4166-88a3-6bf785237097</uuid>
Nov 28 17:22:30 user nova-compute[75246]:   <name>instance-0000002d</name>
Nov 28 17:22:30 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:22:30 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:22:30 user nova-compute[75246]:   <metadata>
Nov 28 17:22:30 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:22:30 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:22:30 user nova-compute[75246]:       <nova:name>tempest-VolumesActionsTest-instance-307637786</nova:name>
Nov 28 17:22:30 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:22:30</nova:creationTime>
Nov 28 17:22:30 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:22:30 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:22:30 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:22:30 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:22:30 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:22:30 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:22:30 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:22:30 user nova-compute[75246]:       <nova:owner>
Nov 28 17:22:30 user nova-compute[75246]:         <nova:user uuid="9e5ebd975fea42b0af369d94360206c7">tempest-VolumesActionsTest-1657173529-project-member</nova:user>
Nov 28 17:22:30 user nova-compute[75246]:         <nova:project uuid="e932cfe5d8b84dff8d8826cd581ce086">tempest-VolumesActionsTest-1657173529</nova:project>
Nov 28 17:22:30 user nova-compute[75246]:       </nova:owner>
Nov 28 17:22:30 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:22:30 user nova-compute[75246]:       <nova:ports>
Nov 28 17:22:30 user nova-compute[75246]:         <nova:port uuid="60f463a9-2f06-47e3-a6ff-746ccbf480d5">
Nov 28 17:22:30 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 17:22:30 user nova-compute[75246]:         </nova:port>
Nov 28 17:22:30 user nova-compute[75246]:       </nova:ports>
Nov 28 17:22:30 user nova-compute[75246]:     </nova:instance>
Nov 28 17:22:30 user nova-compute[75246]:   </metadata>
Nov 28 17:22:30 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:22:30 user nova-compute[75246]:     <system>
Nov 28 17:22:30 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:22:30 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:22:30 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:22:30 user nova-compute[75246]:       <entry name="serial">96c4a3c2-590a-4166-88a3-6bf785237097</entry>
Nov 28 17:22:30 user nova-compute[75246]:       <entry name="uuid">96c4a3c2-590a-4166-88a3-6bf785237097</entry>
Nov 28 17:22:30 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:22:30 user nova-compute[75246]:     </system>
Nov 28 17:22:30 user nova-compute[75246]:   </sysinfo>
Nov 28 17:22:30 user nova-compute[75246]:   <os>
Nov 28 17:22:30 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:22:30 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:22:30 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:22:30 user nova-compute[75246]:   </os>
Nov 28 17:22:30 user nova-compute[75246]:   <features>
Nov 28 17:22:30 user nova-compute[75246]:     <acpi/>
Nov 28 17:22:30 user nova-compute[75246]:     <apic/>
Nov 28 17:22:30 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:22:30 user nova-compute[75246]:   </features>
Nov 28 17:22:30 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:22:30 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:22:30 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:22:30 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:22:30 user nova-compute[75246]:   </clock>
Nov 28 17:22:30 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:22:30 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:22:30 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:22:30 user nova-compute[75246]:   </cpu>
Nov 28 17:22:30 user nova-compute[75246]:   <devices>
Nov 28 17:22:30 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:22:30 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:22:30 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/disk"/>
Nov 28 17:22:30 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:22:30 user nova-compute[75246]:     </disk>
Nov 28 17:22:30 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:22:30 user nova-compute[75246]:       <mac address="fa:16:3e:16:a3:f7"/>
Nov 28 17:22:30 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:22:30 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:22:30 user nova-compute[75246]:       <target dev="tap60f463a9-2f"/>
Nov 28 17:22:30 user nova-compute[75246]:     </interface>
Nov 28 17:22:30 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:22:30 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/console.log" append="off"/>
Nov 28 17:22:30 user nova-compute[75246]:     </serial>
Nov 28 17:22:30 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:22:30 user nova-compute[75246]:     <video>
Nov 28 17:22:30 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:22:30 user nova-compute[75246]:     </video>
Nov 28 17:22:30 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:22:30 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:22:30 user nova-compute[75246]:     </rng>
Nov 28 17:22:30 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:22:30 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:22:30 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:22:30 user nova-compute[75246]:     </memballoon>
Nov 28 17:22:30 user nova-compute[75246]:   </devices>
Nov 28 17:22:30 user nova-compute[75246]: </domain>
Nov 28 17:22:30 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-307637786',display_name='tempest-VolumesActionsTest-instance-307637786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-307637786',id=45,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e932cfe5d8b84dff8d8826cd581ce086',ramdisk_id='',reservation_id='r-ejsw9re8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1657173529',owner_user_name='tempest-VolumesActionsTest-1657173529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:22:29Z,user_data=None,user_id='9e5ebd975fea42b0af369d94360206c7',uuid=96c4a3c2-590a-4166-88a3-6bf785237097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "address": "fa:16:3e:16:a3:f7", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f463a9-2f", "ovs_interfaceid": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Converting VIF {"id": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "address": "fa:16:3e:16:a3:f7", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f463a9-2f", "ovs_interfaceid": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a3:f7,bridge_name='br-int',has_traffic_filtering=True,id=60f463a9-2f06-47e3-a6ff-746ccbf480d5,network=Network(0d612931-a2ce-4d23-ad5b-5e8c5abf33d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f463a9-2f') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG os_vif [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a3:f7,bridge_name='br-int',has_traffic_filtering=True,id=60f463a9-2f06-47e3-a6ff-746ccbf480d5,network=Network(0d612931-a2ce-4d23-ad5b-5e8c5abf33d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f463a9-2f') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4345b311-354d-572f-808b-5726f438d2f6', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60f463a9-2f, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60f463a9-2f, col_values=(('qos', UUID('0fcd2185-6123-4e51-8d55-f9a111e5883d')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60f463a9-2f, col_values=(('external_ids', {'iface-id': '60f463a9-2f06-47e3-a6ff-746ccbf480d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:a3:f7', 'vm-uuid': '96c4a3c2-590a-4166-88a3-6bf785237097'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:30 user nova-compute[75246]: INFO os_vif [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a3:f7,bridge_name='br-int',has_traffic_filtering=True,id=60f463a9-2f06-47e3-a6ff-746ccbf480d5,network=Network(0d612931-a2ce-4d23-ad5b-5e8c5abf33d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f463a9-2f')
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] No VIF found with MAC fa:16:3e:16:a3:f7, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:22:30 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Instance spawned successfully.
Nov 28 17:22:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG nova.compute.manager [req-ae8b2463-ec51-4a9b-8fb9-7ec233edfb3d req-97a436ef-a617-4c22-9613-5c84901b1619 service nova] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Received event network-vif-plugged-53e83fee-b8ec-4d6a-a3ce-d831c58e7e86 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ae8b2463-ec51-4a9b-8fb9-7ec233edfb3d req-97a436ef-a617-4c22-9613-5c84901b1619 service nova] Acquiring lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ae8b2463-ec51-4a9b-8fb9-7ec233edfb3d req-97a436ef-a617-4c22-9613-5c84901b1619 service nova] Lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ae8b2463-ec51-4a9b-8fb9-7ec233edfb3d req-97a436ef-a617-4c22-9613-5c84901b1619 service nova] Lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG nova.compute.manager [req-ae8b2463-ec51-4a9b-8fb9-7ec233edfb3d req-97a436ef-a617-4c22-9613-5c84901b1619 service nova] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] No waiting events found dispatching network-vif-plugged-53e83fee-b8ec-4d6a-a3ce-d831c58e7e86 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:22:31 user nova-compute[75246]: WARNING nova.compute.manager [req-ae8b2463-ec51-4a9b-8fb9-7ec233edfb3d req-97a436ef-a617-4c22-9613-5c84901b1619 service nova] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Received unexpected event network-vif-plugged-53e83fee-b8ec-4d6a-a3ce-d831c58e7e86 for instance with vm_state building and task_state spawning.
Nov 28 17:22:31 user nova-compute[75246]: DEBUG nova.compute.manager [req-ae8b2463-ec51-4a9b-8fb9-7ec233edfb3d req-97a436ef-a617-4c22-9613-5c84901b1619 service nova] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Received event network-changed-60f463a9-2f06-47e3-a6ff-746ccbf480d5 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG nova.compute.manager [req-ae8b2463-ec51-4a9b-8fb9-7ec233edfb3d req-97a436ef-a617-4c22-9613-5c84901b1619 service nova] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Refreshing instance network info cache due to event network-changed-60f463a9-2f06-47e3-a6ff-746ccbf480d5. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ae8b2463-ec51-4a9b-8fb9-7ec233edfb3d req-97a436ef-a617-4c22-9613-5c84901b1619 service nova] Acquiring lock "refresh_cache-96c4a3c2-590a-4166-88a3-6bf785237097" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ae8b2463-ec51-4a9b-8fb9-7ec233edfb3d req-97a436ef-a617-4c22-9613-5c84901b1619 service nova] Acquired lock "refresh_cache-96c4a3c2-590a-4166-88a3-6bf785237097" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG nova.network.neutron [req-ae8b2463-ec51-4a9b-8fb9-7ec233edfb3d req-97a436ef-a617-4c22-9613-5c84901b1619 service nova] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Refreshing network info cache for port 60f463a9-2f06-47e3-a6ff-746ccbf480d5 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:22:31 user nova-compute[75246]: INFO nova.compute.manager [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 28 17:22:31 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:22:31 user nova-compute[75246]: INFO nova.compute.manager [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Took 6.18 seconds to build instance.
Nov 28 17:22:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6f31e570-aa6c-4d08-8df5-34bf5521d970 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.297s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG nova.network.neutron [req-ae8b2463-ec51-4a9b-8fb9-7ec233edfb3d req-97a436ef-a617-4c22-9613-5c84901b1619 service nova] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Updated VIF entry in instance network info cache for port 60f463a9-2f06-47e3-a6ff-746ccbf480d5. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG nova.network.neutron [req-ae8b2463-ec51-4a9b-8fb9-7ec233edfb3d req-97a436ef-a617-4c22-9613-5c84901b1619 service nova] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Updating instance_info_cache with network_info: [{"id": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "address": "fa:16:3e:16:a3:f7", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f463a9-2f", "ovs_interfaceid": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ae8b2463-ec51-4a9b-8fb9-7ec233edfb3d req-97a436ef-a617-4c22-9613-5c84901b1619 service nova] Releasing lock "refresh_cache-96c4a3c2-590a-4166-88a3-6bf785237097" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:22:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-4db9cedb-c51e-4f67-b1d0-c7fb27df932a req-36425528-e1a5-40d8-9b8f-da63b6296bce service nova] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Received event network-vif-plugged-60f463a9-2f06-47e3-a6ff-746ccbf480d5 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:22:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4db9cedb-c51e-4f67-b1d0-c7fb27df932a req-36425528-e1a5-40d8-9b8f-da63b6296bce service nova] Acquiring lock "96c4a3c2-590a-4166-88a3-6bf785237097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4db9cedb-c51e-4f67-b1d0-c7fb27df932a req-36425528-e1a5-40d8-9b8f-da63b6296bce service nova] Lock "96c4a3c2-590a-4166-88a3-6bf785237097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4db9cedb-c51e-4f67-b1d0-c7fb27df932a req-36425528-e1a5-40d8-9b8f-da63b6296bce service nova] Lock "96c4a3c2-590a-4166-88a3-6bf785237097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:32 user nova-compute[75246]: DEBUG nova.compute.manager [req-4db9cedb-c51e-4f67-b1d0-c7fb27df932a req-36425528-e1a5-40d8-9b8f-da63b6296bce service nova] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] No waiting events found dispatching network-vif-plugged-60f463a9-2f06-47e3-a6ff-746ccbf480d5 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:22:32 user nova-compute[75246]: WARNING nova.compute.manager [req-4db9cedb-c51e-4f67-b1d0-c7fb27df932a req-36425528-e1a5-40d8-9b8f-da63b6296bce service nova] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Received unexpected event network-vif-plugged-60f463a9-2f06-47e3-a6ff-746ccbf480d5 for instance with vm_state building and task_state spawning.
Nov 28 17:22:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-39b28485-d057-4f39-b3cb-316547e19eb8 req-540a085b-cb9b-432f-b852-d4e340187c30 service nova] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Received event network-vif-plugged-60f463a9-2f06-47e3-a6ff-746ccbf480d5 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:22:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-39b28485-d057-4f39-b3cb-316547e19eb8 req-540a085b-cb9b-432f-b852-d4e340187c30 service nova] Acquiring lock "96c4a3c2-590a-4166-88a3-6bf785237097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-39b28485-d057-4f39-b3cb-316547e19eb8 req-540a085b-cb9b-432f-b852-d4e340187c30 service nova] Lock "96c4a3c2-590a-4166-88a3-6bf785237097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-39b28485-d057-4f39-b3cb-316547e19eb8 req-540a085b-cb9b-432f-b852-d4e340187c30 service nova] Lock "96c4a3c2-590a-4166-88a3-6bf785237097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-39b28485-d057-4f39-b3cb-316547e19eb8 req-540a085b-cb9b-432f-b852-d4e340187c30 service nova] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] No waiting events found dispatching network-vif-plugged-60f463a9-2f06-47e3-a6ff-746ccbf480d5 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:22:34 user nova-compute[75246]: WARNING nova.compute.manager [req-39b28485-d057-4f39-b3cb-316547e19eb8 req-540a085b-cb9b-432f-b852-d4e340187c30 service nova] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Received unexpected event network-vif-plugged-60f463a9-2f06-47e3-a6ff-746ccbf480d5 for instance with vm_state building and task_state spawning.
Nov 28 17:22:34 user nova-compute[75246]: DEBUG nova.compute.manager [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:22:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:22:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Instance spawned successfully.
Nov 28 17:22:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:22:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:22:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:22:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:22:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:22:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:22:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:22:34 user nova-compute[75246]: INFO nova.compute.manager [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Took 6.12 seconds to spawn the instance on the hypervisor.
Nov 28 17:22:34 user nova-compute[75246]: DEBUG nova.compute.manager [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:22:34 user nova-compute[75246]: INFO nova.compute.manager [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Took 6.91 seconds to build instance.
Nov 28 17:22:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-21f69d8c-6403-4323-a03e-0a761062af0e tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "96c4a3c2-590a-4166-88a3-6bf785237097" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.025s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:36 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:22:36 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lZTbEkVM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:22:37 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:22:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:22:37 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:22:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:22:37 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[54960da8-512a-4166-b3c1-914494d19f2f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:22:37 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71f9909-c70d-4614-870c-2e9e84657124]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2] added
Nov 28 17:22:37 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[22660e60-e283-4fdd-9b27-fcdd25d44593]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92dfeda-4e19-42c8-9ce9-d01fafbcd226]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lZTbEkVM {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lZTbEkVM" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[447912d8-b3f2-4bac-b908-5ae3a3721079]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lZTbEkVM'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ae2e5c-dadb-4866-9e84-2f5fd139ed6c]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:22:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[35951f0f-dfd6-4d31-a4fe-881e723d95f9]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:22:38 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:22:38 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5680367-e2c3-4afb-b834-22964b530c58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2, portal: 172.16.0.220,3260]
Nov 28 17:22:38 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2, portal: 172.16.0.220,3260] successful.
Nov 28 17:22:38 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[85016cb4-d2d3-4e18-a529-acd6d2601e40]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66e1938-316c-42ee-8334-d0fd5c13bd9f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:22:38 user nova-compute[75246]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 (non-flash)
Nov 28 17:22:38 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:22:38 user nova-compute[75246]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 (non-flash)
Nov 28 17:22:38 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3d8ff9-bfdd-4878-a47f-584cd4d59a66]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lZTbEkVM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:22:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23432386639363465', 'path': '/dev/sdc'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:22:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432386639363465', 'path': '/dev/sdc'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:22:39 user nova-compute[75246]: DEBUG nova.objects.instance [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lazy-loading 'flavor' on Instance uuid 5175a016-3237-4e79-bc77-4b72e5402695 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:22:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:22:39 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:22:39 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:22:39 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:22:39 user nova-compute[75246]:   <serial>2820efd5-b045-48b9-a0ce-ed89bfac30d2</serial>
Nov 28 17:22:39 user nova-compute[75246]: </disk>
Nov 28 17:22:39 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:22:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:22:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:22:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] No VIF found with MAC fa:16:3e:f8:4f:00, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:22:40 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:22:40 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:22:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8287MB free_disk=25.126262664794922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:22:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-db0b2222-894f-4723-89fc-f48b6986fcc7 tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.348s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:22:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a796152e-e8df-41bf-a5ea-ae94d4fa8b41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:22:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 5175a016-3237-4e79-bc77-4b72e5402695 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:22:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 1a520141-ac59-407a-a525-b3fe402e8cd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:22:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 81104ec7-670f-417b-926f-9ee8f7c5d659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:22:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance ae257aa8-78c3-499e-a5cf-1021deefe6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:22:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 96c4a3c2-590a-4166-88a3-6bf785237097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:22:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:22:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:22:40 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:22:40 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:22:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:22:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:22:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:22:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:22:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:22:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:42 user nova-compute[75246]: INFO nova.compute.manager [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Detaching volume 2820efd5-b045-48b9-a0ce-ed89bfac30d2
Nov 28 17:22:42 user nova-compute[75246]: INFO nova.virt.block_device [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Attempting to driver detach volume 2820efd5-b045-48b9-a0ce-ed89bfac30d2 from mountpoint /dev/vdb
Nov 28 17:22:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Attempting to detach device vdb from instance 5175a016-3237-4e79-bc77-4b72e5402695 from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:22:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:22:42 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:22:42 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:22:42 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:22:42 user nova-compute[75246]:   <serial>2820efd5-b045-48b9-a0ce-ed89bfac30d2</serial>
Nov 28 17:22:42 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:22:42 user nova-compute[75246]: </disk>
Nov 28 17:22:42 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:22:42 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Successfully detached device vdb from instance 5175a016-3237-4e79-bc77-4b72e5402695 from the persistent domain config.
Nov 28 17:22:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5175a016-3237-4e79-bc77-4b72e5402695 from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:22:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:22:42 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:22:42 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:22:42 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:22:42 user nova-compute[75246]:   <serial>2820efd5-b045-48b9-a0ce-ed89bfac30d2</serial>
Nov 28 17:22:42 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:22:42 user nova-compute[75246]: </disk>
Nov 28 17:22:42 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:22:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:22:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:22:42 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:22:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5175a016-3237-4e79-bc77-4b72e5402695 {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:22:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:47 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:22:47 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:22:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-5175a016-3237-4e79-bc77-4b72e5402695" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:22:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-5175a016-3237-4e79-bc77-4b72e5402695" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:22:48 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:22:48 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Updating instance_info_cache with network_info: [{"id": "f457a357-039b-4e32-b72a-9868e81dbb1b", "address": "fa:16:3e:f8:4f:00", "network": {"id": "e7fee231-f986-4a20-8aa4-d9b0d120a12c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1360844364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd096414f864a1cb0d72e97161ee28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf457a357-03", "ovs_interfaceid": "f457a357-039b-4e32-b72a-9868e81dbb1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:22:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-5175a016-3237-4e79-bc77-4b72e5402695" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:22:48 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:22:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "81104ec7-670f-417b-926f-9ee8f7c5d659" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "81104ec7-670f-417b-926f-9ee8f7c5d659-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:51 user nova-compute[75246]: INFO nova.compute.manager [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Terminating instance
Nov 28 17:22:51 user nova-compute[75246]: DEBUG nova.compute.manager [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:22:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:51 user nova-compute[75246]: DEBUG nova.compute.manager [req-5d53ab9a-a3e1-488b-85d7-de86e47159b5 req-47bf9913-a022-41c2-b82a-9be5b3ae1ca0 service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Received event network-vif-unplugged-790ebd7c-fc6a-4b58-a55c-4b2618528aba {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:22:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5d53ab9a-a3e1-488b-85d7-de86e47159b5 req-47bf9913-a022-41c2-b82a-9be5b3ae1ca0 service nova] Acquiring lock "81104ec7-670f-417b-926f-9ee8f7c5d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5d53ab9a-a3e1-488b-85d7-de86e47159b5 req-47bf9913-a022-41c2-b82a-9be5b3ae1ca0 service nova] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-5d53ab9a-a3e1-488b-85d7-de86e47159b5 req-47bf9913-a022-41c2-b82a-9be5b3ae1ca0 service nova] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:51 user nova-compute[75246]: DEBUG nova.compute.manager [req-5d53ab9a-a3e1-488b-85d7-de86e47159b5 req-47bf9913-a022-41c2-b82a-9be5b3ae1ca0 service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] No waiting events found dispatching network-vif-unplugged-790ebd7c-fc6a-4b58-a55c-4b2618528aba {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:22:51 user nova-compute[75246]: DEBUG nova.compute.manager [req-5d53ab9a-a3e1-488b-85d7-de86e47159b5 req-47bf9913-a022-41c2-b82a-9be5b3ae1ca0 service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Received event network-vif-unplugged-790ebd7c-fc6a-4b58-a55c-4b2618528aba for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:22:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:52 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Instance destroyed successfully.
Nov 28 17:22:52 user nova-compute[75246]: DEBUG nova.objects.instance [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lazy-loading 'resources' on Instance uuid 81104ec7-670f-417b-926f-9ee8f7c5d659 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:22:52 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:19:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-37419736',display_name='tempest-AttachVolumeNegativeTest-server-37419736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-37419736',id=42,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTjxXTKyiGyugWA+BNbGzRbIakvzZND7iIsYhAq5DK2kboS5mJv24/8kj8Tn6g0HRoGnBoCmtdSS5uP6x4KMB5Mug8qDeCBuNYZG2jMV9KpQ+kAEkeL4FYXGZzr61pvCw==',key_name='tempest-keypair-741064529',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:20:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d39dde859674409847b50613bcc608b',ramdisk_id='',reservation_id='r-051kkxnb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-524813585',owner_user_name='tempest-AttachVolumeNegativeTest-524813585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:20:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ae91a734974162a14d7b4c498c4b8d',uuid=81104ec7-670f-417b-926f-9ee8f7c5d659,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "address": "fa:16:3e:1b:3c:72", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790ebd7c-fc", "ovs_interfaceid": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:22:52 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converting VIF {"id": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "address": "fa:16:3e:1b:3c:72", "network": {"id": "1c0ed7e0-36eb-4f61-ae8f-9b726940b797", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1595852432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d39dde859674409847b50613bcc608b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790ebd7c-fc", "ovs_interfaceid": "790ebd7c-fc6a-4b58-a55c-4b2618528aba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:22:52 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:3c:72,bridge_name='br-int',has_traffic_filtering=True,id=790ebd7c-fc6a-4b58-a55c-4b2618528aba,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790ebd7c-fc') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:22:52 user nova-compute[75246]: DEBUG os_vif [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:3c:72,bridge_name='br-int',has_traffic_filtering=True,id=790ebd7c-fc6a-4b58-a55c-4b2618528aba,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790ebd7c-fc') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:22:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap790ebd7c-fc, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:22:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:22:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e87168f3-7535-4aee-9fec-7059d09bf16a) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:22:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:22:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:52 user nova-compute[75246]: INFO os_vif [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:3c:72,bridge_name='br-int',has_traffic_filtering=True,id=790ebd7c-fc6a-4b58-a55c-4b2618528aba,network=Network(1c0ed7e0-36eb-4f61-ae8f-9b726940b797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790ebd7c-fc')
Nov 28 17:22:52 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Deleting instance files /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659_del
Nov 28 17:22:52 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Deletion of /opt/stack/data/nova/instances/81104ec7-670f-417b-926f-9ee8f7c5d659_del complete
Nov 28 17:22:52 user nova-compute[75246]: INFO nova.compute.manager [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 17:22:52 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:22:52 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:22:52 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:22:52 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:22:52 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Took 0.76 seconds to deallocate network for instance.
Nov 28 17:22:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-d475d691-4ccf-40e7-9b87-d36183a3d481 req-6e40c5e3-5d28-4080-bf53-b8fd42ec549e service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Received event network-vif-deleted-790ebd7c-fc6a-4b58-a55c-4b2618528aba {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:22:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:53 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:22:53 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:22:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:53 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Deleted allocations for instance 81104ec7-670f-417b-926f-9ee8f7c5d659
Nov 28 17:22:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96ef1110-10f7-4b66-b6f1-7b0d7b083c33 tempest-AttachVolumeNegativeTest-524813585 tempest-AttachVolumeNegativeTest-524813585-project-member] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.073s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-a6de0fde-7b6b-44ea-a10f-b4c4b90802b1 req-e32d82c8-003b-4a83-98a0-9bc7f848d66e service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Received event network-vif-plugged-790ebd7c-fc6a-4b58-a55c-4b2618528aba {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:22:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a6de0fde-7b6b-44ea-a10f-b4c4b90802b1 req-e32d82c8-003b-4a83-98a0-9bc7f848d66e service nova] Acquiring lock "81104ec7-670f-417b-926f-9ee8f7c5d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a6de0fde-7b6b-44ea-a10f-b4c4b90802b1 req-e32d82c8-003b-4a83-98a0-9bc7f848d66e service nova] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a6de0fde-7b6b-44ea-a10f-b4c4b90802b1 req-e32d82c8-003b-4a83-98a0-9bc7f848d66e service nova] Lock "81104ec7-670f-417b-926f-9ee8f7c5d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-a6de0fde-7b6b-44ea-a10f-b4c4b90802b1 req-e32d82c8-003b-4a83-98a0-9bc7f848d66e service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] No waiting events found dispatching network-vif-plugged-790ebd7c-fc6a-4b58-a55c-4b2618528aba {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:22:53 user nova-compute[75246]: WARNING nova.compute.manager [req-a6de0fde-7b6b-44ea-a10f-b4c4b90802b1 req-e32d82c8-003b-4a83-98a0-9bc7f848d66e service nova] [instance: 81104ec7-670f-417b-926f-9ee8f7c5d659] Received unexpected event network-vif-plugged-790ebd7c-fc6a-4b58-a55c-4b2618528aba for instance with vm_state deleted and task_state None.
Nov 28 17:22:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "f7c26790-8596-4151-94f3-e5bfa9fb7586" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:53 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:22:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:22:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:22:53 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:22:53 user nova-compute[75246]: INFO nova.compute.claims [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Claim successful on node user
Nov 28 17:22:54 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG nova.network.neutron [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:22:54 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:22:54 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG nova.policy [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c334f73c5bf1473aadf865c8f032c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0eebdd39c54a74be8d2e0f9842b165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:22:54 user nova-compute[75246]: INFO nova.virt.block_device [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Booting with volume 816a4875-3799-4b5e-aac5-f1461aca0f75 at /dev/vda
Nov 28 17:22:54 user nova-compute[75246]: DEBUG os_brick.utils [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf600ac3-ad00-4478-911d-0139b3b11ad0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec05483-150f-4c1d-99eb-7ce60c9a6889]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6262ef-76be-4fbc-a473-82511130497b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[147c7d00-025a-4494-87fb-970b6acb6371]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:22:54 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:22:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d9e751-e542-4845-889a-82bb7d42d0dd]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG os_brick.utils [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:22:54 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Updating existing volume attachment record: 20393c46-0d97-4a92-bb3a-240d01d5cd14 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:22:55 user nova-compute[75246]: DEBUG nova.network.neutron [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Successfully created port: 034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:22:55 user nova-compute[75246]: DEBUG nova.network.neutron [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Successfully updated port: 034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:22:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "refresh_cache-f7c26790-8596-4151-94f3-e5bfa9fb7586" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:22:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquired lock "refresh_cache-f7c26790-8596-4151-94f3-e5bfa9fb7586" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:22:55 user nova-compute[75246]: DEBUG nova.network.neutron [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:22:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-f13f5f5d-382b-467c-a0fc-246b4fdc1e59 req-117a9cff-587e-4a86-a504-08b91888dfc0 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received event network-changed-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:22:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-f13f5f5d-382b-467c-a0fc-246b4fdc1e59 req-117a9cff-587e-4a86-a504-08b91888dfc0 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Refreshing instance network info cache due to event network-changed-034ab47e-b974-4aab-b608-25f52c0fea75. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:22:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f13f5f5d-382b-467c-a0fc-246b4fdc1e59 req-117a9cff-587e-4a86-a504-08b91888dfc0 service nova] Acquiring lock "refresh_cache-f7c26790-8596-4151-94f3-e5bfa9fb7586" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:22:55 user nova-compute[75246]: DEBUG nova.network.neutron [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:22:55 user nova-compute[75246]: DEBUG nova.network.neutron [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Updating instance_info_cache with network_info: [{"id": "034ab47e-b974-4aab-b608-25f52c0fea75", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034ab47e-b9", "ovs_interfaceid": "034ab47e-b974-4aab-b608-25f52c0fea75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:22:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Releasing lock "refresh_cache-f7c26790-8596-4151-94f3-e5bfa9fb7586" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:22:55 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Instance network_info: |[{"id": "034ab47e-b974-4aab-b608-25f52c0fea75", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034ab47e-b9", "ovs_interfaceid": "034ab47e-b974-4aab-b608-25f52c0fea75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:22:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f13f5f5d-382b-467c-a0fc-246b4fdc1e59 req-117a9cff-587e-4a86-a504-08b91888dfc0 service nova] Acquired lock "refresh_cache-f7c26790-8596-4151-94f3-e5bfa9fb7586" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:22:55 user nova-compute[75246]: DEBUG nova.network.neutron [req-f13f5f5d-382b-467c-a0fc-246b4fdc1e59 req-117a9cff-587e-4a86-a504-08b91888dfc0 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Refreshing network info cache for port 034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:22:56 user nova-compute[75246]: DEBUG nova.network.neutron [req-f13f5f5d-382b-467c-a0fc-246b4fdc1e59 req-117a9cff-587e-4a86-a504-08b91888dfc0 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Updated VIF entry in instance network info cache for port 034ab47e-b974-4aab-b608-25f52c0fea75. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:22:56 user nova-compute[75246]: DEBUG nova.network.neutron [req-f13f5f5d-382b-467c-a0fc-246b4fdc1e59 req-117a9cff-587e-4a86-a504-08b91888dfc0 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Updating instance_info_cache with network_info: [{"id": "034ab47e-b974-4aab-b608-25f52c0fea75", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034ab47e-b9", "ovs_interfaceid": "034ab47e-b974-4aab-b608-25f52c0fea75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:22:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f13f5f5d-382b-467c-a0fc-246b4fdc1e59 req-117a9cff-587e-4a86-a504-08b91888dfc0 service nova] Releasing lock "refresh_cache-f7c26790-8596-4151-94f3-e5bfa9fb7586" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:22:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:22:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:23:01 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Creating image(s)
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Did not create local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Ensure instance console log exists: /opt/stack/data/nova/instances/f7c26790-8596-4151-94f3-e5bfa9fb7586/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Start _get_guest_xml network_info=[{"id": "034ab47e-b974-4aab-b608-25f52c0fea75", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034ab47e-b9", "ovs_interfaceid": "034ab47e-b974-4aab-b608-25f52c0fea75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '20393c46-0d97-4a92-bb3a-240d01d5cd14', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goEuwIjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7c26790-8596-4151-94f3-e5bfa9fb7586', 'attached_at': '', 'detached_at': '', 'volume_id': '816a4875-3799-4b5e-aac5-f1461aca0f75', 'serial': '816a4875-3799-4b5e-aac5-f1461aca0f75'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:23:01 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:23:01 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goEuwIjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:23:01 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:23:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:23:01 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:23:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:23:01 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4832f2e2-84bb-4579-ad24-aefc582af280]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:23:01 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e19dc9-4c0c-47ef-a863-64c4ae19b3f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75] added
Nov 28 17:23:01 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13fe3c9-f02a-4869-9fd8-56b036d6d10a]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3b9ab6-9295-4ae9-b151-5b57994f4e13]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v goEuwIjf {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v goEuwIjf" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daf41ec-45ef-402f-a7e6-ce181dc77438]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'goEuwIjf'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fa0d9a-0ec2-47ba-b49f-3f35f908d3b9]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c70ae10-e9b3-4979-b0b7-9169bbc8207f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:23:01 user nova-compute[75246]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 (non-flash)
Nov 28 17:23:01 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:23:01 user nova-compute[75246]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 (non-flash)
Nov 28 17:23:01 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f853530f-faa4-4281-95cd-e472d1ff7729]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75, portal: 172.16.0.220,3260]
Nov 28 17:23:01 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75, portal: 172.16.0.220,3260] successful.
Nov 28 17:23:01 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb15c56-e7d5-4a70-b4ab-f74dc86a3db2]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[629dcc1a-67d1-4a28-8949-c40eae54c506]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:23:02 user nova-compute[75246]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 (non-flash)
Nov 28 17:23:02 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:23:02 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:23:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:23:02 user nova-compute[75246]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 (non-flash)
Nov 28 17:23:02 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:23:02 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:23:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:23:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:23:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:23:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:23:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:02 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[178f8af7-5da7-436c-804e-de468ef9dae8]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: None {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:23:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:03 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:23:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goEuwIjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:23:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:23:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23538666564313061', 'path': '/dev/sdd'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:23:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538666564313061', 'path': '/dev/sdd'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:23:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:22:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-163192544',display_name='tempest-TestVolumeBootPattern-server-163192544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-163192544',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrg6dgmwLxM+qOiUQmkZP+lby3sIcjedzAt6Qr2Vg5lrRzmZuOCIGPTCAvsPt68uI6UbSOJN/oyUTe5OqihGAovpc3vgI5qK/6ApsKxZfDXJBHGmnIe3WgtSfAKkR6e4g==',key_name='tempest-TestVolumeBootPattern-1591090964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe0eebdd39c54a74be8d2e0f9842b165',ramdisk_id='',reservation_id='r-006oh214',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-389869337',owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:22:54Z,user_data=None,user_id='c334f73c5bf1473aadf865c8f032c0cb',uuid=f7c26790-8596-4151-94f3-e5bfa9fb7586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "034ab47e-b974-4aab-b608-25f52c0fea75", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034ab47e-b9", "ovs_interfaceid": "034ab47e-b974-4aab-b608-25f52c0fea75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:23:03 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converting VIF {"id": "034ab47e-b974-4aab-b608-25f52c0fea75", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034ab47e-b9", "ovs_interfaceid": "034ab47e-b974-4aab-b608-25f52c0fea75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:23:03 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:1b:b0,bridge_name='br-int',has_traffic_filtering=True,id=034ab47e-b974-4aab-b608-25f52c0fea75,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap034ab47e-b9') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:23:03 user nova-compute[75246]: DEBUG nova.objects.instance [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lazy-loading 'pci_devices' on Instance uuid f7c26790-8596-4151-94f3-e5bfa9fb7586 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:23:03 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5175a016-3237-4e79-bc77-4b72e5402695 is timed out.
Nov 28 17:23:03 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Successfully detached device vdb from instance 5175a016-3237-4e79-bc77-4b72e5402695 from the live domain config.
Nov 28 17:23:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:23:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lZTbEkVM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:23:03 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:23:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:23:03 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:23:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:23:03 user nova-compute[75246]:   <uuid>f7c26790-8596-4151-94f3-e5bfa9fb7586</uuid>
Nov 28 17:23:03 user nova-compute[75246]:   <name>instance-0000002e</name>
Nov 28 17:23:03 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:23:03 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:23:03 user nova-compute[75246]:   <metadata>
Nov 28 17:23:03 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:23:03 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:23:03 user nova-compute[75246]:       <nova:name>tempest-TestVolumeBootPattern-server-163192544</nova:name>
Nov 28 17:23:03 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:23:01</nova:creationTime>
Nov 28 17:23:03 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:23:03 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:23:03 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:23:03 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:23:03 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:23:03 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:23:03 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:23:03 user nova-compute[75246]:       <nova:owner>
Nov 28 17:23:03 user nova-compute[75246]:         <nova:user uuid="c334f73c5bf1473aadf865c8f032c0cb">tempest-TestVolumeBootPattern-389869337-project-member</nova:user>
Nov 28 17:23:03 user nova-compute[75246]:         <nova:project uuid="fe0eebdd39c54a74be8d2e0f9842b165">tempest-TestVolumeBootPattern-389869337</nova:project>
Nov 28 17:23:03 user nova-compute[75246]:       </nova:owner>
Nov 28 17:23:03 user nova-compute[75246]:       <nova:ports>
Nov 28 17:23:03 user nova-compute[75246]:         <nova:port uuid="034ab47e-b974-4aab-b608-25f52c0fea75">
Nov 28 17:23:03 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 17:23:03 user nova-compute[75246]:         </nova:port>
Nov 28 17:23:03 user nova-compute[75246]:       </nova:ports>
Nov 28 17:23:03 user nova-compute[75246]:     </nova:instance>
Nov 28 17:23:03 user nova-compute[75246]:   </metadata>
Nov 28 17:23:03 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:23:03 user nova-compute[75246]:     <system>
Nov 28 17:23:03 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:23:03 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:23:03 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:23:03 user nova-compute[75246]:       <entry name="serial">f7c26790-8596-4151-94f3-e5bfa9fb7586</entry>
Nov 28 17:23:03 user nova-compute[75246]:       <entry name="uuid">f7c26790-8596-4151-94f3-e5bfa9fb7586</entry>
Nov 28 17:23:03 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:23:03 user nova-compute[75246]:     </system>
Nov 28 17:23:03 user nova-compute[75246]:   </sysinfo>
Nov 28 17:23:03 user nova-compute[75246]:   <os>
Nov 28 17:23:03 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:23:03 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:23:03 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:23:03 user nova-compute[75246]:   </os>
Nov 28 17:23:03 user nova-compute[75246]:   <features>
Nov 28 17:23:03 user nova-compute[75246]:     <acpi/>
Nov 28 17:23:03 user nova-compute[75246]:     <apic/>
Nov 28 17:23:03 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:23:03 user nova-compute[75246]:   </features>
Nov 28 17:23:03 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:23:03 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:23:03 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:23:03 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:23:03 user nova-compute[75246]:   </clock>
Nov 28 17:23:03 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:23:03 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:23:03 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:23:03 user nova-compute[75246]:   </cpu>
Nov 28 17:23:03 user nova-compute[75246]:   <devices>
Nov 28 17:23:03 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:23:03 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:23:03 user nova-compute[75246]:       <source dev="/dev/sdd"/>
Nov 28 17:23:03 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:23:03 user nova-compute[75246]:       <serial>816a4875-3799-4b5e-aac5-f1461aca0f75</serial>
Nov 28 17:23:03 user nova-compute[75246]:     </disk>
Nov 28 17:23:03 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:23:03 user nova-compute[75246]:       <mac address="fa:16:3e:f0:1b:b0"/>
Nov 28 17:23:03 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:23:03 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:23:03 user nova-compute[75246]:       <target dev="tap034ab47e-b9"/>
Nov 28 17:23:03 user nova-compute[75246]:     </interface>
Nov 28 17:23:03 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:23:03 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/f7c26790-8596-4151-94f3-e5bfa9fb7586/console.log" append="off"/>
Nov 28 17:23:03 user nova-compute[75246]:     </serial>
Nov 28 17:23:03 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:23:03 user nova-compute[75246]:     <video>
Nov 28 17:23:03 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:23:03 user nova-compute[75246]:     </video>
Nov 28 17:23:03 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:23:03 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:23:03 user nova-compute[75246]:     </rng>
Nov 28 17:23:03 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:23:03 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:23:03 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:23:03 user nova-compute[75246]:     </memballoon>
Nov 28 17:23:03 user nova-compute[75246]:   </devices>
Nov 28 17:23:03 user nova-compute[75246]: </domain>
Nov 28 17:23:03 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:22:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-163192544',display_name='tempest-TestVolumeBootPattern-server-163192544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-163192544',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrg6dgmwLxM+qOiUQmkZP+lby3sIcjedzAt6Qr2Vg5lrRzmZuOCIGPTCAvsPt68uI6UbSOJN/oyUTe5OqihGAovpc3vgI5qK/6ApsKxZfDXJBHGmnIe3WgtSfAKkR6e4g==',key_name='tempest-TestVolumeBootPattern-1591090964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe0eebdd39c54a74be8d2e0f9842b165',ramdisk_id='',reservation_id='r-006oh214',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-389869337',owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:22:54Z,user_data=None,user_id='c334f73c5bf1473aadf865c8f032c0cb',uuid=f7c26790-8596-4151-94f3-e5bfa9fb7586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "034ab47e-b974-4aab-b608-25f52c0fea75", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034ab47e-b9", "ovs_interfaceid": "034ab47e-b974-4aab-b608-25f52c0fea75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converting VIF {"id": "034ab47e-b974-4aab-b608-25f52c0fea75", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034ab47e-b9", "ovs_interfaceid": "034ab47e-b974-4aab-b608-25f52c0fea75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:1b:b0,bridge_name='br-int',has_traffic_filtering=True,id=034ab47e-b974-4aab-b608-25f52c0fea75,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap034ab47e-b9') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG os_vif [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:1b:b0,bridge_name='br-int',has_traffic_filtering=True,id=034ab47e-b974-4aab-b608-25f52c0fea75,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap034ab47e-b9') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39f4ba44-e0ee-5c6b-b121-7bd5908e5d0e', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap034ab47e-b9, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap034ab47e-b9, col_values=(('qos', UUID('a94d9e0c-cfba-4832-83d8-f53162a5acfa')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap034ab47e-b9, col_values=(('external_ids', {'iface-id': '034ab47e-b974-4aab-b608-25f52c0fea75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:1b:b0', 'vm-uuid': 'f7c26790-8596-4151-94f3-e5bfa9fb7586'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[19135c37-22e1-4a80-9ea8-1fd142db17e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:23:04 user nova-compute[75246]: No targets found.
Nov 28 17:23:04 user nova-compute[75246]: iSNS:
Nov 28 17:23:04 user nova-compute[75246]: No targets found.
Nov 28 17:23:04 user nova-compute[75246]: STATIC:
Nov 28 17:23:04 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2
Nov 28 17:23:04 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:23:04 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:23:04 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75
Nov 28 17:23:04 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:23:04 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:23:04 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:23:04 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:23:04 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:23:04 user nova-compute[75246]: FIRMWARE:
Nov 28 17:23:04 user nova-compute[75246]: No targets found.
Nov 28 17:23:04 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:23:04 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:23:04 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:04 user nova-compute[75246]: INFO os_vif [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:1b:b0,bridge_name='br-int',has_traffic_filtering=True,id=034ab47e-b974-4aab-b608-25f52c0fea75,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap034ab47e-b9')
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4074e2c5-9350-4587-a034-fd97c1f42fc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[687e1134-d4ce-4030-8b33-ca89e380302d]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:23:04 user nova-compute[75246]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 (non-flash)
Nov 28 17:23:04 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:23:04 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:23:04 user nova-compute[75246]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 (non-flash)
Nov 28 17:23:04 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:23:04 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4b8712680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2'): ({'sdc'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Removing single pathed devices sdc {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] No VIF found with MAC fa:16:3e:f0:1b:b0, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.044s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5415901b-455f-4b25-8b6c-fc0ec1517f89]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.040s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5323c1b3-b2bb-4ac9-8d15-f85bcd63a1b9]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Flushing IO for device /dev/sdc {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4caf71-775b-464a-9755-d5f77232643e]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.185s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b3bc07-6248-4db1-abe3-2ec162af9a81]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.123s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4306612d-0bcf-443e-be73-a0d49e28f2dc]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.276s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a35e126-3a18-47e9-a16f-5f9df9d78e0a]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2, portal: 172.16.0.220,3260]
Nov 28 17:23:04 user nova-compute[75246]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2, portal: 172.16.0.220,3260] successful.
Nov 28 17:23:04 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2820efd5-b045-48b9-a0ce-ed89bfac30d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db4e981-d942-4079-a9f6-cd852f813a55]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.860s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] <== disconnect_volume: return (860ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-2b8809bf-6b12-4d0b-b06e-722162a409ff req-00764df1-c590-412b-8cc0-cf58156de8a7 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received event network-vif-plugged-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2b8809bf-6b12-4d0b-b06e-722162a409ff req-00764df1-c590-412b-8cc0-cf58156de8a7 service nova] Acquiring lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2b8809bf-6b12-4d0b-b06e-722162a409ff req-00764df1-c590-412b-8cc0-cf58156de8a7 service nova] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2b8809bf-6b12-4d0b-b06e-722162a409ff req-00764df1-c590-412b-8cc0-cf58156de8a7 service nova] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-2b8809bf-6b12-4d0b-b06e-722162a409ff req-00764df1-c590-412b-8cc0-cf58156de8a7 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] No waiting events found dispatching network-vif-plugged-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:23:04 user nova-compute[75246]: WARNING nova.compute.manager [req-2b8809bf-6b12-4d0b-b06e-722162a409ff req-00764df1-c590-412b-8cc0-cf58156de8a7 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received unexpected event network-vif-plugged-034ab47e-b974-4aab-b608-25f52c0fea75 for instance with vm_state building and task_state spawning.
Nov 28 17:23:04 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lazy-loading 'flavor' on Instance uuid 5175a016-3237-4e79-bc77-4b72e5402695 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:23:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3c0254fb-66c3-4e63-a90b-24442c9c94cd tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.315s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:23:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:23:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:23:06 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Instance spawned successfully.
Nov 28 17:23:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:23:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:23:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:23:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:23:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:23:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:23:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:23:06 user nova-compute[75246]: INFO nova.compute.manager [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 28 17:23:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:23:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-f7b93d57-85fb-4cab-a7a7-b52be819287c req-8ca28fdc-f445-4da0-a8ea-ca1e48aae690 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received event network-vif-plugged-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:23:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f7b93d57-85fb-4cab-a7a7-b52be819287c req-8ca28fdc-f445-4da0-a8ea-ca1e48aae690 service nova] Acquiring lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:23:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f7b93d57-85fb-4cab-a7a7-b52be819287c req-8ca28fdc-f445-4da0-a8ea-ca1e48aae690 service nova] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:23:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f7b93d57-85fb-4cab-a7a7-b52be819287c req-8ca28fdc-f445-4da0-a8ea-ca1e48aae690 service nova] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:23:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-f7b93d57-85fb-4cab-a7a7-b52be819287c req-8ca28fdc-f445-4da0-a8ea-ca1e48aae690 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] No waiting events found dispatching network-vif-plugged-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:23:06 user nova-compute[75246]: WARNING nova.compute.manager [req-f7b93d57-85fb-4cab-a7a7-b52be819287c req-8ca28fdc-f445-4da0-a8ea-ca1e48aae690 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received unexpected event network-vif-plugged-034ab47e-b974-4aab-b608-25f52c0fea75 for instance with vm_state building and task_state spawning.
Nov 28 17:23:06 user nova-compute[75246]: INFO nova.compute.manager [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Took 12.95 seconds to build instance.
Nov 28 17:23:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4ceaf3bb-b97a-4564-b56c-5425464121b5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.048s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:23:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:13 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:23:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG nova.objects.instance [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lazy-loading 'flavor' on Instance uuid 1a520141-ac59-407a-a525-b3fe402e8cd5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:23:23 user nova-compute[75246]: INFO nova.compute.manager [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Attaching volume 9404eaad-09b5-4b76-9f67-c6595d033899 to /dev/vdb
Nov 28 17:23:23 user nova-compute[75246]: DEBUG os_brick.utils [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c72f50-9c32-47d8-8e36-808f14f74942]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4febfef5-2b8b-49c4-b751-870035e56548]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a95dec-a69b-41b3-ad93-5dccbb55d718]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe602682-539d-4a09-8ee2-08d51fd7c793]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:23:23 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:23:23 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ee65cf-26cf-4815-a6d2-4bbf27def1d9]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG os_brick.utils [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:23:23 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Updating existing volume attachment record: 4b3c609d-dc4e-49a5-bee6-36bb16afc886 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:23:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AELFzyTq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:23:30 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:23:30 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:23:30 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5ee03b-85f9-4a3d-8ae2-8d97e9548b7c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:23:30 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff424d4f-3fd3-4c3b-8592-8e5193be380c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899] added
Nov 28 17:23:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d57243-d496-44d4-b0c2-63c0dcb9692e]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd012e9b-baad-478f-84d5-f956949f6159]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AELFzyTq {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AELFzyTq" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2124d71c-2b03-4b48-938f-9af8354e584f]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AELFzyTq'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e061b6ff-63f4-4f0e-9bab-aed3b54350dc]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[95601da0-8668-4389-b91b-efde91bd41e3]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:23:30 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:23:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:23:30 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:23:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf74c0a-fcfd-4b3b-aff9-19956e802835]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899, portal: 172.16.0.220,3260]
Nov 28 17:23:30 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899, portal: 172.16.0.220,3260] successful.
Nov 28 17:23:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6cce11-6f22-4dc3-a4af-eb6badc3eeaf]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7499a2a2-f504-4f77-b46e-96472ba197bf]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:23:30 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:23:30 user nova-compute[75246]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)
Nov 28 17:23:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:23:30 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:23:30 user nova-compute[75246]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)
Nov 28 17:23:30 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dfc6f0-86ea-40a8-9e29-1554809d3926]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:23:30 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AELFzyTq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:23:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:23:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23339646233636532', 'path': '/dev/sdc'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:23:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339646233636532', 'path': '/dev/sdc'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:23:31 user nova-compute[75246]: DEBUG nova.objects.instance [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lazy-loading 'flavor' on Instance uuid 1a520141-ac59-407a-a525-b3fe402e8cd5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:23:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:23:31 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:23:31 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:23:31 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:23:31 user nova-compute[75246]:   <serial>9404eaad-09b5-4b76-9f67-c6595d033899</serial>
Nov 28 17:23:31 user nova-compute[75246]: </disk>
Nov 28 17:23:31 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:23:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:23:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:23:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] No VIF found with MAC fa:16:3e:24:10:f8, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:23:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b1788dfa-8497-4c6a-8ce2-5e72bd95df36 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.867s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:23:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:33 user nova-compute[75246]: INFO nova.compute.manager [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Rescuing
Nov 28 17:23:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:23:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquired lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:23:33 user nova-compute[75246]: DEBUG nova.network.neutron [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:23:33 user nova-compute[75246]: DEBUG nova.network.neutron [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Updating instance_info_cache with network_info: [{"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:23:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Releasing lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:23:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-ed70f5dc-508c-4992-b276-4cc9c7e70cfe req-bc7bdda0-5fa5-4706-bbc3-8ceffa30ee6b service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received event network-vif-unplugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:23:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ed70f5dc-508c-4992-b276-4cc9c7e70cfe req-bc7bdda0-5fa5-4706-bbc3-8ceffa30ee6b service nova] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:23:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ed70f5dc-508c-4992-b276-4cc9c7e70cfe req-bc7bdda0-5fa5-4706-bbc3-8ceffa30ee6b service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:23:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-ed70f5dc-508c-4992-b276-4cc9c7e70cfe req-bc7bdda0-5fa5-4706-bbc3-8ceffa30ee6b service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:23:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-ed70f5dc-508c-4992-b276-4cc9c7e70cfe req-bc7bdda0-5fa5-4706-bbc3-8ceffa30ee6b service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] No waiting events found dispatching network-vif-unplugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:23:34 user nova-compute[75246]: WARNING nova.compute.manager [req-ed70f5dc-508c-4992-b276-4cc9c7e70cfe req-bc7bdda0-5fa5-4706-bbc3-8ceffa30ee6b service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received unexpected event network-vif-unplugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 for instance with vm_state active and task_state rescuing.
Nov 28 17:23:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Instance destroyed successfully.
Nov 28 17:23:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Attempting a stable device rescue
Nov 28 17:23:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75246) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 17:23:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Instance directory exists: not creating {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 17:23:34 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Creating image(s)
Nov 28 17:23:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:23:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "/opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:23:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "/opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:23:34 user nova-compute[75246]: DEBUG nova.objects.instance [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1a520141-ac59-407a-a525-b3fe402e8cd5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:23:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "a444acb43f3e9fc14e27532062fae38275c7e0f1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:23:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "a444acb43f3e9fc14e27532062fae38275c7e0f1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:23:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a444acb43f3e9fc14e27532062fae38275c7e0f1.part --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a444acb43f3e9fc14e27532062fae38275c7e0f1.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:35 user nova-compute[75246]: DEBUG nova.virt.images [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] 8ac58a7a-f6f0-405d-9a7b-e876ac7d1da9 was qcow2, converting to raw {{(pid=75246) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 17:23:35 user nova-compute[75246]: DEBUG nova.privsep.utils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75246) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 17:23:35 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a444acb43f3e9fc14e27532062fae38275c7e0f1.part /opt/stack/data/nova/instances/_base/a444acb43f3e9fc14e27532062fae38275c7e0f1.converted {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a444acb43f3e9fc14e27532062fae38275c7e0f1.part /opt/stack/data/nova/instances/_base/a444acb43f3e9fc14e27532062fae38275c7e0f1.converted" returned: 0 in 0.379s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a444acb43f3e9fc14e27532062fae38275c7e0f1.converted --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-2910edcd-fa7c-4ea4-967c-0c6721e0b0c2 req-17deb5a1-df9f-47d4-be28-ad44ac996a52 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received event network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2910edcd-fa7c-4ea4-967c-0c6721e0b0c2 req-17deb5a1-df9f-47d4-be28-ad44ac996a52 service nova] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2910edcd-fa7c-4ea4-967c-0c6721e0b0c2 req-17deb5a1-df9f-47d4-be28-ad44ac996a52 service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2910edcd-fa7c-4ea4-967c-0c6721e0b0c2 req-17deb5a1-df9f-47d4-be28-ad44ac996a52 service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-2910edcd-fa7c-4ea4-967c-0c6721e0b0c2 req-17deb5a1-df9f-47d4-be28-ad44ac996a52 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] No waiting events found dispatching network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:23:36 user nova-compute[75246]: WARNING nova.compute.manager [req-2910edcd-fa7c-4ea4-967c-0c6721e0b0c2 req-17deb5a1-df9f-47d4-be28-ad44ac996a52 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received unexpected event network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 for instance with vm_state active and task_state rescuing.
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a444acb43f3e9fc14e27532062fae38275c7e0f1.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "a444acb43f3e9fc14e27532062fae38275c7e0f1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.780s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "a444acb43f3e9fc14e27532062fae38275c7e0f1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "a444acb43f3e9fc14e27532062fae38275c7e0f1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a444acb43f3e9fc14e27532062fae38275c7e0f1 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a444acb43f3e9fc14e27532062fae38275c7e0f1 --force-share --output=json" returned: 0 in 0.189s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a444acb43f3e9fc14e27532062fae38275c7e0f1,backing_fmt=raw /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk.rescue {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a444acb43f3e9fc14e27532062fae38275c7e0f1,backing_fmt=raw /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk.rescue" returned: 0 in 0.046s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "a444acb43f3e9fc14e27532062fae38275c7e0f1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.objects.instance [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lazy-loading 'migration_context' on Instance uuid 1a520141-ac59-407a-a525-b3fe402e8cd5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.objects.base [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Object Instance<1a520141-ac59-407a-a525-b3fe402e8cd5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Start _get_guest_xml network_info=[{"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "vif_mac": "fa:16:3e:24:10:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8ac58a7a-f6f0-405d-9a7b-e876ac7d1da9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '4b3c609d-dc4e-49a5-bee6-36bb16afc886', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AELFzyTq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '1a520141-ac59-407a-a525-b3fe402e8cd5', 'attached_at': '', 'detached_at': '', 'volume_id': '9404eaad-09b5-4b76-9f67-c6595d033899', 'serial': '9404eaad-09b5-4b76-9f67-c6595d033899'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.objects.instance [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lazy-loading 'resources' on Instance uuid 1a520141-ac59-407a-a525-b3fe402e8cd5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.objects.base [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Object Instance<1a520141-ac59-407a-a525-b3fe402e8cd5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.objects.instance [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lazy-loading 'numa_topology' on Instance uuid 1a520141-ac59-407a-a525-b3fe402e8cd5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.objects.base [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Object Instance<1a520141-ac59-407a-a525-b3fe402e8cd5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:23:36 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:23:36 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.objects.instance [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1a520141-ac59-407a-a525-b3fe402e8cd5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.objects.base [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Object Instance<1a520141-ac59-407a-a525-b3fe402e8cd5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AELFzyTq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:23:36 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:23:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:23:36 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:23:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:23:36 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e35c5e4-829a-45dc-a961-ac52eadd95be]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = AELFzyTq\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 17:23:36 user nova-compute[75246]: node.name = iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899
Nov 28 17:23:36 user nova-compute[75246]: node.tpgt = -1
Nov 28 17:23:36 user nova-compute[75246]: node.startup = automatic
Nov 28 17:23:36 user nova-compute[75246]: node.leading_login = No
Nov 28 17:23:36 user nova-compute[75246]: iface.iscsi_ifacename = default
Nov 28 17:23:36 user nova-compute[75246]: iface.net_ifacename = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.ipaddress = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.prefix_len = 0
Nov 28 17:23:36 user nova-compute[75246]: iface.hwaddress = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.transport_name = tcp
Nov 28 17:23:36 user nova-compute[75246]: iface.initiatorname = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.state = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.vlan_id = 0
Nov 28 17:23:36 user nova-compute[75246]: iface.vlan_priority = 0
Nov 28 17:23:36 user nova-compute[75246]: iface.vlan_state = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.iface_num = 0
Nov 28 17:23:36 user nova-compute[75246]: iface.mtu = 0
Nov 28 17:23:36 user nova-compute[75246]: iface.port = 0
Nov 28 17:23:36 user nova-compute[75246]: iface.bootproto = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.subnet_mask = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.gateway = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.dhcp_alt_client_id = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.dhcp_dns = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.dhcp_learn_iqn = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.dhcp_vendor_id_state = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.dhcp_vendor_id = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.dhcp_slp_da = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.fragmentation = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.gratuitous_arp = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.incoming_forwarding = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.tos_state = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.tos = 0
Nov 28 17:23:36 user nova-compute[75246]: iface.ttl = 0
Nov 28 17:23:36 user nova-compute[75246]: iface.delayed_ack = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.tcp_nagle = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.tcp_wsf_state = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.tcp_wsf = 0
Nov 28 17:23:36 user nova-compute[75246]: iface.tcp_timer_scale = 0
Nov 28 17:23:36 user nova-compute[75246]: iface.tcp_timestamp = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.redirect = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.def_task_mgmt_timeout = 0
Nov 28 17:23:36 user nova-compute[75246]: iface.header_digest = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.data_digest = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.immediate_data = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.initial_r2t = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.data_seq_inorder = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.data_pdu_inorder = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.erl = 0
Nov 28 17:23:36 user nova-compute[75246]: iface.max_receive_data_len = 0
Nov 28 17:23:36 user nova-compute[75246]: iface.first_burst_len = 0
Nov 28 17:23:36 user nova-compute[75246]: iface.max_outstanding_r2t = 0
Nov 28 17:23:36 user nova-compute[75246]: iface.max_burst_len = 0
Nov 28 17:23:36 user nova-compute[75246]: iface.chap_auth = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.bidi_chap = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.strict_login_compliance = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.discovery_auth = <empty>
Nov 28 17:23:36 user nova-compute[75246]: iface.discovery_logout = <empty>
Nov 28 17:23:36 user nova-compute[75246]: node.discovery_address = <empty>
Nov 28 17:23:36 user nova-compute[75246]: node.discovery_port = 0
Nov 28 17:23:36 user nova-compute[75246]: node.discovery_type = static
Nov 28 17:23:36 user nova-compute[75246]: node.session.initial_cmdsn = 0
Nov 28 17:23:36 user nova-compute[75246]: node.session.initial_login_retry_max = 8
Nov 28 17:23:36 user nova-compute[75246]: node.session.xmit_thread_priority = -20
Nov 28 17:23:36 user nova-compute[75246]: node.session.cmds_max = 128
Nov 28 17:23:36 user nova-compute[75246]: node.session.queue_depth = 32
Nov 28 17:23:36 user nova-compute[75246]: node.session.nr_sessions = 1
Nov 28 17:23:36 user nova-compute[75246]: node.session.auth.authmethod = CHAP
Nov 28 17:23:36 user nova-compute[75246]: node.session.auth.username = AELFzyTq
Nov 28 17:23:36 user nova-compute[75246]: node.session.auth.password = ***
Nov 28 17:23:36 user nova-compute[75246]: node.session.auth.username_in = <empty>
Nov 28 17:23:36 user nova-compute[75246]: node.session.auth.password_in = <empty>
Nov 28 17:23:36 user nova-compute[75246]: node.session.auth.chap_algs = MD5
Nov 28 17:23:36 user nova-compute[75246]: node.session.timeo.replacement_timeout = 120
Nov 28 17:23:36 user nova-compute[75246]: node.session.err_timeo.abort_timeout = 15
Nov 28 17:23:36 user nova-compute[75246]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 17:23:36 user nova-compute[75246]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 17:23:36 user nova-compute[75246]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 17:23:36 user nova-compute[75246]: node.session.iscsi.FastAbort = Yes
Nov 28 17:23:36 user nova-compute[75246]: node.session.iscsi.InitialR2T = No
Nov 28 17:23:36 user nova-compute[75246]: node.session.iscsi.ImmediateData = Yes
Nov 28 17:23:36 user nova-compute[75246]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 17:23:36 user nova-compute[75246]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 17:23:36 user nova-compute[75246]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 17:23:36 user nova-compute[75246]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 17:23:36 user nova-compute[75246]: node.session.iscsi.MaxConnections = 1
Nov 28 17:23:36 user nova-compute[75246]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 17:23:36 user nova-compute[75246]: node.session.iscsi.ERL = 0
Nov 28 17:23:36 user nova-compute[75246]: node.session.scan = manual
Nov 28 17:23:36 user nova-compute[75246]: node.session.reopen_max = 0
Nov 28 17:23:36 user nova-compute[75246]: node.conn[0].address = 172.16.0.220
Nov 28 17:23:36 user nova-compute[75246]: node.conn[0].port = 3260
Nov 28 17:23:36 user nova-compute[75246]: node.conn[0].startup = manual
Nov 28 17:23:36 user nova-compute[75246]: node.conn[0].tcp.window_size = 524288
Nov 28 17:23:36 user nova-compute[75246]: node.conn[0].tcp.type_of_service = 0
Nov 28 17:23:36 user nova-compute[75246]: node.conn[0].timeo.logout_timeout = 15
Nov 28 17:23:36 user nova-compute[75246]: node.conn[0].timeo.login_timeout = 15
Nov 28 17:23:36 user nova-compute[75246]: node.conn[0].timeo.auth_timeout = 45
Nov 28 17:23:36 user nova-compute[75246]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 17:23:36 user nova-compute[75246]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 17:23:36 user nova-compute[75246]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 17:23:36 user nova-compute[75246]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 17:23:36 user nova-compute[75246]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 17:23:36 user nova-compute[75246]: node.conn[0].iscsi.DataDigest = None
Nov 28 17:23:36 user nova-compute[75246]: node.conn[0].iscsi.IFMarker = No
Nov 28 17:23:36 user nova-compute[75246]: node.conn[0].iscsi.OFMarker = No
Nov 28 17:23:36 user nova-compute[75246]: # END RECORD
Nov 28 17:23:36 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89c6632-f1b7-4414-8d73-24f821f838f2]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[552ee6b0-15b5-4b09-bd8b-dd45d78ca99a]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AELFzyTq {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AELFzyTq" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6001dd64-2bc3-410d-85ae-bbcb7e9b45ee]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AELFzyTq'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[332b0a21-be92-470d-9c10-075692a3b205]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30b8275-d80d-4694-b5ed-4c72063664dc]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:23:37 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:23:37 user nova-compute[75246]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)
Nov 28 17:23:37 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:23:37 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:23:37 user nova-compute[75246]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)
Nov 28 17:23:37 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.156s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] HCTL ('34', '0', '0', 0) found on session 50 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac25769-b60d-4678-9a37-e5ef351ef1e3]: (4, ('0 0 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Searching for a device in session 50 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AELFzyTq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.180s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] <== connect_volume: return (181ms) {'type': 'block', 'scsi_wwn': '23339646233636532', 'path': '/dev/sdc'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339646233636532', 'path': '/dev/sdc'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2095107296',display_name='tempest-ServerStableDeviceRescueTest-server-2095107296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2095107296',id=40,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDa5uEO1HX+58NWsd53/buxKkPj78W0uZlYn7nLVLGasZGkhXRb5Jz2aA7I2S3wLbUGkObWNp8tsEnWn252BxXEnoOs3Plc1kb2ClU++Ma46Pfe3fpGcAWwTUSSX3xIDQ==',key_name='tempest-keypair-1485453579',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:19:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4641269f199d40e7b0950c342f63cedf',ramdisk_id='',reservation_id='r-zm04m3my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2071157665',owner_user_name='tempest-ServerStableDeviceRescueTest-2071157665-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:21:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19ef7d1761e1453192ff17640d5e76c5',uuid=1a520141-ac59-407a-a525-b3fe402e8cd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "vif_mac": "fa:16:3e:24:10:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Converting VIF {"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "vif_mac": "fa:16:3e:24:10:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:10:f8,bridge_name='br-int',has_traffic_filtering=True,id=82c2968b-a7ec-41d6-924f-25ce67ec14b1,network=Network(c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82c2968b-a7') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG nova.objects.instance [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a520141-ac59-407a-a525-b3fe402e8cd5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG nova.objects.base [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Object Instance<1a520141-ac59-407a-a525-b3fe402e8cd5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:23:37 user nova-compute[75246]:   <uuid>1a520141-ac59-407a-a525-b3fe402e8cd5</uuid>
Nov 28 17:23:37 user nova-compute[75246]:   <name>instance-00000028</name>
Nov 28 17:23:37 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:23:37 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:23:37 user nova-compute[75246]:   <metadata>
Nov 28 17:23:37 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:23:37 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:23:37 user nova-compute[75246]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2095107296</nova:name>
Nov 28 17:23:37 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:23:36</nova:creationTime>
Nov 28 17:23:37 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:23:37 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:23:37 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:23:37 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:23:37 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:23:37 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:23:37 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:23:37 user nova-compute[75246]:       <nova:owner>
Nov 28 17:23:37 user nova-compute[75246]:         <nova:user uuid="19ef7d1761e1453192ff17640d5e76c5">tempest-ServerStableDeviceRescueTest-2071157665-project-member</nova:user>
Nov 28 17:23:37 user nova-compute[75246]:         <nova:project uuid="4641269f199d40e7b0950c342f63cedf">tempest-ServerStableDeviceRescueTest-2071157665</nova:project>
Nov 28 17:23:37 user nova-compute[75246]:       </nova:owner>
Nov 28 17:23:37 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:23:37 user nova-compute[75246]:       <nova:ports>
Nov 28 17:23:37 user nova-compute[75246]:         <nova:port uuid="82c2968b-a7ec-41d6-924f-25ce67ec14b1">
Nov 28 17:23:37 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 17:23:37 user nova-compute[75246]:         </nova:port>
Nov 28 17:23:37 user nova-compute[75246]:       </nova:ports>
Nov 28 17:23:37 user nova-compute[75246]:     </nova:instance>
Nov 28 17:23:37 user nova-compute[75246]:   </metadata>
Nov 28 17:23:37 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:23:37 user nova-compute[75246]:     <system>
Nov 28 17:23:37 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:23:37 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:23:37 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:23:37 user nova-compute[75246]:       <entry name="serial">1a520141-ac59-407a-a525-b3fe402e8cd5</entry>
Nov 28 17:23:37 user nova-compute[75246]:       <entry name="uuid">1a520141-ac59-407a-a525-b3fe402e8cd5</entry>
Nov 28 17:23:37 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:23:37 user nova-compute[75246]:     </system>
Nov 28 17:23:37 user nova-compute[75246]:   </sysinfo>
Nov 28 17:23:37 user nova-compute[75246]:   <os>
Nov 28 17:23:37 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:23:37 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:23:37 user nova-compute[75246]:   </os>
Nov 28 17:23:37 user nova-compute[75246]:   <features>
Nov 28 17:23:37 user nova-compute[75246]:     <acpi/>
Nov 28 17:23:37 user nova-compute[75246]:     <apic/>
Nov 28 17:23:37 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:23:37 user nova-compute[75246]:   </features>
Nov 28 17:23:37 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:23:37 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:23:37 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:23:37 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:23:37 user nova-compute[75246]:   </clock>
Nov 28 17:23:37 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:23:37 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:23:37 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:23:37 user nova-compute[75246]:   </cpu>
Nov 28 17:23:37 user nova-compute[75246]:   <devices>
Nov 28 17:23:37 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:23:37 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:23:37 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk"/>
Nov 28 17:23:37 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:23:37 user nova-compute[75246]:     </disk>
Nov 28 17:23:37 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:23:37 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:23:37 user nova-compute[75246]:       <source dev="/dev/sdc"/>
Nov 28 17:23:37 user nova-compute[75246]:       <target dev="vdb" bus="virtio"/>
Nov 28 17:23:37 user nova-compute[75246]:       <serial>9404eaad-09b5-4b76-9f67-c6595d033899</serial>
Nov 28 17:23:37 user nova-compute[75246]:     </disk>
Nov 28 17:23:37 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:23:37 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:23:37 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk.rescue"/>
Nov 28 17:23:37 user nova-compute[75246]:       <target dev="vdc" bus="virtio"/>
Nov 28 17:23:37 user nova-compute[75246]:       <boot order="1"/>
Nov 28 17:23:37 user nova-compute[75246]:     </disk>
Nov 28 17:23:37 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:23:37 user nova-compute[75246]:       <mac address="fa:16:3e:24:10:f8"/>
Nov 28 17:23:37 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:23:37 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:23:37 user nova-compute[75246]:       <target dev="tap82c2968b-a7"/>
Nov 28 17:23:37 user nova-compute[75246]:     </interface>
Nov 28 17:23:37 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:23:37 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/console.log" append="off"/>
Nov 28 17:23:37 user nova-compute[75246]:     </serial>
Nov 28 17:23:37 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:23:37 user nova-compute[75246]:     <video>
Nov 28 17:23:37 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:23:37 user nova-compute[75246]:     </video>
Nov 28 17:23:37 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:23:37 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:23:37 user nova-compute[75246]:     </rng>
Nov 28 17:23:37 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:23:37 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:23:37 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:23:37 user nova-compute[75246]:     </memballoon>
Nov 28 17:23:37 user nova-compute[75246]:   </devices>
Nov 28 17:23:37 user nova-compute[75246]: </domain>
Nov 28 17:23:37 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:23:37 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Instance destroyed successfully.
Nov 28 17:23:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] No VIF found with MAC fa:16:3e:24:10:f8, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:37 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:23:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-380bf2d3-3761-4a16-a523-c1712d84ce79 req-6cdfda93-dd3f-4bbf-a571-a6fff42b46b7 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received event network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:23:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-380bf2d3-3761-4a16-a523-c1712d84ce79 req-6cdfda93-dd3f-4bbf-a571-a6fff42b46b7 service nova] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:23:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-380bf2d3-3761-4a16-a523-c1712d84ce79 req-6cdfda93-dd3f-4bbf-a571-a6fff42b46b7 service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:23:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-380bf2d3-3761-4a16-a523-c1712d84ce79 req-6cdfda93-dd3f-4bbf-a571-a6fff42b46b7 service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:23:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-380bf2d3-3761-4a16-a523-c1712d84ce79 req-6cdfda93-dd3f-4bbf-a571-a6fff42b46b7 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] No waiting events found dispatching network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:23:38 user nova-compute[75246]: WARNING nova.compute.manager [req-380bf2d3-3761-4a16-a523-c1712d84ce79 req-6cdfda93-dd3f-4bbf-a571-a6fff42b46b7 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received unexpected event network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 for instance with vm_state active and task_state rescuing.
Nov 28 17:23:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:23:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:23:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:23:40 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:23:40 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:23:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8173MB free_disk=24.986026763916016GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:23:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:23:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:23:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:23:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a796152e-e8df-41bf-a5ea-ae94d4fa8b41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:23:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 5175a016-3237-4e79-bc77-4b72e5402695 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:23:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 1a520141-ac59-407a-a525-b3fe402e8cd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:23:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance ae257aa8-78c3-499e-a5cf-1021deefe6d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:23:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 96c4a3c2-590a-4166-88a3-6bf785237097 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:23:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance f7c26790-8596-4151-94f3-e5bfa9fb7586 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:23:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:23:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:23:40 user nova-compute[75246]: DEBUG nova.compute.manager [None req-5b9ddaf9-08a2-44ee-98a7-949d44bc6d9f tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:23:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-bd85b9e5-6bc6-4b91-b4e1-51b9cb768169 req-c197645f-d343-4b40-b0f4-d34a4599029a service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received event network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:23:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-bd85b9e5-6bc6-4b91-b4e1-51b9cb768169 req-c197645f-d343-4b40-b0f4-d34a4599029a service nova] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:23:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-bd85b9e5-6bc6-4b91-b4e1-51b9cb768169 req-c197645f-d343-4b40-b0f4-d34a4599029a service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:23:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-bd85b9e5-6bc6-4b91-b4e1-51b9cb768169 req-c197645f-d343-4b40-b0f4-d34a4599029a service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:23:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-bd85b9e5-6bc6-4b91-b4e1-51b9cb768169 req-c197645f-d343-4b40-b0f4-d34a4599029a service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] No waiting events found dispatching network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:23:40 user nova-compute[75246]: WARNING nova.compute.manager [req-bd85b9e5-6bc6-4b91-b4e1-51b9cb768169 req-c197645f-d343-4b40-b0f4-d34a4599029a service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received unexpected event network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 for instance with vm_state active and task_state rescuing.
Nov 28 17:23:41 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:23:41 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:23:41 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:23:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:23:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:23:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:23:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:23:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:23:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:23:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:23:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:44 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:23:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:23:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:23:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:23:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:23:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:23:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:49 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:23:49 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:23:49 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:23:49 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:23:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-894da7a3-9c67-417e-b0f4-306335a533e6" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:23:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-894da7a3-9c67-417e-b0f4-306335a533e6" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:23:50 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:23:50 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lazy-loading 'info_cache' on Instance uuid 894da7a3-9c67-417e-b0f4-306335a533e6 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:23:50 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Updating instance_info_cache with network_info: [{"id": "003f5480-4452-4891-8713-532403877f31", "address": "fa:16:3e:8d:b0:79", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap003f5480-44", "ovs_interfaceid": "003f5480-4452-4891-8713-532403877f31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:23:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-894da7a3-9c67-417e-b0f4-306335a533e6" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:23:50 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:23:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:23:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:23:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:23:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:23:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:23:58 user nova-compute[75246]: INFO nova.compute.manager [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Terminating instance
Nov 28 17:23:58 user nova-compute[75246]: DEBUG nova.compute.manager [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:23:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:58 user nova-compute[75246]: DEBUG nova.compute.manager [req-29b569d9-d0ff-46ae-928a-364635eb5dac req-c5467abf-c120-496a-9ebd-e1e3839ff145 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received event network-vif-unplugged-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:23:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-29b569d9-d0ff-46ae-928a-364635eb5dac req-c5467abf-c120-496a-9ebd-e1e3839ff145 service nova] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:23:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-29b569d9-d0ff-46ae-928a-364635eb5dac req-c5467abf-c120-496a-9ebd-e1e3839ff145 service nova] Lock "5175a016-3237-4e79-bc77-4b72e5402695-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:23:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-29b569d9-d0ff-46ae-928a-364635eb5dac req-c5467abf-c120-496a-9ebd-e1e3839ff145 service nova] Lock "5175a016-3237-4e79-bc77-4b72e5402695-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:23:58 user nova-compute[75246]: DEBUG nova.compute.manager [req-29b569d9-d0ff-46ae-928a-364635eb5dac req-c5467abf-c120-496a-9ebd-e1e3839ff145 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] No waiting events found dispatching network-vif-unplugged-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:23:58 user nova-compute[75246]: DEBUG nova.compute.manager [req-29b569d9-d0ff-46ae-928a-364635eb5dac req-c5467abf-c120-496a-9ebd-e1e3839ff145 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received event network-vif-unplugged-f457a357-039b-4e32-b72a-9868e81dbb1b for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:23:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:59 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Instance destroyed successfully.
Nov 28 17:23:59 user nova-compute[75246]: DEBUG nova.objects.instance [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lazy-loading 'resources' on Instance uuid 5175a016-3237-4e79-bc77-4b72e5402695 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1083182305',display_name='tempest-SnapshotDataIntegrityTests-server-1083182305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1083182305',id=39,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtGj2Il54kVcR0L7hq6lwnW1OotabRjIgcp2FdUWB4em7hCgdx7FdTnfeMmz100Xsxu2WzRDdA6/mGzkEhHCDeZsG/Fy+2FA+UATeIQz/IRhsI5+SvMDCtc5PKx3WsTCw==',key_name='tempest-keypair-744419971',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:17:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfd096414f864a1cb0d72e97161ee28b',ramdisk_id='',reservation_id='r-yv3doj07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-521360590',owner_user_name='tempest-SnapshotDataIntegrityTests-521360590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:17:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99a104ac894b42fba228f37739da28b9',uuid=5175a016-3237-4e79-bc77-4b72e5402695,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f457a357-039b-4e32-b72a-9868e81dbb1b", "address": "fa:16:3e:f8:4f:00", "network": {"id": "e7fee231-f986-4a20-8aa4-d9b0d120a12c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1360844364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd096414f864a1cb0d72e97161ee28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf457a357-03", "ovs_interfaceid": "f457a357-039b-4e32-b72a-9868e81dbb1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Converting VIF {"id": "f457a357-039b-4e32-b72a-9868e81dbb1b", "address": "fa:16:3e:f8:4f:00", "network": {"id": "e7fee231-f986-4a20-8aa4-d9b0d120a12c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1360844364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfd096414f864a1cb0d72e97161ee28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf457a357-03", "ovs_interfaceid": "f457a357-039b-4e32-b72a-9868e81dbb1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:4f:00,bridge_name='br-int',has_traffic_filtering=True,id=f457a357-039b-4e32-b72a-9868e81dbb1b,network=Network(e7fee231-f986-4a20-8aa4-d9b0d120a12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf457a357-03') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG os_vif [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:4f:00,bridge_name='br-int',has_traffic_filtering=True,id=f457a357-039b-4e32-b72a-9868e81dbb1b,network=Network(e7fee231-f986-4a20-8aa4-d9b0d120a12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf457a357-03') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf457a357-03, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=300bb98f-2961-4c54-8320-4777e0cc7461) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:23:59 user nova-compute[75246]: INFO os_vif [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:4f:00,bridge_name='br-int',has_traffic_filtering=True,id=f457a357-039b-4e32-b72a-9868e81dbb1b,network=Network(e7fee231-f986-4a20-8aa4-d9b0d120a12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf457a357-03')
Nov 28 17:23:59 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Deleting instance files /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695_del
Nov 28 17:23:59 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Deletion of /opt/stack/data/nova/instances/5175a016-3237-4e79-bc77-4b72e5402695_del complete
Nov 28 17:23:59 user nova-compute[75246]: INFO nova.compute.manager [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 28 17:23:59 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:23:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-d9000e86-921d-4a7f-8b22-5639e769b329 req-549a083f-f4cc-42da-a31e-af6c57166131 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received event network-vif-deleted-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:24:00 user nova-compute[75246]: INFO nova.compute.manager [req-d9000e86-921d-4a7f-8b22-5639e769b329 req-549a083f-f4cc-42da-a31e-af6c57166131 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Neutron deleted interface f457a357-039b-4e32-b72a-9868e81dbb1b; detaching it from the instance and deleting it from the info cache
Nov 28 17:24:00 user nova-compute[75246]: DEBUG nova.network.neutron [req-d9000e86-921d-4a7f-8b22-5639e769b329 req-549a083f-f4cc-42da-a31e-af6c57166131 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:24:00 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Took 1.13 seconds to deallocate network for instance.
Nov 28 17:24:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-d9000e86-921d-4a7f-8b22-5639e769b329 req-549a083f-f4cc-42da-a31e-af6c57166131 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Detach interface failed, port_id=f457a357-039b-4e32-b72a-9868e81dbb1b, reason: Instance 5175a016-3237-4e79-bc77-4b72e5402695 could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received event network-vif-plugged-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] Lock "5175a016-3237-4e79-bc77-4b72e5402695-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] Lock "5175a016-3237-4e79-bc77-4b72e5402695-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] No waiting events found dispatching network-vif-plugged-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:24:00 user nova-compute[75246]: WARNING nova.compute.manager [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received unexpected event network-vif-plugged-f457a357-039b-4e32-b72a-9868e81dbb1b for instance with vm_state deleted and task_state None.
Nov 28 17:24:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received event network-vif-plugged-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] Lock "5175a016-3237-4e79-bc77-4b72e5402695-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] Lock "5175a016-3237-4e79-bc77-4b72e5402695-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] No waiting events found dispatching network-vif-plugged-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:24:00 user nova-compute[75246]: WARNING nova.compute.manager [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received unexpected event network-vif-plugged-f457a357-039b-4e32-b72a-9868e81dbb1b for instance with vm_state deleted and task_state None.
Nov 28 17:24:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received event network-vif-plugged-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] Lock "5175a016-3237-4e79-bc77-4b72e5402695-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] Lock "5175a016-3237-4e79-bc77-4b72e5402695-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] No waiting events found dispatching network-vif-plugged-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:24:00 user nova-compute[75246]: WARNING nova.compute.manager [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received unexpected event network-vif-plugged-f457a357-039b-4e32-b72a-9868e81dbb1b for instance with vm_state deleted and task_state None.
Nov 28 17:24:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received event network-vif-unplugged-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] Lock "5175a016-3237-4e79-bc77-4b72e5402695-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] Lock "5175a016-3237-4e79-bc77-4b72e5402695-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] No waiting events found dispatching network-vif-unplugged-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:24:00 user nova-compute[75246]: WARNING nova.compute.manager [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received unexpected event network-vif-unplugged-f457a357-039b-4e32-b72a-9868e81dbb1b for instance with vm_state deleted and task_state None.
Nov 28 17:24:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received event network-vif-plugged-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] Acquiring lock "5175a016-3237-4e79-bc77-4b72e5402695-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] Lock "5175a016-3237-4e79-bc77-4b72e5402695-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] Lock "5175a016-3237-4e79-bc77-4b72e5402695-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] No waiting events found dispatching network-vif-plugged-f457a357-039b-4e32-b72a-9868e81dbb1b {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:24:00 user nova-compute[75246]: WARNING nova.compute.manager [req-e999f89a-3119-4f12-b21c-15f0edaa4c02 req-30b0a024-d025-4e64-9ce8-cf8811672d37 service nova] [instance: 5175a016-3237-4e79-bc77-4b72e5402695] Received unexpected event network-vif-plugged-f457a357-039b-4e32-b72a-9868e81dbb1b for instance with vm_state deleted and task_state None.
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:00 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Deleted allocations for instance 5175a016-3237-4e79-bc77-4b72e5402695
Nov 28 17:24:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-7a1c81bf-adb5-4f8a-bdb0-b39992bfa14d tempest-SnapshotDataIntegrityTests-521360590 tempest-SnapshotDataIntegrityTests-521360590-project-member] Lock "5175a016-3237-4e79-bc77-4b72e5402695" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.557s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:24:16 user nova-compute[75246]: INFO nova.compute.manager [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] instance snapshotting
Nov 28 17:24:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Beginning live snapshot process
Nov 28 17:24:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json -f qcow2 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json -f qcow2 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnp0jgfp7/2bdab35809e540f9a581c825fdc1557c.delta 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnp0jgfp7/2bdab35809e540f9a581c825fdc1557c.delta 1073741824" returned: 0 in 0.047s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:17 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 17:24:17 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:24:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75246) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 17:24:18 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 17:24:18 user nova-compute[75246]: DEBUG nova.privsep.utils [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75246) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 17:24:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnp0jgfp7/2bdab35809e540f9a581c825fdc1557c.delta /opt/stack/data/nova/instances/snapshots/tmpnp0jgfp7/2bdab35809e540f9a581c825fdc1557c {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnp0jgfp7/2bdab35809e540f9a581c825fdc1557c.delta /opt/stack/data/nova/instances/snapshots/tmpnp0jgfp7/2bdab35809e540f9a581c825fdc1557c" returned: 0 in 0.356s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:18 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Snapshot extracted, beginning image upload
Nov 28 17:24:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquiring lock "96c4a3c2-590a-4166-88a3-6bf785237097" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "96c4a3c2-590a-4166-88a3-6bf785237097" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquiring lock "96c4a3c2-590a-4166-88a3-6bf785237097-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "96c4a3c2-590a-4166-88a3-6bf785237097-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "96c4a3c2-590a-4166-88a3-6bf785237097-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:18 user nova-compute[75246]: INFO nova.compute.manager [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Terminating instance
Nov 28 17:24:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:24:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:18 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG nova.compute.manager [req-e58cb033-b7c9-4d43-8078-4085bb23f96d req-19c4474b-6e27-43c3-a023-016086902695 service nova] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Received event network-vif-unplugged-60f463a9-2f06-47e3-a6ff-746ccbf480d5 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e58cb033-b7c9-4d43-8078-4085bb23f96d req-19c4474b-6e27-43c3-a023-016086902695 service nova] Acquiring lock "96c4a3c2-590a-4166-88a3-6bf785237097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e58cb033-b7c9-4d43-8078-4085bb23f96d req-19c4474b-6e27-43c3-a023-016086902695 service nova] Lock "96c4a3c2-590a-4166-88a3-6bf785237097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e58cb033-b7c9-4d43-8078-4085bb23f96d req-19c4474b-6e27-43c3-a023-016086902695 service nova] Lock "96c4a3c2-590a-4166-88a3-6bf785237097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG nova.compute.manager [req-e58cb033-b7c9-4d43-8078-4085bb23f96d req-19c4474b-6e27-43c3-a023-016086902695 service nova] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] No waiting events found dispatching network-vif-unplugged-60f463a9-2f06-47e3-a6ff-746ccbf480d5 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG nova.compute.manager [req-e58cb033-b7c9-4d43-8078-4085bb23f96d req-19c4474b-6e27-43c3-a023-016086902695 service nova] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Received event network-vif-unplugged-60f463a9-2f06-47e3-a6ff-746ccbf480d5 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:24:19 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Instance destroyed successfully.
Nov 28 17:24:19 user nova-compute[75246]: DEBUG nova.objects.instance [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lazy-loading 'resources' on Instance uuid 96c4a3c2-590a-4166-88a3-6bf785237097 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-307637786',display_name='tempest-VolumesActionsTest-instance-307637786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-307637786',id=45,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:22:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e932cfe5d8b84dff8d8826cd581ce086',ramdisk_id='',reservation_id='r-ejsw9re8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1657173529',owner_user_name='tempest-VolumesActionsTest-1657173529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:22:35Z,user_data=None,user_id='9e5ebd975fea42b0af369d94360206c7',uuid=96c4a3c2-590a-4166-88a3-6bf785237097,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "address": "fa:16:3e:16:a3:f7", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f463a9-2f", "ovs_interfaceid": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Converting VIF {"id": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "address": "fa:16:3e:16:a3:f7", "network": {"id": "0d612931-a2ce-4d23-ad5b-5e8c5abf33d1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-500950768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e932cfe5d8b84dff8d8826cd581ce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f463a9-2f", "ovs_interfaceid": "60f463a9-2f06-47e3-a6ff-746ccbf480d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a3:f7,bridge_name='br-int',has_traffic_filtering=True,id=60f463a9-2f06-47e3-a6ff-746ccbf480d5,network=Network(0d612931-a2ce-4d23-ad5b-5e8c5abf33d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f463a9-2f') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG os_vif [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a3:f7,bridge_name='br-int',has_traffic_filtering=True,id=60f463a9-2f06-47e3-a6ff-746ccbf480d5,network=Network(0d612931-a2ce-4d23-ad5b-5e8c5abf33d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f463a9-2f') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60f463a9-2f, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fcd2185-6123-4e51-8d55-f9a111e5883d) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:19 user nova-compute[75246]: INFO os_vif [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a3:f7,bridge_name='br-int',has_traffic_filtering=True,id=60f463a9-2f06-47e3-a6ff-746ccbf480d5,network=Network(0d612931-a2ce-4d23-ad5b-5e8c5abf33d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f463a9-2f')
Nov 28 17:24:19 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Deleting instance files /opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097_del
Nov 28 17:24:19 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Deletion of /opt/stack/data/nova/instances/96c4a3c2-590a-4166-88a3-6bf785237097_del complete
Nov 28 17:24:19 user nova-compute[75246]: INFO nova.compute.manager [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 28 17:24:19 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:24:19 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:24:20 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:24:20 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Took 0.50 seconds to deallocate network for instance.
Nov 28 17:24:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-1d406ae1-f9e2-4404-8c9c-835681446b66 req-5efae1be-6310-4f35-ae5c-d659c99b528b service nova] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Received event network-vif-deleted-60f463a9-2f06-47e3-a6ff-746ccbf480d5 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:24:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:20 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:24:20 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:24:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:20 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Deleted allocations for instance 96c4a3c2-590a-4166-88a3-6bf785237097
Nov 28 17:24:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-12980ff8-fa3e-485b-8630-31d8bcae21e5 tempest-VolumesActionsTest-1657173529 tempest-VolumesActionsTest-1657173529-project-member] Lock "96c4a3c2-590a-4166-88a3-6bf785237097" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.707s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:21 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Snapshot image upload complete
Nov 28 17:24:21 user nova-compute[75246]: INFO nova.compute.manager [None req-95d84501-c08f-4f2a-bf69-6921433a17ab tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Took 5.24 seconds to snapshot the instance on the hypervisor.
Nov 28 17:24:21 user nova-compute[75246]: DEBUG nova.compute.manager [req-4aeb0d79-0bd8-4365-83f8-ac691111027c req-10135c12-4afb-49a6-b409-b12059f83f91 service nova] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Received event network-vif-plugged-60f463a9-2f06-47e3-a6ff-746ccbf480d5 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:24:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4aeb0d79-0bd8-4365-83f8-ac691111027c req-10135c12-4afb-49a6-b409-b12059f83f91 service nova] Acquiring lock "96c4a3c2-590a-4166-88a3-6bf785237097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4aeb0d79-0bd8-4365-83f8-ac691111027c req-10135c12-4afb-49a6-b409-b12059f83f91 service nova] Lock "96c4a3c2-590a-4166-88a3-6bf785237097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4aeb0d79-0bd8-4365-83f8-ac691111027c req-10135c12-4afb-49a6-b409-b12059f83f91 service nova] Lock "96c4a3c2-590a-4166-88a3-6bf785237097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:21 user nova-compute[75246]: DEBUG nova.compute.manager [req-4aeb0d79-0bd8-4365-83f8-ac691111027c req-10135c12-4afb-49a6-b409-b12059f83f91 service nova] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] No waiting events found dispatching network-vif-plugged-60f463a9-2f06-47e3-a6ff-746ccbf480d5 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:24:21 user nova-compute[75246]: WARNING nova.compute.manager [req-4aeb0d79-0bd8-4365-83f8-ac691111027c req-10135c12-4afb-49a6-b409-b12059f83f91 service nova] [instance: 96c4a3c2-590a-4166-88a3-6bf785237097] Received unexpected event network-vif-plugged-60f463a9-2f06-47e3-a6ff-746ccbf480d5 for instance with vm_state deleted and task_state None.
Nov 28 17:24:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "22705851-8092-4be3-ab20-3712b62e40f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "22705851-8092-4be3-ab20-3712b62e40f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:32 user nova-compute[75246]: DEBUG nova.compute.manager [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:24:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:32 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:32 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:24:32 user nova-compute[75246]: INFO nova.compute.claims [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Claim successful on node user
Nov 28 17:24:33 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG nova.compute.manager [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG nova.compute.manager [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG nova.network.neutron [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:24:33 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:24:33 user nova-compute[75246]: DEBUG nova.compute.manager [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG nova.policy [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '124d4cbebf644cd1a6de6aeccd4d4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c961f690054959a9a92a3383ff6ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG nova.compute.manager [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:24:33 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Creating image(s)
Nov 28 17:24:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "/opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "/opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "/opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk 1073741824" returned: 0 in 0.050s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:33 user nova-compute[75246]: DEBUG nova.network.neutron [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Successfully created port: 7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Cannot resize image /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Ensure instance console log exists: /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.network.neutron [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Successfully updated port: 7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "refresh_cache-22705851-8092-4be3-ab20-3712b62e40f5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquired lock "refresh_cache-22705851-8092-4be3-ab20-3712b62e40f5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.network.neutron [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-b9106722-1579-4cab-8b72-233566d12cb7 req-a51c7960-51ad-4d9e-8a78-ad06bb8249dd service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received event network-changed-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.compute.manager [req-b9106722-1579-4cab-8b72-233566d12cb7 req-a51c7960-51ad-4d9e-8a78-ad06bb8249dd service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Refreshing instance network info cache due to event network-changed-7166f3eb-0624-4f3a-85e1-db89b444907d. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b9106722-1579-4cab-8b72-233566d12cb7 req-a51c7960-51ad-4d9e-8a78-ad06bb8249dd service nova] Acquiring lock "refresh_cache-22705851-8092-4be3-ab20-3712b62e40f5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.network.neutron [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.network.neutron [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Updating instance_info_cache with network_info: [{"id": "7166f3eb-0624-4f3a-85e1-db89b444907d", "address": "fa:16:3e:7b:81:81", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7166f3eb-06", "ovs_interfaceid": "7166f3eb-0624-4f3a-85e1-db89b444907d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Releasing lock "refresh_cache-22705851-8092-4be3-ab20-3712b62e40f5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.compute.manager [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Instance network_info: |[{"id": "7166f3eb-0624-4f3a-85e1-db89b444907d", "address": "fa:16:3e:7b:81:81", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7166f3eb-06", "ovs_interfaceid": "7166f3eb-0624-4f3a-85e1-db89b444907d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b9106722-1579-4cab-8b72-233566d12cb7 req-a51c7960-51ad-4d9e-8a78-ad06bb8249dd service nova] Acquired lock "refresh_cache-22705851-8092-4be3-ab20-3712b62e40f5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.network.neutron [req-b9106722-1579-4cab-8b72-233566d12cb7 req-a51c7960-51ad-4d9e-8a78-ad06bb8249dd service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Refreshing network info cache for port 7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Start _get_guest_xml network_info=[{"id": "7166f3eb-0624-4f3a-85e1-db89b444907d", "address": "fa:16:3e:7b:81:81", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7166f3eb-06", "ovs_interfaceid": "7166f3eb-0624-4f3a-85e1-db89b444907d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:24:34 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:24:34 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:24:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-492535018',display_name='tempest-VolumesSnapshotTestJSON-instance-492535018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-492535018',id=47,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHVmBN3kLp/ygSOyonzB4KVQcmo+Xh+uW5tHV200ZRVwt8OhioJygpiRPcmUGSa5IvXZqJ3Uy+87vpV2I1EbikdwCAkBcOfdbEkWeI6vtpaeIa5c7WvE9aHiNPCXxJ83g==',key_name='tempest-keypair-815578317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45c961f690054959a9a92a3383ff6ff7',ramdisk_id='',reservation_id='r-ecf065tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1977855474',owner_user_name='tempest-VolumesSnapshotTestJSON-1977855474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:24:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124d4cbebf644cd1a6de6aeccd4d4030',uuid=22705851-8092-4be3-ab20-3712b62e40f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7166f3eb-0624-4f3a-85e1-db89b444907d", "address": "fa:16:3e:7b:81:81", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7166f3eb-06", "ovs_interfaceid": "7166f3eb-0624-4f3a-85e1-db89b444907d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Converting VIF {"id": "7166f3eb-0624-4f3a-85e1-db89b444907d", "address": "fa:16:3e:7b:81:81", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7166f3eb-06", "ovs_interfaceid": "7166f3eb-0624-4f3a-85e1-db89b444907d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:81:81,bridge_name='br-int',has_traffic_filtering=True,id=7166f3eb-0624-4f3a-85e1-db89b444907d,network=Network(6297eef9-9b93-47d1-bffa-cd1a7cc5925b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7166f3eb-06') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.objects.instance [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lazy-loading 'pci_devices' on Instance uuid 22705851-8092-4be3-ab20-3712b62e40f5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:24:34 user nova-compute[75246]:   <uuid>22705851-8092-4be3-ab20-3712b62e40f5</uuid>
Nov 28 17:24:34 user nova-compute[75246]:   <name>instance-0000002f</name>
Nov 28 17:24:34 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:24:34 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:24:34 user nova-compute[75246]:   <metadata>
Nov 28 17:24:34 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:24:34 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:24:34 user nova-compute[75246]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-492535018</nova:name>
Nov 28 17:24:34 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:24:34</nova:creationTime>
Nov 28 17:24:34 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:24:34 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:24:34 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:24:34 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:24:34 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:24:34 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:24:34 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:24:34 user nova-compute[75246]:       <nova:owner>
Nov 28 17:24:34 user nova-compute[75246]:         <nova:user uuid="124d4cbebf644cd1a6de6aeccd4d4030">tempest-VolumesSnapshotTestJSON-1977855474-project-member</nova:user>
Nov 28 17:24:34 user nova-compute[75246]:         <nova:project uuid="45c961f690054959a9a92a3383ff6ff7">tempest-VolumesSnapshotTestJSON-1977855474</nova:project>
Nov 28 17:24:34 user nova-compute[75246]:       </nova:owner>
Nov 28 17:24:34 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:24:34 user nova-compute[75246]:       <nova:ports>
Nov 28 17:24:34 user nova-compute[75246]:         <nova:port uuid="7166f3eb-0624-4f3a-85e1-db89b444907d">
Nov 28 17:24:34 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 17:24:34 user nova-compute[75246]:         </nova:port>
Nov 28 17:24:34 user nova-compute[75246]:       </nova:ports>
Nov 28 17:24:34 user nova-compute[75246]:     </nova:instance>
Nov 28 17:24:34 user nova-compute[75246]:   </metadata>
Nov 28 17:24:34 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:24:34 user nova-compute[75246]:     <system>
Nov 28 17:24:34 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:24:34 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:24:34 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:24:34 user nova-compute[75246]:       <entry name="serial">22705851-8092-4be3-ab20-3712b62e40f5</entry>
Nov 28 17:24:34 user nova-compute[75246]:       <entry name="uuid">22705851-8092-4be3-ab20-3712b62e40f5</entry>
Nov 28 17:24:34 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:24:34 user nova-compute[75246]:     </system>
Nov 28 17:24:34 user nova-compute[75246]:   </sysinfo>
Nov 28 17:24:34 user nova-compute[75246]:   <os>
Nov 28 17:24:34 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:24:34 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:24:34 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:24:34 user nova-compute[75246]:   </os>
Nov 28 17:24:34 user nova-compute[75246]:   <features>
Nov 28 17:24:34 user nova-compute[75246]:     <acpi/>
Nov 28 17:24:34 user nova-compute[75246]:     <apic/>
Nov 28 17:24:34 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:24:34 user nova-compute[75246]:   </features>
Nov 28 17:24:34 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:24:34 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:24:34 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:24:34 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:24:34 user nova-compute[75246]:   </clock>
Nov 28 17:24:34 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:24:34 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:24:34 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:24:34 user nova-compute[75246]:   </cpu>
Nov 28 17:24:34 user nova-compute[75246]:   <devices>
Nov 28 17:24:34 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:24:34 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:24:34 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk"/>
Nov 28 17:24:34 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:24:34 user nova-compute[75246]:     </disk>
Nov 28 17:24:34 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:24:34 user nova-compute[75246]:       <mac address="fa:16:3e:7b:81:81"/>
Nov 28 17:24:34 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:24:34 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:24:34 user nova-compute[75246]:       <target dev="tap7166f3eb-06"/>
Nov 28 17:24:34 user nova-compute[75246]:     </interface>
Nov 28 17:24:34 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:24:34 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/console.log" append="off"/>
Nov 28 17:24:34 user nova-compute[75246]:     </serial>
Nov 28 17:24:34 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:24:34 user nova-compute[75246]:     <video>
Nov 28 17:24:34 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:24:34 user nova-compute[75246]:     </video>
Nov 28 17:24:34 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:24:34 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:24:34 user nova-compute[75246]:     </rng>
Nov 28 17:24:34 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:24:34 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:24:34 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:24:34 user nova-compute[75246]:     </memballoon>
Nov 28 17:24:34 user nova-compute[75246]:   </devices>
Nov 28 17:24:34 user nova-compute[75246]: </domain>
Nov 28 17:24:34 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:24:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-492535018',display_name='tempest-VolumesSnapshotTestJSON-instance-492535018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-492535018',id=47,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHVmBN3kLp/ygSOyonzB4KVQcmo+Xh+uW5tHV200ZRVwt8OhioJygpiRPcmUGSa5IvXZqJ3Uy+87vpV2I1EbikdwCAkBcOfdbEkWeI6vtpaeIa5c7WvE9aHiNPCXxJ83g==',key_name='tempest-keypair-815578317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45c961f690054959a9a92a3383ff6ff7',ramdisk_id='',reservation_id='r-ecf065tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1977855474',owner_user_name='tempest-VolumesSnapshotTestJSON-1977855474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:24:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124d4cbebf644cd1a6de6aeccd4d4030',uuid=22705851-8092-4be3-ab20-3712b62e40f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7166f3eb-0624-4f3a-85e1-db89b444907d", "address": "fa:16:3e:7b:81:81", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7166f3eb-06", "ovs_interfaceid": "7166f3eb-0624-4f3a-85e1-db89b444907d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Converting VIF {"id": "7166f3eb-0624-4f3a-85e1-db89b444907d", "address": "fa:16:3e:7b:81:81", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7166f3eb-06", "ovs_interfaceid": "7166f3eb-0624-4f3a-85e1-db89b444907d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:81:81,bridge_name='br-int',has_traffic_filtering=True,id=7166f3eb-0624-4f3a-85e1-db89b444907d,network=Network(6297eef9-9b93-47d1-bffa-cd1a7cc5925b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7166f3eb-06') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG os_vif [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:81:81,bridge_name='br-int',has_traffic_filtering=True,id=7166f3eb-0624-4f3a-85e1-db89b444907d,network=Network(6297eef9-9b93-47d1-bffa-cd1a7cc5925b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7166f3eb-06') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d9c4db0-7e4d-5cee-95b1-ce7388469ee3', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7166f3eb-06, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7166f3eb-06, col_values=(('qos', UUID('b7d14e5e-b360-4219-867f-b69ef23690b7')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7166f3eb-06, col_values=(('external_ids', {'iface-id': '7166f3eb-0624-4f3a-85e1-db89b444907d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:81:81', 'vm-uuid': '22705851-8092-4be3-ab20-3712b62e40f5'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:24:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:35 user nova-compute[75246]: INFO os_vif [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:81:81,bridge_name='br-int',has_traffic_filtering=True,id=7166f3eb-0624-4f3a-85e1-db89b444907d,network=Network(6297eef9-9b93-47d1-bffa-cd1a7cc5925b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7166f3eb-06')
Nov 28 17:24:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:24:35 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] No VIF found with MAC fa:16:3e:7b:81:81, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:24:35 user nova-compute[75246]: DEBUG nova.network.neutron [req-b9106722-1579-4cab-8b72-233566d12cb7 req-a51c7960-51ad-4d9e-8a78-ad06bb8249dd service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Updated VIF entry in instance network info cache for port 7166f3eb-0624-4f3a-85e1-db89b444907d. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:24:35 user nova-compute[75246]: DEBUG nova.network.neutron [req-b9106722-1579-4cab-8b72-233566d12cb7 req-a51c7960-51ad-4d9e-8a78-ad06bb8249dd service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Updating instance_info_cache with network_info: [{"id": "7166f3eb-0624-4f3a-85e1-db89b444907d", "address": "fa:16:3e:7b:81:81", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7166f3eb-06", "ovs_interfaceid": "7166f3eb-0624-4f3a-85e1-db89b444907d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:24:35 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-b9106722-1579-4cab-8b72-233566d12cb7 req-a51c7960-51ad-4d9e-8a78-ad06bb8249dd service nova] Releasing lock "refresh_cache-22705851-8092-4be3-ab20-3712b62e40f5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:24:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-91d7a6ca-17ab-491a-a15f-25854ccf18c7 req-a2d95b4d-0920-4561-8fff-f0551db6f08a service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received event network-vif-plugged-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:24:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-91d7a6ca-17ab-491a-a15f-25854ccf18c7 req-a2d95b4d-0920-4561-8fff-f0551db6f08a service nova] Acquiring lock "22705851-8092-4be3-ab20-3712b62e40f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-91d7a6ca-17ab-491a-a15f-25854ccf18c7 req-a2d95b4d-0920-4561-8fff-f0551db6f08a service nova] Lock "22705851-8092-4be3-ab20-3712b62e40f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-91d7a6ca-17ab-491a-a15f-25854ccf18c7 req-a2d95b4d-0920-4561-8fff-f0551db6f08a service nova] Lock "22705851-8092-4be3-ab20-3712b62e40f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:36 user nova-compute[75246]: DEBUG nova.compute.manager [req-91d7a6ca-17ab-491a-a15f-25854ccf18c7 req-a2d95b4d-0920-4561-8fff-f0551db6f08a service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] No waiting events found dispatching network-vif-plugged-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:24:36 user nova-compute[75246]: WARNING nova.compute.manager [req-91d7a6ca-17ab-491a-a15f-25854ccf18c7 req-a2d95b4d-0920-4561-8fff-f0551db6f08a service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received unexpected event network-vif-plugged-7166f3eb-0624-4f3a-85e1-db89b444907d for instance with vm_state building and task_state spawning.
Nov 28 17:24:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:37 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG nova.compute.manager [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:24:38 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Instance spawned successfully.
Nov 28 17:24:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-4be3da82-4ba5-473c-bfe9-8baca8374a09 req-f0df2bf0-f145-45d5-a5e9-87e7b3e58465 service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received event network-vif-plugged-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be3da82-4ba5-473c-bfe9-8baca8374a09 req-f0df2bf0-f145-45d5-a5e9-87e7b3e58465 service nova] Acquiring lock "22705851-8092-4be3-ab20-3712b62e40f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be3da82-4ba5-473c-bfe9-8baca8374a09 req-f0df2bf0-f145-45d5-a5e9-87e7b3e58465 service nova] Lock "22705851-8092-4be3-ab20-3712b62e40f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be3da82-4ba5-473c-bfe9-8baca8374a09 req-f0df2bf0-f145-45d5-a5e9-87e7b3e58465 service nova] Lock "22705851-8092-4be3-ab20-3712b62e40f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-4be3da82-4ba5-473c-bfe9-8baca8374a09 req-f0df2bf0-f145-45d5-a5e9-87e7b3e58465 service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] No waiting events found dispatching network-vif-plugged-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:24:38 user nova-compute[75246]: WARNING nova.compute.manager [req-4be3da82-4ba5-473c-bfe9-8baca8374a09 req-f0df2bf0-f145-45d5-a5e9-87e7b3e58465 service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received unexpected event network-vif-plugged-7166f3eb-0624-4f3a-85e1-db89b444907d for instance with vm_state building and task_state spawning.
Nov 28 17:24:38 user nova-compute[75246]: INFO nova.compute.manager [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 28 17:24:38 user nova-compute[75246]: DEBUG nova.compute.manager [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:38 user nova-compute[75246]: INFO nova.compute.manager [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Took 5.90 seconds to build instance.
Nov 28 17:24:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-18fc3f98-4812-4f7e-8506-4fd1c80da5ee tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "22705851-8092-4be3-ab20-3712b62e40f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.014s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:24:38 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:24:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:40 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:24:40 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:24:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8272MB free_disk=24.978981018066406GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:24:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:24:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a796152e-e8df-41bf-a5ea-ae94d4fa8b41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:24:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 1a520141-ac59-407a-a525-b3fe402e8cd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:24:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance ae257aa8-78c3-499e-a5cf-1021deefe6d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:24:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance f7c26790-8596-4151-94f3-e5bfa9fb7586 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:24:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 22705851-8092-4be3-ab20-3712b62e40f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:24:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:24:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:24:40 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:24:40 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:24:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:24:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:24:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:24:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:24:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:24:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:24:43 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:24:44 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:24:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:24:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-8b545894-3d21-4270-ac92-4d54f3b845d5 req-70fde647-1c3c-4075-b4b6-4c571e327761 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received event network-changed-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:24:45 user nova-compute[75246]: DEBUG nova.compute.manager [req-8b545894-3d21-4270-ac92-4d54f3b845d5 req-70fde647-1c3c-4075-b4b6-4c571e327761 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Refreshing instance network info cache due to event network-changed-034ab47e-b974-4aab-b608-25f52c0fea75. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:24:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8b545894-3d21-4270-ac92-4d54f3b845d5 req-70fde647-1c3c-4075-b4b6-4c571e327761 service nova] Acquiring lock "refresh_cache-f7c26790-8596-4151-94f3-e5bfa9fb7586" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:24:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8b545894-3d21-4270-ac92-4d54f3b845d5 req-70fde647-1c3c-4075-b4b6-4c571e327761 service nova] Acquired lock "refresh_cache-f7c26790-8596-4151-94f3-e5bfa9fb7586" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:24:45 user nova-compute[75246]: DEBUG nova.network.neutron [req-8b545894-3d21-4270-ac92-4d54f3b845d5 req-70fde647-1c3c-4075-b4b6-4c571e327761 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Refreshing network info cache for port 034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:24:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-8b545894-3d21-4270-ac92-4d54f3b845d5 req-70fde647-1c3c-4075-b4b6-4c571e327761 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Updated VIF entry in instance network info cache for port 034ab47e-b974-4aab-b608-25f52c0fea75. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:24:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-8b545894-3d21-4270-ac92-4d54f3b845d5 req-70fde647-1c3c-4075-b4b6-4c571e327761 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Updating instance_info_cache with network_info: [{"id": "034ab47e-b974-4aab-b608-25f52c0fea75", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034ab47e-b9", "ovs_interfaceid": "034ab47e-b974-4aab-b608-25f52c0fea75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:24:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8b545894-3d21-4270-ac92-4d54f3b845d5 req-70fde647-1c3c-4075-b4b6-4c571e327761 service nova] Releasing lock "refresh_cache-f7c26790-8596-4151-94f3-e5bfa9fb7586" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:24:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:51 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:24:51 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:24:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:24:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:24:52 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:24:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:52 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Updating instance_info_cache with network_info: [{"id": "a311cb50-be83-4bf0-b889-d02170d667d6", "address": "fa:16:3e:65:bd:fb", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa311cb50-be", "ovs_interfaceid": "a311cb50-be83-4bf0-b889-d02170d667d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:24:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:24:52 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:24:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:53 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:24:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:24:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:24:53 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:24:53 user nova-compute[75246]: INFO nova.compute.claims [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Claim successful on node user
Nov 28 17:24:53 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:24:53 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:24:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:24:53 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:24:53 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:24:53 user nova-compute[75246]: DEBUG nova.network.neutron [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:24:53 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:24:53 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:24:53 user nova-compute[75246]: DEBUG nova.policy [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c334f73c5bf1473aadf865c8f032c0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0eebdd39c54a74be8d2e0f9842b165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:24:53 user nova-compute[75246]: INFO nova.virt.block_device [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Booting with volume 8788658b-b207-4323-844b-c81f7bed1ab5 at /dev/vda
Nov 28 17:24:54 user nova-compute[75246]: DEBUG os_brick.utils [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ca9e04-83a0-4ed4-9fff-6b3d36075f50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[547447b1-0e25-4118-bf0a-280a0852ad70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3e429b-1508-48b0-a43a-06eef1586e72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[af52222d-48cb-44d8-9a62-0c24b50d7cdd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:24:54 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:24:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34ac267-e35b-4fc6-a909-d01d996a6ecb]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG os_brick.utils [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Updating existing volume attachment record: 4a7fe0ed-17a4-4bfa-8496-9878e95fa9ec {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG nova.network.neutron [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Successfully created port: 1bafa973-0c18-4a87-98a0-6a1af9588b47 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:24:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:55 user nova-compute[75246]: DEBUG nova.network.neutron [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Successfully updated port: 1bafa973-0c18-4a87-98a0-6a1af9588b47 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:24:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "refresh_cache-bb4a950d-d7c6-4bef-96a3-63fefd512e4b" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:24:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquired lock "refresh_cache-bb4a950d-d7c6-4bef-96a3-63fefd512e4b" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:24:55 user nova-compute[75246]: DEBUG nova.network.neutron [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:24:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-a35eea3d-bb23-4607-abeb-bdc8ca513ee5 req-07592971-c84a-4f43-a0c8-6b6ac42c00e2 service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Received event network-changed-1bafa973-0c18-4a87-98a0-6a1af9588b47 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:24:55 user nova-compute[75246]: DEBUG nova.compute.manager [req-a35eea3d-bb23-4607-abeb-bdc8ca513ee5 req-07592971-c84a-4f43-a0c8-6b6ac42c00e2 service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Refreshing instance network info cache due to event network-changed-1bafa973-0c18-4a87-98a0-6a1af9588b47. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:24:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a35eea3d-bb23-4607-abeb-bdc8ca513ee5 req-07592971-c84a-4f43-a0c8-6b6ac42c00e2 service nova] Acquiring lock "refresh_cache-bb4a950d-d7c6-4bef-96a3-63fefd512e4b" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:24:55 user nova-compute[75246]: DEBUG nova.network.neutron [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:24:55 user nova-compute[75246]: DEBUG nova.network.neutron [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Updating instance_info_cache with network_info: [{"id": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "address": "fa:16:3e:62:8c:11", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bafa973-0c", "ovs_interfaceid": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:24:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Releasing lock "refresh_cache-bb4a950d-d7c6-4bef-96a3-63fefd512e4b" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:24:55 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Instance network_info: |[{"id": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "address": "fa:16:3e:62:8c:11", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bafa973-0c", "ovs_interfaceid": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:24:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a35eea3d-bb23-4607-abeb-bdc8ca513ee5 req-07592971-c84a-4f43-a0c8-6b6ac42c00e2 service nova] Acquired lock "refresh_cache-bb4a950d-d7c6-4bef-96a3-63fefd512e4b" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:24:55 user nova-compute[75246]: DEBUG nova.network.neutron [req-a35eea3d-bb23-4607-abeb-bdc8ca513ee5 req-07592971-c84a-4f43-a0c8-6b6ac42c00e2 service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Refreshing network info cache for port 1bafa973-0c18-4a87-98a0-6a1af9588b47 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:24:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:24:56 user nova-compute[75246]: DEBUG nova.network.neutron [req-a35eea3d-bb23-4607-abeb-bdc8ca513ee5 req-07592971-c84a-4f43-a0c8-6b6ac42c00e2 service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Updated VIF entry in instance network info cache for port 1bafa973-0c18-4a87-98a0-6a1af9588b47. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:24:56 user nova-compute[75246]: DEBUG nova.network.neutron [req-a35eea3d-bb23-4607-abeb-bdc8ca513ee5 req-07592971-c84a-4f43-a0c8-6b6ac42c00e2 service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Updating instance_info_cache with network_info: [{"id": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "address": "fa:16:3e:62:8c:11", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bafa973-0c", "ovs_interfaceid": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:24:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a35eea3d-bb23-4607-abeb-bdc8ca513ee5 req-07592971-c84a-4f43-a0c8-6b6ac42c00e2 service nova] Releasing lock "refresh_cache-bb4a950d-d7c6-4bef-96a3-63fefd512e4b" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:24:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:25:01 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Creating image(s)
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Did not create local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Ensure instance console log exists: /opt/stack/data/nova/instances/bb4a950d-d7c6-4bef-96a3-63fefd512e4b/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Start _get_guest_xml network_info=[{"id": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "address": "fa:16:3e:62:8c:11", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bafa973-0c", "ovs_interfaceid": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '4a7fe0ed-17a4-4bfa-8496-9878e95fa9ec', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQfnsxjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bb4a950d-d7c6-4bef-96a3-63fefd512e4b', 'attached_at': '', 'detached_at': '', 'volume_id': '8788658b-b207-4323-844b-c81f7bed1ab5', 'serial': '8788658b-b207-4323-844b-c81f7bed1ab5'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:25:01 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:25:01 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQfnsxjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:25:01 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:25:01 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:25:01 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e64784-949b-447e-9e69-71244658a36f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:25:01 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[435e5658-af47-4567-9261-2225463bc831]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5] added
Nov 28 17:25:01 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11e3da4-31fa-42f6-889d-d3dd7551bc52]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64a426b-1866-4a40-a704-86eda0b1f86c]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQfnsxjg {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQfnsxjg" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71aed20-8187-4898-835e-b17e822d4402]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pQfnsxjg'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9cd93c-610c-4195-904e-31d76d9cbaad]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f1e586-24aa-48e6-9283-60767e7d7a28]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:25:01 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:25:01 user nova-compute[75246]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)
Nov 28 17:25:01 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:25:01 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:25:01 user nova-compute[75246]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)
Nov 28 17:25:01 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[78191321-7ed3-4687-905d-5f78f088ce24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5, portal: 172.16.0.220,3260]
Nov 28 17:25:01 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5, portal: 172.16.0.220,3260] successful.
Nov 28 17:25:01 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2ba4a4-95e0-4cfe-8ed5-fef334a1a0b6]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[690e5703-a87e-4e4b-9bf3-c87ab95b0f51]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:25:01 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:25:01 user nova-compute[75246]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)
Nov 28 17:25:01 user nova-compute[75246]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)
Nov 28 17:25:01 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:25:01 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:25:01 user nova-compute[75246]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)
Nov 28 17:25:01 user nova-compute[75246]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)
Nov 28 17:25:01 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b0c7e3-75c9-4e8c-aac3-d781dae17b42]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:01 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: None {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQfnsxjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26563333133666261', 'path': '/dev/sde'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563333133666261', 'path': '/dev/sde'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1809681454',display_name='tempest-TestVolumeBootPattern-server-1809681454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1809681454',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrg6dgmwLxM+qOiUQmkZP+lby3sIcjedzAt6Qr2Vg5lrRzmZuOCIGPTCAvsPt68uI6UbSOJN/oyUTe5OqihGAovpc3vgI5qK/6ApsKxZfDXJBHGmnIe3WgtSfAKkR6e4g==',key_name='tempest-TestVolumeBootPattern-1591090964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe0eebdd39c54a74be8d2e0f9842b165',ramdisk_id='',reservation_id='r-jl6dfscf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-389869337',owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:24:54Z,user_data=None,user_id='c334f73c5bf1473aadf865c8f032c0cb',uuid=bb4a950d-d7c6-4bef-96a3-63fefd512e4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "address": "fa:16:3e:62:8c:11", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bafa973-0c", "ovs_interfaceid": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converting VIF {"id": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "address": "fa:16:3e:62:8c:11", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bafa973-0c", "ovs_interfaceid": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:8c:11,bridge_name='br-int',has_traffic_filtering=True,id=1bafa973-0c18-4a87-98a0-6a1af9588b47,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bafa973-0c') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG nova.objects.instance [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lazy-loading 'pci_devices' on Instance uuid bb4a950d-d7c6-4bef-96a3-63fefd512e4b {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:25:02 user nova-compute[75246]:   <uuid>bb4a950d-d7c6-4bef-96a3-63fefd512e4b</uuid>
Nov 28 17:25:02 user nova-compute[75246]:   <name>instance-00000030</name>
Nov 28 17:25:02 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:25:02 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:25:02 user nova-compute[75246]:   <metadata>
Nov 28 17:25:02 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:25:02 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:25:02 user nova-compute[75246]:       <nova:name>tempest-TestVolumeBootPattern-server-1809681454</nova:name>
Nov 28 17:25:02 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:25:01</nova:creationTime>
Nov 28 17:25:02 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:25:02 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:25:02 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:25:02 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:25:02 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:25:02 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:25:02 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:25:02 user nova-compute[75246]:       <nova:owner>
Nov 28 17:25:02 user nova-compute[75246]:         <nova:user uuid="c334f73c5bf1473aadf865c8f032c0cb">tempest-TestVolumeBootPattern-389869337-project-member</nova:user>
Nov 28 17:25:02 user nova-compute[75246]:         <nova:project uuid="fe0eebdd39c54a74be8d2e0f9842b165">tempest-TestVolumeBootPattern-389869337</nova:project>
Nov 28 17:25:02 user nova-compute[75246]:       </nova:owner>
Nov 28 17:25:02 user nova-compute[75246]:       <nova:ports>
Nov 28 17:25:02 user nova-compute[75246]:         <nova:port uuid="1bafa973-0c18-4a87-98a0-6a1af9588b47">
Nov 28 17:25:02 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 17:25:02 user nova-compute[75246]:         </nova:port>
Nov 28 17:25:02 user nova-compute[75246]:       </nova:ports>
Nov 28 17:25:02 user nova-compute[75246]:     </nova:instance>
Nov 28 17:25:02 user nova-compute[75246]:   </metadata>
Nov 28 17:25:02 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:25:02 user nova-compute[75246]:     <system>
Nov 28 17:25:02 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:25:02 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:25:02 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:25:02 user nova-compute[75246]:       <entry name="serial">bb4a950d-d7c6-4bef-96a3-63fefd512e4b</entry>
Nov 28 17:25:02 user nova-compute[75246]:       <entry name="uuid">bb4a950d-d7c6-4bef-96a3-63fefd512e4b</entry>
Nov 28 17:25:02 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:25:02 user nova-compute[75246]:     </system>
Nov 28 17:25:02 user nova-compute[75246]:   </sysinfo>
Nov 28 17:25:02 user nova-compute[75246]:   <os>
Nov 28 17:25:02 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:25:02 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:25:02 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:25:02 user nova-compute[75246]:   </os>
Nov 28 17:25:02 user nova-compute[75246]:   <features>
Nov 28 17:25:02 user nova-compute[75246]:     <acpi/>
Nov 28 17:25:02 user nova-compute[75246]:     <apic/>
Nov 28 17:25:02 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:25:02 user nova-compute[75246]:   </features>
Nov 28 17:25:02 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:25:02 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:25:02 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:25:02 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:25:02 user nova-compute[75246]:   </clock>
Nov 28 17:25:02 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:25:02 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:25:02 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:25:02 user nova-compute[75246]:   </cpu>
Nov 28 17:25:02 user nova-compute[75246]:   <devices>
Nov 28 17:25:02 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:25:02 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:25:02 user nova-compute[75246]:       <source dev="/dev/sde"/>
Nov 28 17:25:02 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:25:02 user nova-compute[75246]:       <serial>8788658b-b207-4323-844b-c81f7bed1ab5</serial>
Nov 28 17:25:02 user nova-compute[75246]:     </disk>
Nov 28 17:25:02 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:25:02 user nova-compute[75246]:       <mac address="fa:16:3e:62:8c:11"/>
Nov 28 17:25:02 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:25:02 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:25:02 user nova-compute[75246]:       <target dev="tap1bafa973-0c"/>
Nov 28 17:25:02 user nova-compute[75246]:     </interface>
Nov 28 17:25:02 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:25:02 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/bb4a950d-d7c6-4bef-96a3-63fefd512e4b/console.log" append="off"/>
Nov 28 17:25:02 user nova-compute[75246]:     </serial>
Nov 28 17:25:02 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:25:02 user nova-compute[75246]:     <video>
Nov 28 17:25:02 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:25:02 user nova-compute[75246]:     </video>
Nov 28 17:25:02 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:25:02 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:25:02 user nova-compute[75246]:     </rng>
Nov 28 17:25:02 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:25:02 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:25:02 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:25:02 user nova-compute[75246]:     </memballoon>
Nov 28 17:25:02 user nova-compute[75246]:   </devices>
Nov 28 17:25:02 user nova-compute[75246]: </domain>
Nov 28 17:25:02 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1809681454',display_name='tempest-TestVolumeBootPattern-server-1809681454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1809681454',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrg6dgmwLxM+qOiUQmkZP+lby3sIcjedzAt6Qr2Vg5lrRzmZuOCIGPTCAvsPt68uI6UbSOJN/oyUTe5OqihGAovpc3vgI5qK/6ApsKxZfDXJBHGmnIe3WgtSfAKkR6e4g==',key_name='tempest-TestVolumeBootPattern-1591090964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe0eebdd39c54a74be8d2e0f9842b165',ramdisk_id='',reservation_id='r-jl6dfscf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-389869337',owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:24:54Z,user_data=None,user_id='c334f73c5bf1473aadf865c8f032c0cb',uuid=bb4a950d-d7c6-4bef-96a3-63fefd512e4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "address": "fa:16:3e:62:8c:11", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bafa973-0c", "ovs_interfaceid": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converting VIF {"id": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "address": "fa:16:3e:62:8c:11", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bafa973-0c", "ovs_interfaceid": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:8c:11,bridge_name='br-int',has_traffic_filtering=True,id=1bafa973-0c18-4a87-98a0-6a1af9588b47,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bafa973-0c') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG os_vif [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:8c:11,bridge_name='br-int',has_traffic_filtering=True,id=1bafa973-0c18-4a87-98a0-6a1af9588b47,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bafa973-0c') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04c8506c-4045-5c3e-bb09-444d1a8ed083', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bafa973-0c, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bafa973-0c, col_values=(('qos', UUID('dac39ace-75f5-41f8-89f3-8ecf19bf71a2')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bafa973-0c, col_values=(('external_ids', {'iface-id': '1bafa973-0c18-4a87-98a0-6a1af9588b47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:8c:11', 'vm-uuid': 'bb4a950d-d7c6-4bef-96a3-63fefd512e4b'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:02 user nova-compute[75246]: INFO os_vif [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:8c:11,bridge_name='br-int',has_traffic_filtering=True,id=1bafa973-0c18-4a87-98a0-6a1af9588b47,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bafa973-0c')
Nov 28 17:25:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:25:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] No VIF found with MAC fa:16:3e:62:8c:11, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:25:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-2c0e618b-f482-4847-a86f-4861439e50a7 req-5a4f6d6d-fb7e-4b6b-a448-4451312e04d3 service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Received event network-vif-plugged-1bafa973-0c18-4a87-98a0-6a1af9588b47 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:25:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2c0e618b-f482-4847-a86f-4861439e50a7 req-5a4f6d6d-fb7e-4b6b-a448-4451312e04d3 service nova] Acquiring lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:25:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2c0e618b-f482-4847-a86f-4861439e50a7 req-5a4f6d6d-fb7e-4b6b-a448-4451312e04d3 service nova] Lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:25:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2c0e618b-f482-4847-a86f-4861439e50a7 req-5a4f6d6d-fb7e-4b6b-a448-4451312e04d3 service nova] Lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:25:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-2c0e618b-f482-4847-a86f-4861439e50a7 req-5a4f6d6d-fb7e-4b6b-a448-4451312e04d3 service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] No waiting events found dispatching network-vif-plugged-1bafa973-0c18-4a87-98a0-6a1af9588b47 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:25:04 user nova-compute[75246]: WARNING nova.compute.manager [req-2c0e618b-f482-4847-a86f-4861439e50a7 req-5a4f6d6d-fb7e-4b6b-a448-4451312e04d3 service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Received unexpected event network-vif-plugged-1bafa973-0c18-4a87-98a0-6a1af9588b47 for instance with vm_state building and task_state spawning.
Nov 28 17:25:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:25:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:25:06 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Instance spawned successfully.
Nov 28 17:25:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:25:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:25:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:25:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:25:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:25:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:25:06 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:25:06 user nova-compute[75246]: INFO nova.compute.manager [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Took 4.91 seconds to spawn the instance on the hypervisor.
Nov 28 17:25:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:25:06 user nova-compute[75246]: INFO nova.compute.manager [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Took 13.02 seconds to build instance.
Nov 28 17:25:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-835a6f6c-1c9f-49d7-94de-b1c112400518 req-57ed475a-6f7d-43d2-8e78-be4135f2764b service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Received event network-vif-plugged-1bafa973-0c18-4a87-98a0-6a1af9588b47 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:25:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-835a6f6c-1c9f-49d7-94de-b1c112400518 req-57ed475a-6f7d-43d2-8e78-be4135f2764b service nova] Acquiring lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:25:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-835a6f6c-1c9f-49d7-94de-b1c112400518 req-57ed475a-6f7d-43d2-8e78-be4135f2764b service nova] Lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:25:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-835a6f6c-1c9f-49d7-94de-b1c112400518 req-57ed475a-6f7d-43d2-8e78-be4135f2764b service nova] Lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:25:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-835a6f6c-1c9f-49d7-94de-b1c112400518 req-57ed475a-6f7d-43d2-8e78-be4135f2764b service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] No waiting events found dispatching network-vif-plugged-1bafa973-0c18-4a87-98a0-6a1af9588b47 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:25:06 user nova-compute[75246]: WARNING nova.compute.manager [req-835a6f6c-1c9f-49d7-94de-b1c112400518 req-57ed475a-6f7d-43d2-8e78-be4135f2764b service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Received unexpected event network-vif-plugged-1bafa973-0c18-4a87-98a0-6a1af9588b47 for instance with vm_state active and task_state None.
Nov 28 17:25:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2103d179-0c54-4db2-af21-1dd571024d32 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.122s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:25:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:25:24 user nova-compute[75246]: INFO nova.compute.manager [None req-fa2ddcfe-461f-47d4-8367-5d21f0d08344 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Unrescuing
Nov 28 17:25:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fa2ddcfe-461f-47d4-8367-5d21f0d08344 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fa2ddcfe-461f-47d4-8367-5d21f0d08344 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquired lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG nova.network.neutron [None req-fa2ddcfe-461f-47d4-8367-5d21f0d08344 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:25:24 user nova-compute[75246]: INFO nova.compute.claims [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Claim successful on node user
Nov 28 17:25:24 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG nova.network.neutron [None req-fa2ddcfe-461f-47d4-8367-5d21f0d08344 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Updating instance_info_cache with network_info: [{"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:25:24 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:25:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-fa2ddcfe-461f-47d4-8367-5d21f0d08344 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Releasing lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG nova.objects.instance [None req-fa2ddcfe-461f-47d4-8367-5d21f0d08344 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lazy-loading 'flavor' on Instance uuid 1a520141-ac59-407a-a525-b3fe402e8cd5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:25:24 user nova-compute[75246]: INFO nova.virt.block_device [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Booting with volume-backed-image 1ef2d77e-6c24-4e9a-ba2a-b6759061c14d at /dev/vda
Nov 28 17:25:24 user nova-compute[75246]: DEBUG nova.policy [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af8b6c3f092547dbbf3debe96c594590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faec5bcef3e2441fba30b593c13d5516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-073d5705-7abb-424b-96b1-a58c059802e5 req-73a9b2ec-c1b7-4217-a6d1-87203ed818e7 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received event network-vif-unplugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:25:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-073d5705-7abb-424b-96b1-a58c059802e5 req-73a9b2ec-c1b7-4217-a6d1-87203ed818e7 service nova] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:25:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-073d5705-7abb-424b-96b1-a58c059802e5 req-73a9b2ec-c1b7-4217-a6d1-87203ed818e7 service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:25:25 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-073d5705-7abb-424b-96b1-a58c059802e5 req-73a9b2ec-c1b7-4217-a6d1-87203ed818e7 service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:25:25 user nova-compute[75246]: DEBUG nova.compute.manager [req-073d5705-7abb-424b-96b1-a58c059802e5 req-73a9b2ec-c1b7-4217-a6d1-87203ed818e7 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] No waiting events found dispatching network-vif-unplugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:25:25 user nova-compute[75246]: WARNING nova.compute.manager [req-073d5705-7abb-424b-96b1-a58c059802e5 req-73a9b2ec-c1b7-4217-a6d1-87203ed818e7 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received unexpected event network-vif-unplugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 for instance with vm_state rescued and task_state unrescuing.
Nov 28 17:25:25 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Instance destroyed successfully.
Nov 28 17:25:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Successfully created port: dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:25:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Successfully updated port: dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:25:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "refresh_cache-aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:25:26 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquired lock "refresh_cache-aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:25:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:25:26 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:25:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:27 user nova-compute[75246]: DEBUG nova.network.neutron [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Updating instance_info_cache with network_info: [{"id": "dc3270f2-afa6-474a-8db6-26146f76efc6", "address": "fa:16:3e:5c:ed:e4", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3270f2-af", "ovs_interfaceid": "dc3270f2-afa6-474a-8db6-26146f76efc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:25:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Releasing lock "refresh_cache-aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:25:27 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Instance network_info: |[{"id": "dc3270f2-afa6-474a-8db6-26146f76efc6", "address": "fa:16:3e:5c:ed:e4", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3270f2-af", "ovs_interfaceid": "dc3270f2-afa6-474a-8db6-26146f76efc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:25:27 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received event network-changed-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:25:27 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Refreshing instance network info cache due to event network-changed-82c2968b-a7ec-41d6-924f-25ce67ec14b1. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:25:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] Acquiring lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:25:27 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] Acquired lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:25:27 user nova-compute[75246]: DEBUG nova.network.neutron [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Refreshing network info cache for port 82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:25:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:28 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:28 user nova-compute[75246]: DEBUG nova.network.neutron [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Updated VIF entry in instance network info cache for port 82c2968b-a7ec-41d6-924f-25ce67ec14b1. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:25:28 user nova-compute[75246]: DEBUG nova.network.neutron [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Updating instance_info_cache with network_info: [{"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:25:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] Releasing lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:25:28 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received event network-changed-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:25:28 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Refreshing instance network info cache due to event network-changed-82c2968b-a7ec-41d6-924f-25ce67ec14b1. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:25:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] Acquiring lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:25:28 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] Acquired lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:25:28 user nova-compute[75246]: DEBUG nova.network.neutron [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Refreshing network info cache for port 82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG nova.network.neutron [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Updated VIF entry in instance network info cache for port 82c2968b-a7ec-41d6-924f-25ce67ec14b1. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG nova.network.neutron [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Updating instance_info_cache with network_info: [{"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] Releasing lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received event network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] No waiting events found dispatching network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:25:29 user nova-compute[75246]: WARNING nova.compute.manager [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received unexpected event network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 for instance with vm_state rescued and task_state unrescuing.
Nov 28 17:25:29 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received event network-changed-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Refreshing instance network info cache due to event network-changed-dc3270f2-afa6-474a-8db6-26146f76efc6. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] Acquiring lock "refresh_cache-aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] Acquired lock "refresh_cache-aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG nova.network.neutron [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Refreshing network info cache for port dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG nova.network.neutron [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Updated VIF entry in instance network info cache for port dc3270f2-afa6-474a-8db6-26146f76efc6. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG nova.network.neutron [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Updating instance_info_cache with network_info: [{"id": "dc3270f2-afa6-474a-8db6-26146f76efc6", "address": "fa:16:3e:5c:ed:e4", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3270f2-af", "ovs_interfaceid": "dc3270f2-afa6-474a-8db6-26146f76efc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] Releasing lock "refresh_cache-aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received event network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG nova.compute.manager [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] No waiting events found dispatching network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:25:29 user nova-compute[75246]: WARNING nova.compute.manager [req-f3016738-be32-46a2-9749-58ecf50b6d6b req-65744a60-5fb2-4213-87b8-c86d2651afb2 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received unexpected event network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 for instance with vm_state rescued and task_state unrescuing.
Nov 28 17:25:29 user nova-compute[75246]: DEBUG nova.compute.manager [req-616da3e0-96e3-4815-a6c2-16a3a0682d97 req-8907a514-a683-47cb-87bd-a46c988a8f29 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received event network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-616da3e0-96e3-4815-a6c2-16a3a0682d97 req-8907a514-a683-47cb-87bd-a46c988a8f29 service nova] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-616da3e0-96e3-4815-a6c2-16a3a0682d97 req-8907a514-a683-47cb-87bd-a46c988a8f29 service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-616da3e0-96e3-4815-a6c2-16a3a0682d97 req-8907a514-a683-47cb-87bd-a46c988a8f29 service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:25:29 user nova-compute[75246]: DEBUG nova.compute.manager [req-616da3e0-96e3-4815-a6c2-16a3a0682d97 req-8907a514-a683-47cb-87bd-a46c988a8f29 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] No waiting events found dispatching network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:25:29 user nova-compute[75246]: WARNING nova.compute.manager [req-616da3e0-96e3-4815-a6c2-16a3a0682d97 req-8907a514-a683-47cb-87bd-a46c988a8f29 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received unexpected event network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 for instance with vm_state rescued and task_state unrescuing.
Nov 28 17:25:30 user nova-compute[75246]: DEBUG nova.compute.manager [None req-fa2ddcfe-461f-47d4-8367-5d21f0d08344 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:25:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:33 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:25:33 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 17:25:34 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] There are 0 instances to clean {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 17:25:36 user nova-compute[75246]: DEBUG os_brick.utils [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:25:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.086s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b423acdd-9d05-4141-80f4-421ec3000373]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[73309832-7320-42ae-85f6-e4395545d4f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1fcd22-bebc-48cb-85e9-2fa6228211df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa66e957-a04a-4d1e-8e16-e82f2f0ebb68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:25:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:25:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:25:36 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:25:37 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc76d2ab-8481-49b5-adc5-c9f6d723fa62]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:25:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:25:37 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:25:37 user nova-compute[75246]: DEBUG os_brick.utils [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] <== get_connector_properties: return (232ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:25:37 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Updating existing volume attachment record: 275dc3d9-ffde-4834-9272-ae5a6d208cf4 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:25:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:40 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:25:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:25:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:25:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:25:40 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:25:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:25:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:25:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:25:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:25:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:42 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:25:42 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:25:42 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8184MB free_disk=23.940296173095703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:25:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:25:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:25:42 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:25:42 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a796152e-e8df-41bf-a5ea-ae94d4fa8b41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:25:42 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 1a520141-ac59-407a-a525-b3fe402e8cd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:25:42 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance ae257aa8-78c3-499e-a5cf-1021deefe6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:25:42 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance f7c26790-8596-4151-94f3-e5bfa9fb7586 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:25:42 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 22705851-8092-4be3-ab20-3712b62e40f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:25:42 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance bb4a950d-d7c6-4bef-96a3-63fefd512e4b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:25:42 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance aa6b050c-ffd6-4a40-ab64-59f7ae8bef78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:25:42 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:25:42 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:25:42 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing inventories for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 17:25:42 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating ProviderTree inventory for provider 241ad926-9deb-44ba-a618-a49e4ac21089 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 17:25:42 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating inventory in ProviderTree for provider 241ad926-9deb-44ba-a618-a49e4ac21089 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 17:25:42 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing aggregate associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, aggregates: None {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 17:25:42 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing trait associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 17:25:43 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:25:43 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:43 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:25:43 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:25:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.780s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:25:43 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:25:43 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:25:43 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:25:43 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:25:43 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:25:43 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:25:45 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Creating image(s)
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Did not create local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Ensure instance console log exists: /opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Start _get_guest_xml network_info=[{"id": "dc3270f2-afa6-474a-8db6-26146f76efc6", "address": "fa:16:3e:5c:ed:e4", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3270f2-af", "ovs_interfaceid": "dc3270f2-afa6-474a-8db6-26146f76efc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '275dc3d9-ffde-4834-9272-ae5a6d208cf4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yvAsZloz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa6b050c-ffd6-4a40-ab64-59f7ae8bef78', 'attached_at': '', 'detached_at': '', 'volume_id': '168870a5-6858-4a8f-82ea-514b95a8b19f', 'serial': '168870a5-6858-4a8f-82ea-514b95a8b19f'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:25:45 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:25:45 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yvAsZloz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:25:45 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:25:45 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:25:45 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aeec22-08af-4941-a886-c19dcbf75af6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:25:45 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f44afd-03ab-4cce-ba4e-0fb4560ade8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f] added
Nov 28 17:25:45 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e9647c-c74d-4346-89db-8bfa97703550]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9403ed93-2e42-4cc9-831b-726a7c4fbd67]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yvAsZloz {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yvAsZloz" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3554f2-e1ea-417f-b163-b0fc5a4df0f9]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yvAsZloz'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc9ed8e-d031-490b-9da5-d86ede57c6c3]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.143s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3cec07-b8cf-4753-b225-a7e3c160688d]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:25:45 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:25:45 user nova-compute[75246]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)
Nov 28 17:25:45 user nova-compute[75246]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)
Nov 28 17:25:45 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:25:45 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:25:45 user nova-compute[75246]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)
Nov 28 17:25:45 user nova-compute[75246]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)
Nov 28 17:25:45 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d012ff86-c414-43f4-a568-05ad94c4b0ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f, portal: 172.16.0.220,3260]
Nov 28 17:25:45 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f, portal: 172.16.0.220,3260] successful.
Nov 28 17:25:45 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[40498ee5-6dc9-45a8-b1e8-f8f833e597dc]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82fed35-03c4-46fe-83a4-546e78454a26]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:25:45 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:25:45 user nova-compute[75246]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)
Nov 28 17:25:45 user nova-compute[75246]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)
Nov 28 17:25:45 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:25:45 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:25:45 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:25:45 user nova-compute[75246]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)
Nov 28 17:25:45 user nova-compute[75246]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)
Nov 28 17:25:45 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:25:45 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.423s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] HCTL ('37', '-', '-', 0) found on session 53 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[835bcc4d-8e1e-4f3f-97ee-c1ea111eab6e]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Searching for a device in session 53 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yvAsZloz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:25:45 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.466s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] <== connect_volume: return (1468ms) {'type': 'block', 'scsi_wwn': '23866313338373837', 'path': '/dev/sdf'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866313338373837', 'path': '/dev/sdf'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:25:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-464990600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-464990600',id=49,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faec5bcef3e2441fba30b593c13d5516',ramdisk_id='',reservation_id='r-ot3xyjx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-506006079',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:25:25Z,user_data=None,user_id='af8b6c3f092547dbbf3debe96c594590',uuid=aa6b050c-ffd6-4a40-ab64-59f7ae8bef78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc3270f2-afa6-474a-8db6-26146f76efc6", "address": "fa:16:3e:5c:ed:e4", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3270f2-af", "ovs_interfaceid": "dc3270f2-afa6-474a-8db6-26146f76efc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converting VIF {"id": "dc3270f2-afa6-474a-8db6-26146f76efc6", "address": "fa:16:3e:5c:ed:e4", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3270f2-af", "ovs_interfaceid": "dc3270f2-afa6-474a-8db6-26146f76efc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ed:e4,bridge_name='br-int',has_traffic_filtering=True,id=dc3270f2-afa6-474a-8db6-26146f76efc6,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3270f2-af') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG nova.objects.instance [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'pci_devices' on Instance uuid aa6b050c-ffd6-4a40-ab64-59f7ae8bef78 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:25:46 user nova-compute[75246]:   <uuid>aa6b050c-ffd6-4a40-ab64-59f7ae8bef78</uuid>
Nov 28 17:25:46 user nova-compute[75246]:   <name>instance-00000031</name>
Nov 28 17:25:46 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:25:46 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:25:46 user nova-compute[75246]:   <metadata>
Nov 28 17:25:46 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:25:46 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:25:46 user nova-compute[75246]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-464990600</nova:name>
Nov 28 17:25:46 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:25:45</nova:creationTime>
Nov 28 17:25:46 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:25:46 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:25:46 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:25:46 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:25:46 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:25:46 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:25:46 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:25:46 user nova-compute[75246]:       <nova:owner>
Nov 28 17:25:46 user nova-compute[75246]:         <nova:user uuid="af8b6c3f092547dbbf3debe96c594590">tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member</nova:user>
Nov 28 17:25:46 user nova-compute[75246]:         <nova:project uuid="faec5bcef3e2441fba30b593c13d5516">tempest-ServerBootFromVolumeStableRescueTest-506006079</nova:project>
Nov 28 17:25:46 user nova-compute[75246]:       </nova:owner>
Nov 28 17:25:46 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:25:46 user nova-compute[75246]:       <nova:ports>
Nov 28 17:25:46 user nova-compute[75246]:         <nova:port uuid="dc3270f2-afa6-474a-8db6-26146f76efc6">
Nov 28 17:25:46 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 17:25:46 user nova-compute[75246]:         </nova:port>
Nov 28 17:25:46 user nova-compute[75246]:       </nova:ports>
Nov 28 17:25:46 user nova-compute[75246]:     </nova:instance>
Nov 28 17:25:46 user nova-compute[75246]:   </metadata>
Nov 28 17:25:46 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:25:46 user nova-compute[75246]:     <system>
Nov 28 17:25:46 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:25:46 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:25:46 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:25:46 user nova-compute[75246]:       <entry name="serial">aa6b050c-ffd6-4a40-ab64-59f7ae8bef78</entry>
Nov 28 17:25:46 user nova-compute[75246]:       <entry name="uuid">aa6b050c-ffd6-4a40-ab64-59f7ae8bef78</entry>
Nov 28 17:25:46 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:25:46 user nova-compute[75246]:     </system>
Nov 28 17:25:46 user nova-compute[75246]:   </sysinfo>
Nov 28 17:25:46 user nova-compute[75246]:   <os>
Nov 28 17:25:46 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:25:46 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:25:46 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:25:46 user nova-compute[75246]:   </os>
Nov 28 17:25:46 user nova-compute[75246]:   <features>
Nov 28 17:25:46 user nova-compute[75246]:     <acpi/>
Nov 28 17:25:46 user nova-compute[75246]:     <apic/>
Nov 28 17:25:46 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:25:46 user nova-compute[75246]:   </features>
Nov 28 17:25:46 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:25:46 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:25:46 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:25:46 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:25:46 user nova-compute[75246]:   </clock>
Nov 28 17:25:46 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:25:46 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:25:46 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:25:46 user nova-compute[75246]:   </cpu>
Nov 28 17:25:46 user nova-compute[75246]:   <devices>
Nov 28 17:25:46 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:25:46 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:25:46 user nova-compute[75246]:       <source dev="/dev/sdf"/>
Nov 28 17:25:46 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:25:46 user nova-compute[75246]:       <serial>168870a5-6858-4a8f-82ea-514b95a8b19f</serial>
Nov 28 17:25:46 user nova-compute[75246]:     </disk>
Nov 28 17:25:46 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:25:46 user nova-compute[75246]:       <mac address="fa:16:3e:5c:ed:e4"/>
Nov 28 17:25:46 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:25:46 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:25:46 user nova-compute[75246]:       <target dev="tapdc3270f2-af"/>
Nov 28 17:25:46 user nova-compute[75246]:     </interface>
Nov 28 17:25:46 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:25:46 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78/console.log" append="off"/>
Nov 28 17:25:46 user nova-compute[75246]:     </serial>
Nov 28 17:25:46 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:25:46 user nova-compute[75246]:     <video>
Nov 28 17:25:46 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:25:46 user nova-compute[75246]:     </video>
Nov 28 17:25:46 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:25:46 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:25:46 user nova-compute[75246]:     </rng>
Nov 28 17:25:46 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:25:46 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:25:46 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:25:46 user nova-compute[75246]:     </memballoon>
Nov 28 17:25:46 user nova-compute[75246]:   </devices>
Nov 28 17:25:46 user nova-compute[75246]: </domain>
Nov 28 17:25:46 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:25:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-464990600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-464990600',id=49,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faec5bcef3e2441fba30b593c13d5516',ramdisk_id='',reservation_id='r-ot3xyjx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-506006079',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:25:25Z,user_data=None,user_id='af8b6c3f092547dbbf3debe96c594590',uuid=aa6b050c-ffd6-4a40-ab64-59f7ae8bef78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc3270f2-afa6-474a-8db6-26146f76efc6", "address": "fa:16:3e:5c:ed:e4", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3270f2-af", "ovs_interfaceid": "dc3270f2-afa6-474a-8db6-26146f76efc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converting VIF {"id": "dc3270f2-afa6-474a-8db6-26146f76efc6", "address": "fa:16:3e:5c:ed:e4", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3270f2-af", "ovs_interfaceid": "dc3270f2-afa6-474a-8db6-26146f76efc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ed:e4,bridge_name='br-int',has_traffic_filtering=True,id=dc3270f2-afa6-474a-8db6-26146f76efc6,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3270f2-af') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG os_vif [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ed:e4,bridge_name='br-int',has_traffic_filtering=True,id=dc3270f2-afa6-474a-8db6-26146f76efc6,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3270f2-af') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e833b2e-a6c6-5233-ab61-67b57dc18dc1', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc3270f2-af, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc3270f2-af, col_values=(('qos', UUID('2102f844-c32d-4e9a-a489-4453b6bf3b49')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc3270f2-af, col_values=(('external_ids', {'iface-id': 'dc3270f2-afa6-474a-8db6-26146f76efc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:ed:e4', 'vm-uuid': 'aa6b050c-ffd6-4a40-ab64-59f7ae8bef78'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:46 user nova-compute[75246]: INFO os_vif [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ed:e4,bridge_name='br-int',has_traffic_filtering=True,id=dc3270f2-afa6-474a-8db6-26146f76efc6,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3270f2-af')
Nov 28 17:25:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] No VIF found with MAC fa:16:3e:5c:ed:e4, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:25:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:48 user nova-compute[75246]: DEBUG nova.compute.manager [req-d7fee9c4-3fe0-4a48-8942-559486cbb72f req-8aa5c44a-714c-423b-9482-a6a76345aaf9 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received event network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:25:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d7fee9c4-3fe0-4a48-8942-559486cbb72f req-8aa5c44a-714c-423b-9482-a6a76345aaf9 service nova] Acquiring lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:25:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d7fee9c4-3fe0-4a48-8942-559486cbb72f req-8aa5c44a-714c-423b-9482-a6a76345aaf9 service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:25:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d7fee9c4-3fe0-4a48-8942-559486cbb72f req-8aa5c44a-714c-423b-9482-a6a76345aaf9 service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:25:48 user nova-compute[75246]: DEBUG nova.compute.manager [req-d7fee9c4-3fe0-4a48-8942-559486cbb72f req-8aa5c44a-714c-423b-9482-a6a76345aaf9 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] No waiting events found dispatching network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:25:48 user nova-compute[75246]: WARNING nova.compute.manager [req-d7fee9c4-3fe0-4a48-8942-559486cbb72f req-8aa5c44a-714c-423b-9482-a6a76345aaf9 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received unexpected event network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 for instance with vm_state building and task_state spawning.
Nov 28 17:25:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:50 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:25:50 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:25:50 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Instance spawned successfully.
Nov 28 17:25:50 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:25:50 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:25:50 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:25:50 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:25:50 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:25:50 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:25:50 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:25:50 user nova-compute[75246]: DEBUG nova.compute.manager [req-64917c05-8e1b-4d50-a09a-5a303be4c677 req-a72b508a-58e4-4932-9b34-b95a6b70b119 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received event network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:25:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-64917c05-8e1b-4d50-a09a-5a303be4c677 req-a72b508a-58e4-4932-9b34-b95a6b70b119 service nova] Acquiring lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:25:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-64917c05-8e1b-4d50-a09a-5a303be4c677 req-a72b508a-58e4-4932-9b34-b95a6b70b119 service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:25:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-64917c05-8e1b-4d50-a09a-5a303be4c677 req-a72b508a-58e4-4932-9b34-b95a6b70b119 service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:25:50 user nova-compute[75246]: DEBUG nova.compute.manager [req-64917c05-8e1b-4d50-a09a-5a303be4c677 req-a72b508a-58e4-4932-9b34-b95a6b70b119 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] No waiting events found dispatching network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:25:50 user nova-compute[75246]: WARNING nova.compute.manager [req-64917c05-8e1b-4d50-a09a-5a303be4c677 req-a72b508a-58e4-4932-9b34-b95a6b70b119 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received unexpected event network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 for instance with vm_state building and task_state spawning.
Nov 28 17:25:50 user nova-compute[75246]: INFO nova.compute.manager [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 28 17:25:50 user nova-compute[75246]: DEBUG nova.compute.manager [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:25:50 user nova-compute[75246]: INFO nova.compute.manager [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Took 26.15 seconds to build instance.
Nov 28 17:25:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-9aad94ce-f58d-4fad-b224-cc59488e3172 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.269s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:25:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:51 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:25:52 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:25:52 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:25:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:25:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:25:53 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:25:53 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Updating instance_info_cache with network_info: [{"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:25:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-1a520141-ac59-407a-a525-b3fe402e8cd5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:25:53 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:25:54 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:25:54 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75246) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 17:25:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:25:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:25:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:25:57 user nova-compute[75246]: INFO nova.compute.manager [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Detaching volume 9404eaad-09b5-4b76-9f67-c6595d033899
Nov 28 17:25:57 user nova-compute[75246]: INFO nova.virt.block_device [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Attempting to driver detach volume 9404eaad-09b5-4b76-9f67-c6595d033899 from mountpoint /dev/vdb
Nov 28 17:25:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Attempting to detach device vdb from instance 1a520141-ac59-407a-a525-b3fe402e8cd5 from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:25:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:25:57 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:25:57 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:25:57 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:25:57 user nova-compute[75246]:   <serial>9404eaad-09b5-4b76-9f67-c6595d033899</serial>
Nov 28 17:25:57 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:25:57 user nova-compute[75246]: </disk>
Nov 28 17:25:57 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:25:57 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Successfully detached device vdb from instance 1a520141-ac59-407a-a525-b3fe402e8cd5 from the persistent domain config.
Nov 28 17:25:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1a520141-ac59-407a-a525-b3fe402e8cd5 from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:25:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:25:57 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:25:57 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:25:57 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:25:57 user nova-compute[75246]:   <serial>9404eaad-09b5-4b76-9f67-c6595d033899</serial>
Nov 28 17:25:57 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:25:57 user nova-compute[75246]: </disk>
Nov 28 17:25:57 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:25:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1a520141-ac59-407a-a525-b3fe402e8cd5 {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:26:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:26:18 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1a520141-ac59-407a-a525-b3fe402e8cd5 is timed out.
Nov 28 17:26:18 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Successfully detached device vdb from instance 1a520141-ac59-407a-a525-b3fe402e8cd5 from the live domain config.
Nov 28 17:26:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AELFzyTq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:26:18 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c399a2b4-f1d2-46cf-88d4-663439dfb9e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:26:18 user nova-compute[75246]: No targets found.
Nov 28 17:26:18 user nova-compute[75246]: iSNS:
Nov 28 17:26:18 user nova-compute[75246]: No targets found.
Nov 28 17:26:18 user nova-compute[75246]: STATIC:
Nov 28 17:26:18 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5
Nov 28 17:26:18 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:26:18 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:26:18 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75
Nov 28 17:26:18 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:26:18 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:26:18 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899
Nov 28 17:26:18 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:26:18 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:26:18 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f
Nov 28 17:26:18 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:26:18 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:26:18 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:26:18 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:26:18 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:26:18 user nova-compute[75246]: FIRMWARE:
Nov 28 17:26:18 user nova-compute[75246]: No targets found.
Nov 28 17:26:18 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:26:18 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:26:18 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58e8fe0-82ce-45ae-92be-9eff8601b9e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[312f214b-e0e8-459a-b27d-988806767edc]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:26:18 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:26:18 user nova-compute[75246]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)
Nov 28 17:26:18 user nova-compute[75246]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)
Nov 28 17:26:18 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:26:18 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:26:18 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:26:18 user nova-compute[75246]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 (non-flash)
Nov 28 17:26:18 user nova-compute[75246]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)
Nov 28 17:26:18 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:26:18 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d816c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899'): ({'sdc'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Removing single pathed devices sdc {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[580e712c-5748-4c54-a865-a4e80d0f6e53]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d92205-1a77-421f-9b43-f481482313c4]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Flushing IO for device /dev/sdc {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb6c059-4dab-43af-9653-ec52e7884ec8]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f20072-48d8-45ab-8a16-317c942230c2]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df0a42c-10c6-48fa-9cb4-93123d493f3b]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cd287a-bdd6-4713-b2f4-1c4cf03bfbba]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899, portal: 172.16.0.220,3260]
Nov 28 17:26:18 user nova-compute[75246]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899, portal: 172.16.0.220,3260] successful.
Nov 28 17:26:18 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9404eaad-09b5-4b76-9f67-c6595d033899 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2182efb-546b-4002-a269-7df06fb8db87]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] <== disconnect_volume: return (377ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:26:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:26:19 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lazy-loading 'flavor' on Instance uuid 1a520141-ac59-407a-a525-b3fe402e8cd5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:26:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3355b78e-5f4e-4e3e-8ea4-8eda96217912 tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.762s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:26:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-423696bd-b763-440a-b917-f018c4aaa9d2 req-e224cf07-05f4-420f-b859-77574e4064f3 service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received event network-changed-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:26:23 user nova-compute[75246]: DEBUG nova.compute.manager [req-423696bd-b763-440a-b917-f018c4aaa9d2 req-e224cf07-05f4-420f-b859-77574e4064f3 service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Refreshing instance network info cache due to event network-changed-7166f3eb-0624-4f3a-85e1-db89b444907d. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:26:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-423696bd-b763-440a-b917-f018c4aaa9d2 req-e224cf07-05f4-420f-b859-77574e4064f3 service nova] Acquiring lock "refresh_cache-22705851-8092-4be3-ab20-3712b62e40f5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:26:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-423696bd-b763-440a-b917-f018c4aaa9d2 req-e224cf07-05f4-420f-b859-77574e4064f3 service nova] Acquired lock "refresh_cache-22705851-8092-4be3-ab20-3712b62e40f5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:26:23 user nova-compute[75246]: DEBUG nova.network.neutron [req-423696bd-b763-440a-b917-f018c4aaa9d2 req-e224cf07-05f4-420f-b859-77574e4064f3 service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Refreshing network info cache for port 7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:26:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "22705851-8092-4be3-ab20-3712b62e40f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "22705851-8092-4be3-ab20-3712b62e40f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:23 user nova-compute[75246]: DEBUG nova.objects.instance [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lazy-loading 'flavor' on Instance uuid 22705851-8092-4be3-ab20-3712b62e40f5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:26:23 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Ignoring supplied device name: /dev/vdb
Nov 28 17:26:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "22705851-8092-4be3-ab20-3712b62e40f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "22705851-8092-4be3-ab20-3712b62e40f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:23 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "22705851-8092-4be3-ab20-3712b62e40f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:23 user nova-compute[75246]: INFO nova.compute.manager [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Attaching volume 881b569a-8d54-4f38-9fc2-2a59c93eaa8a to /dev/vdb
Nov 28 17:26:24 user nova-compute[75246]: DEBUG nova.network.neutron [req-423696bd-b763-440a-b917-f018c4aaa9d2 req-e224cf07-05f4-420f-b859-77574e4064f3 service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Updated VIF entry in instance network info cache for port 7166f3eb-0624-4f3a-85e1-db89b444907d. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG nova.network.neutron [req-423696bd-b763-440a-b917-f018c4aaa9d2 req-e224cf07-05f4-420f-b859-77574e4064f3 service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Updating instance_info_cache with network_info: [{"id": "7166f3eb-0624-4f3a-85e1-db89b444907d", "address": "fa:16:3e:7b:81:81", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7166f3eb-06", "ovs_interfaceid": "7166f3eb-0624-4f3a-85e1-db89b444907d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG os_brick.utils [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4198db-4000-4187-861f-acb7f6379702]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-423696bd-b763-440a-b917-f018c4aaa9d2 req-e224cf07-05f4-420f-b859-77574e4064f3 service nova] Releasing lock "refresh_cache-22705851-8092-4be3-ab20-3712b62e40f5" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cd43e7-fddb-404b-9a3b-3bf7eff6f154]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[221a6b61-4973-4ce1-bd29-90160b2f0d6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db63327-ca39-4a33-9640-af97f3298b58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:26:24 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:26:24 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0469b4-5715-4d0f-8414-1a4a8ebacf80]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG os_brick.utils [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:26:24 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Updating existing volume attachment record: 286b671c-293a-48b7-b8bf-3e58cb399d8c {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:26:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dHsmPiAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:26:31 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:26:31 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:26:31 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0c0190-ac9f-4f68-ac7c-72c96934686b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:26:31 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[238e457d-5b09-4d1b-b3c6-c416a92a5f90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a] added
Nov 28 17:26:31 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9fd0c4-7467-4b27-b915-7aee46e23407]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[61111d02-ad53-4bfd-bb93-fd1a8d6aa4c8]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dHsmPiAh {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dHsmPiAh" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49f43e3-d39a-4ce4-9637-2752556c6189]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dHsmPiAh'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f00609-3c1d-4061-b0c5-783bb3df3e75]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc339017-aeea-4ca8-94ea-771caa76b15d]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:26:31 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:26:31 user nova-compute[75246]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)
Nov 28 17:26:31 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:26:31 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:26:31 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:26:31 user nova-compute[75246]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)
Nov 28 17:26:31 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:26:31 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ece2d12-f5ef-4282-8a06-b88c98c26298]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a, portal: 172.16.0.220,3260]
Nov 28 17:26:31 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a, portal: 172.16.0.220,3260] successful.
Nov 28 17:26:31 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac47d5b-c820-473e-9c50-8816dfc023d8]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[271e18cd-ddae-4175-9376-e65a9565a24a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:26:31 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:26:31 user nova-compute[75246]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)
Nov 28 17:26:31 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:26:31 user nova-compute[75246]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a (non-flash)
Nov 28 17:26:31 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:26:31 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:26:31 user nova-compute[75246]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)
Nov 28 17:26:31 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:26:31 user nova-compute[75246]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a (non-flash)
Nov 28 17:26:31 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b6b493-5ced-49fe-9e0a-388fbb35d2d9]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:26:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:32 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:26:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dHsmPiAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:26:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:26:32 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26535613339666436', 'path': '/dev/sdc'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:26:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535613339666436', 'path': '/dev/sdc'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:26:32 user nova-compute[75246]: DEBUG nova.objects.instance [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lazy-loading 'flavor' on Instance uuid 22705851-8092-4be3-ab20-3712b62e40f5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:26:32 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:26:32 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:26:32 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:26:32 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:26:32 user nova-compute[75246]:   <serial>881b569a-8d54-4f38-9fc2-2a59c93eaa8a</serial>
Nov 28 17:26:32 user nova-compute[75246]: </disk>
Nov 28 17:26:32 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:26:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:26:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:26:33 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] No VIF found with MAC fa:16:3e:7b:81:81, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:26:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-ebeb7f33-7b85-4074-9666-4d62a274c0b6 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "22705851-8092-4be3-ab20-3712b62e40f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.337s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:26:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:26:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:26:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:26:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:26:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:44 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:26:44 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:26:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8104MB free_disk=24.93747329711914GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:26:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:26:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a796152e-e8df-41bf-a5ea-ae94d4fa8b41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:26:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 1a520141-ac59-407a-a525-b3fe402e8cd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:26:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance ae257aa8-78c3-499e-a5cf-1021deefe6d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:26:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance f7c26790-8596-4151-94f3-e5bfa9fb7586 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:26:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 22705851-8092-4be3-ab20-3712b62e40f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:26:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance bb4a950d-d7c6-4bef-96a3-63fefd512e4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:26:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance aa6b050c-ffd6-4a40-ab64-59f7ae8bef78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:26:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:26:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:26:44 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:26:44 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:26:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:26:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:45 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:26:45 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:26:45 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:26:45 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:26:45 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:26:45 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-06fc5f16-b876-431d-a0c0-e75c2d97c576 req-e11dbcfc-e567-4856-b71c-9b6acd6be6fc service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Received event network-changed-1bafa973-0c18-4a87-98a0-6a1af9588b47 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-06fc5f16-b876-431d-a0c0-e75c2d97c576 req-e11dbcfc-e567-4856-b71c-9b6acd6be6fc service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Refreshing instance network info cache due to event network-changed-1bafa973-0c18-4a87-98a0-6a1af9588b47. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-06fc5f16-b876-431d-a0c0-e75c2d97c576 req-e11dbcfc-e567-4856-b71c-9b6acd6be6fc service nova] Acquiring lock "refresh_cache-bb4a950d-d7c6-4bef-96a3-63fefd512e4b" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-06fc5f16-b876-431d-a0c0-e75c2d97c576 req-e11dbcfc-e567-4856-b71c-9b6acd6be6fc service nova] Acquired lock "refresh_cache-bb4a950d-d7c6-4bef-96a3-63fefd512e4b" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-06fc5f16-b876-431d-a0c0-e75c2d97c576 req-e11dbcfc-e567-4856-b71c-9b6acd6be6fc service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Refreshing network info cache for port 1bafa973-0c18-4a87-98a0-6a1af9588b47 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-06fc5f16-b876-431d-a0c0-e75c2d97c576 req-e11dbcfc-e567-4856-b71c-9b6acd6be6fc service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Updated VIF entry in instance network info cache for port 1bafa973-0c18-4a87-98a0-6a1af9588b47. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-06fc5f16-b876-431d-a0c0-e75c2d97c576 req-e11dbcfc-e567-4856-b71c-9b6acd6be6fc service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Updating instance_info_cache with network_info: [{"id": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "address": "fa:16:3e:62:8c:11", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bafa973-0c", "ovs_interfaceid": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-06fc5f16-b876-431d-a0c0-e75c2d97c576 req-e11dbcfc-e567-4856-b71c-9b6acd6be6fc service nova] Releasing lock "refresh_cache-bb4a950d-d7c6-4bef-96a3-63fefd512e4b" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-9c0b90f7-8a3f-4bb3-8265-8aac879b3b0e req-4ead2bf1-e8cc-49d6-8489-d28f6651ace0 service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Received event network-changed-1bafa973-0c18-4a87-98a0-6a1af9588b47 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-9c0b90f7-8a3f-4bb3-8265-8aac879b3b0e req-4ead2bf1-e8cc-49d6-8489-d28f6651ace0 service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Refreshing instance network info cache due to event network-changed-1bafa973-0c18-4a87-98a0-6a1af9588b47. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9c0b90f7-8a3f-4bb3-8265-8aac879b3b0e req-4ead2bf1-e8cc-49d6-8489-d28f6651ace0 service nova] Acquiring lock "refresh_cache-bb4a950d-d7c6-4bef-96a3-63fefd512e4b" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9c0b90f7-8a3f-4bb3-8265-8aac879b3b0e req-4ead2bf1-e8cc-49d6-8489-d28f6651ace0 service nova] Acquired lock "refresh_cache-bb4a950d-d7c6-4bef-96a3-63fefd512e4b" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG nova.network.neutron [req-9c0b90f7-8a3f-4bb3-8265-8aac879b3b0e req-4ead2bf1-e8cc-49d6-8489-d28f6651ace0 service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Refreshing network info cache for port 1bafa973-0c18-4a87-98a0-6a1af9588b47 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:46 user nova-compute[75246]: INFO nova.compute.manager [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Terminating instance
Nov 28 17:26:46 user nova-compute[75246]: DEBUG nova.compute.manager [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:26:46 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG nova.compute.manager [req-0c0401c6-a1b1-48a1-a711-8cc2f6888237 req-57e7d2f0-ca94-415e-8127-254e0e2e55dd service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Received event network-vif-unplugged-1bafa973-0c18-4a87-98a0-6a1af9588b47 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0c0401c6-a1b1-48a1-a711-8cc2f6888237 req-57e7d2f0-ca94-415e-8127-254e0e2e55dd service nova] Acquiring lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0c0401c6-a1b1-48a1-a711-8cc2f6888237 req-57e7d2f0-ca94-415e-8127-254e0e2e55dd service nova] Lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0c0401c6-a1b1-48a1-a711-8cc2f6888237 req-57e7d2f0-ca94-415e-8127-254e0e2e55dd service nova] Lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG nova.compute.manager [req-0c0401c6-a1b1-48a1-a711-8cc2f6888237 req-57e7d2f0-ca94-415e-8127-254e0e2e55dd service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] No waiting events found dispatching network-vif-unplugged-1bafa973-0c18-4a87-98a0-6a1af9588b47 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG nova.compute.manager [req-0c0401c6-a1b1-48a1-a711-8cc2f6888237 req-57e7d2f0-ca94-415e-8127-254e0e2e55dd service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Received event network-vif-unplugged-1bafa973-0c18-4a87-98a0-6a1af9588b47 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:26:47 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Instance destroyed successfully.
Nov 28 17:26:47 user nova-compute[75246]: DEBUG nova.objects.instance [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lazy-loading 'resources' on Instance uuid bb4a950d-d7c6-4bef-96a3-63fefd512e4b {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1809681454',display_name='tempest-TestVolumeBootPattern-server-1809681454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1809681454',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrg6dgmwLxM+qOiUQmkZP+lby3sIcjedzAt6Qr2Vg5lrRzmZuOCIGPTCAvsPt68uI6UbSOJN/oyUTe5OqihGAovpc3vgI5qK/6ApsKxZfDXJBHGmnIe3WgtSfAKkR6e4g==',key_name='tempest-TestVolumeBootPattern-1591090964',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:25:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe0eebdd39c54a74be8d2e0f9842b165',ramdisk_id='',reservation_id='r-jl6dfscf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-389869337',owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:25:06Z,user_data=None,user_id='c334f73c5bf1473aadf865c8f032c0cb',uuid=bb4a950d-d7c6-4bef-96a3-63fefd512e4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "address": "fa:16:3e:62:8c:11", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bafa973-0c", "ovs_interfaceid": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converting VIF {"id": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "address": "fa:16:3e:62:8c:11", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bafa973-0c", "ovs_interfaceid": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:8c:11,bridge_name='br-int',has_traffic_filtering=True,id=1bafa973-0c18-4a87-98a0-6a1af9588b47,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bafa973-0c') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_vif [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:8c:11,bridge_name='br-int',has_traffic_filtering=True,id=1bafa973-0c18-4a87-98a0-6a1af9588b47,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bafa973-0c') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bafa973-0c, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG nova.network.neutron [req-9c0b90f7-8a3f-4bb3-8265-8aac879b3b0e req-4ead2bf1-e8cc-49d6-8489-d28f6651ace0 service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Updated VIF entry in instance network info cache for port 1bafa973-0c18-4a87-98a0-6a1af9588b47. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG nova.network.neutron [req-9c0b90f7-8a3f-4bb3-8265-8aac879b3b0e req-4ead2bf1-e8cc-49d6-8489-d28f6651ace0 service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Updating instance_info_cache with network_info: [{"id": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "address": "fa:16:3e:62:8c:11", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bafa973-0c", "ovs_interfaceid": "1bafa973-0c18-4a87-98a0-6a1af9588b47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dac39ace-75f5-41f8-89f3-8ecf19bf71a2) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:47 user nova-compute[75246]: INFO os_vif [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:8c:11,bridge_name='br-int',has_traffic_filtering=True,id=1bafa973-0c18-4a87-98a0-6a1af9588b47,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bafa973-0c')
Nov 28 17:26:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQfnsxjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:26:47 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9c0b90f7-8a3f-4bb3-8265-8aac879b3b0e req-4ead2bf1-e8cc-49d6-8489-d28f6651ace0 service nova] Releasing lock "refresh_cache-bb4a950d-d7c6-4bef-96a3-63fefd512e4b" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5997c846-4b90-42a9-9a8e-cc5fd4823a68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:26:47 user nova-compute[75246]: No targets found.
Nov 28 17:26:47 user nova-compute[75246]: iSNS:
Nov 28 17:26:47 user nova-compute[75246]: No targets found.
Nov 28 17:26:47 user nova-compute[75246]: STATIC:
Nov 28 17:26:47 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5
Nov 28 17:26:47 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:26:47 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:26:47 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a
Nov 28 17:26:47 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:26:47 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:26:47 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75
Nov 28 17:26:47 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:26:47 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:26:47 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f
Nov 28 17:26:47 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:26:47 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:26:47 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:26:47 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:26:47 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:26:47 user nova-compute[75246]: FIRMWARE:
Nov 28 17:26:47 user nova-compute[75246]: No targets found.
Nov 28 17:26:47 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:26:47 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:26:47 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[40591c52-983f-4a0b-b0fa-267adb86f696]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5ed219-5de6-428b-9b1f-58da30457d45]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:26:47 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:26:47 user nova-compute[75246]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)
Nov 28 17:26:47 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:26:47 user nova-compute[75246]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a (non-flash)
Nov 28 17:26:47 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:26:47 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:26:47 user nova-compute[75246]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 (non-flash)
Nov 28 17:26:47 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:26:47 user nova-compute[75246]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a (non-flash)
Nov 28 17:26:47 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4fbbdd510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5'): ({'sde'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Removing single pathed devices sde {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a53e09-5320-409c-8996-ff16b0daa1c3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a487d4a0-a92a-4175-8227-04bd2b96f11c]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Flushing IO for device /dev/sde {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe94c297-3e3b-49d1-85c3-d9c161f86f98]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[740e55ad-4435-4b8e-96c4-0054c8298a5e]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] SCSI volumes sde have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e10e425f', '/dev/disk/by-id/scsi-26563333133666261', '/dev/disk/by-id/scsi-1SCST_BIOe10e425f-ec313fbab2146a9a') {{(pid=85745) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c11fde-978d-45b0-9e2a-c836f1bd8f95]: (4, None) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee998ad3-34a4-47fc-b71b-46e0bc6b655a]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5a3abc-3498-4864-bb8f-91abd34eafd7]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5, portal: 172.16.0.220,3260]
Nov 28 17:26:47 user nova-compute[75246]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5, portal: 172.16.0.220,3260] successful.
Nov 28 17:26:47 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8788658b-b207-4323-844b-c81f7bed1ab5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3292e2-2c42-4fb9-b3cf-5ceb4e530eff]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] <== disconnect_volume: return (332ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:26:47 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:26:47 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Deleting instance files /opt/stack/data/nova/instances/bb4a950d-d7c6-4bef-96a3-63fefd512e4b_del
Nov 28 17:26:47 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Deletion of /opt/stack/data/nova/instances/bb4a950d-d7c6-4bef-96a3-63fefd512e4b_del complete
Nov 28 17:26:48 user nova-compute[75246]: INFO nova.compute.manager [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 28 17:26:48 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:26:48 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:26:48 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:26:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:48 user nova-compute[75246]: INFO nova.compute.manager [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Terminating instance
Nov 28 17:26:48 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:26:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:49 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Instance destroyed successfully.
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.objects.instance [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lazy-loading 'resources' on Instance uuid 1a520141-ac59-407a-a525-b3fe402e8cd5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2095107296',display_name='tempest-ServerStableDeviceRescueTest-server-2095107296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2095107296',id=40,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDa5uEO1HX+58NWsd53/buxKkPj78W0uZlYn7nLVLGasZGkhXRb5Jz2aA7I2S3wLbUGkObWNp8tsEnWn252BxXEnoOs3Plc1kb2ClU++Ma46Pfe3fpGcAWwTUSSX3xIDQ==',key_name='tempest-keypair-1485453579',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:23:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4641269f199d40e7b0950c342f63cedf',ramdisk_id='',reservation_id='r-zm04m3my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2071157665',owner_user_name='tempest-ServerStableDeviceRescueTest-2071157665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:25:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19ef7d1761e1453192ff17640d5e76c5',uuid=1a520141-ac59-407a-a525-b3fe402e8cd5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Converting VIF {"id": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "address": "fa:16:3e:24:10:f8", "network": {"id": "c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349842805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4641269f199d40e7b0950c342f63cedf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82c2968b-a7", "ovs_interfaceid": "82c2968b-a7ec-41d6-924f-25ce67ec14b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:10:f8,bridge_name='br-int',has_traffic_filtering=True,id=82c2968b-a7ec-41d6-924f-25ce67ec14b1,network=Network(c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82c2968b-a7') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG os_vif [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:10:f8,bridge_name='br-int',has_traffic_filtering=True,id=82c2968b-a7ec-41d6-924f-25ce67ec14b1,network=Network(c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82c2968b-a7') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82c2968b-a7, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f667434c-8078-4053-aa4f-493599e1db3a) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:49 user nova-compute[75246]: INFO os_vif [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:10:f8,bridge_name='br-int',has_traffic_filtering=True,id=82c2968b-a7ec-41d6-924f-25ce67ec14b1,network=Network(c2d2084e-d6bb-4af3-ba62-3e8ec5e8b44e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82c2968b-a7')
Nov 28 17:26:49 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Deleting instance files /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5_del
Nov 28 17:26:49 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Deletion of /opt/stack/data/nova/instances/1a520141-ac59-407a-a525-b3fe402e8cd5_del complete
Nov 28 17:26:49 user nova-compute[75246]: INFO nova.compute.manager [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:26:49 user nova-compute[75246]: WARNING nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] While synchronizing instance power states, found 8 instances in the database and 6 instances on the hypervisor.
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 894da7a3-9c67-417e-b0f4-306335a533e6 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid a796152e-e8df-41bf-a5ea-ae94d4fa8b41 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 1a520141-ac59-407a-a525-b3fe402e8cd5 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid ae257aa8-78c3-499e-a5cf-1021deefe6d8 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid f7c26790-8596-4151-94f3-e5bfa9fb7586 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid 22705851-8092-4be3-ab20-3712b62e40f5 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid bb4a950d-d7c6-4bef-96a3-63fefd512e4b {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid aa6b050c-ffd6-4a40-ab64-59f7ae8bef78 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "894da7a3-9c67-417e-b0f4-306335a533e6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "894da7a3-9c67-417e-b0f4-306335a533e6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "f7c26790-8596-4151-94f3-e5bfa9fb7586" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "22705851-8092-4be3-ab20-3712b62e40f5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "22705851-8092-4be3-ab20-3712b62e40f5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-53f4e393-6fd4-4b4d-b1d2-c7a5590a92d4 req-5b74b9b7-4981-48bf-8e0e-8ec52ae13ee3 service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Received event network-vif-plugged-1bafa973-0c18-4a87-98a0-6a1af9588b47 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-53f4e393-6fd4-4b4d-b1d2-c7a5590a92d4 req-5b74b9b7-4981-48bf-8e0e-8ec52ae13ee3 service nova] Acquiring lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-53f4e393-6fd4-4b4d-b1d2-c7a5590a92d4 req-5b74b9b7-4981-48bf-8e0e-8ec52ae13ee3 service nova] Lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-53f4e393-6fd4-4b4d-b1d2-c7a5590a92d4 req-5b74b9b7-4981-48bf-8e0e-8ec52ae13ee3 service nova] Lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-53f4e393-6fd4-4b4d-b1d2-c7a5590a92d4 req-5b74b9b7-4981-48bf-8e0e-8ec52ae13ee3 service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] No waiting events found dispatching network-vif-plugged-1bafa973-0c18-4a87-98a0-6a1af9588b47 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:26:49 user nova-compute[75246]: WARNING nova.compute.manager [req-53f4e393-6fd4-4b4d-b1d2-c7a5590a92d4 req-5b74b9b7-4981-48bf-8e0e-8ec52ae13ee3 service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Received unexpected event network-vif-plugged-1bafa973-0c18-4a87-98a0-6a1af9588b47 for instance with vm_state active and task_state deleting.
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-53f4e393-6fd4-4b4d-b1d2-c7a5590a92d4 req-5b74b9b7-4981-48bf-8e0e-8ec52ae13ee3 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received event network-vif-unplugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-53f4e393-6fd4-4b4d-b1d2-c7a5590a92d4 req-5b74b9b7-4981-48bf-8e0e-8ec52ae13ee3 service nova] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-53f4e393-6fd4-4b4d-b1d2-c7a5590a92d4 req-5b74b9b7-4981-48bf-8e0e-8ec52ae13ee3 service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-53f4e393-6fd4-4b4d-b1d2-c7a5590a92d4 req-5b74b9b7-4981-48bf-8e0e-8ec52ae13ee3 service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-53f4e393-6fd4-4b4d-b1d2-c7a5590a92d4 req-5b74b9b7-4981-48bf-8e0e-8ec52ae13ee3 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] No waiting events found dispatching network-vif-unplugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-53f4e393-6fd4-4b4d-b1d2-c7a5590a92d4 req-5b74b9b7-4981-48bf-8e0e-8ec52ae13ee3 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received event network-vif-unplugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "894da7a3-9c67-417e-b0f4-306335a533e6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:49 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Took 1.44 seconds to deallocate network for instance.
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "22705851-8092-4be3-ab20-3712b62e40f5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:50 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:26:50 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Took 0.89 seconds to deallocate network for instance.
Nov 28 17:26:50 user nova-compute[75246]: DEBUG nova.compute.manager [req-28716c62-9e5a-4784-8664-100bc4a07508 req-1f0d3bf6-1a6b-4656-a50d-1c6f330f88c3 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received event network-vif-deleted-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:26:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:50 user nova-compute[75246]: INFO nova.compute.manager [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Took 0.81 seconds to detach 1 volumes for instance.
Nov 28 17:26:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:50 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:26:50 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:26:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.158s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:50 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Deleted allocations for instance 1a520141-ac59-407a-a525-b3fe402e8cd5
Nov 28 17:26:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b351b629-6370-4ec7-89e4-b370f6ca208a tempest-ServerStableDeviceRescueTest-2071157665 tempest-ServerStableDeviceRescueTest-2071157665-project-member] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.213s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.228s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:50 user nova-compute[75246]: INFO nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 28 17:26:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:50 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:26:50 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:26:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:50 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Deleted allocations for instance bb4a950d-d7c6-4bef-96a3-63fefd512e4b
Nov 28 17:26:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-8be11317-75f4-4564-b703-88f314f1d5a8 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.063s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.481s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:50 user nova-compute[75246]: INFO nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 28 17:26:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "bb4a950d-d7c6-4bef-96a3-63fefd512e4b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:51 user nova-compute[75246]: DEBUG nova.compute.manager [req-8f7fd151-05f0-4d16-b197-aa046317964e req-e7cf6cf4-dec1-4cc0-9157-1b0a4e68cde7 service nova] [instance: bb4a950d-d7c6-4bef-96a3-63fefd512e4b] Received event network-vif-deleted-1bafa973-0c18-4a87-98a0-6a1af9588b47 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:26:51 user nova-compute[75246]: DEBUG nova.compute.manager [req-8f7fd151-05f0-4d16-b197-aa046317964e req-e7cf6cf4-dec1-4cc0-9157-1b0a4e68cde7 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received event network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:26:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8f7fd151-05f0-4d16-b197-aa046317964e req-e7cf6cf4-dec1-4cc0-9157-1b0a4e68cde7 service nova] Acquiring lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8f7fd151-05f0-4d16-b197-aa046317964e req-e7cf6cf4-dec1-4cc0-9157-1b0a4e68cde7 service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-8f7fd151-05f0-4d16-b197-aa046317964e req-e7cf6cf4-dec1-4cc0-9157-1b0a4e68cde7 service nova] Lock "1a520141-ac59-407a-a525-b3fe402e8cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:26:51 user nova-compute[75246]: DEBUG nova.compute.manager [req-8f7fd151-05f0-4d16-b197-aa046317964e req-e7cf6cf4-dec1-4cc0-9157-1b0a4e68cde7 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] No waiting events found dispatching network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:26:51 user nova-compute[75246]: WARNING nova.compute.manager [req-8f7fd151-05f0-4d16-b197-aa046317964e req-e7cf6cf4-dec1-4cc0-9157-1b0a4e68cde7 service nova] [instance: 1a520141-ac59-407a-a525-b3fe402e8cd5] Received unexpected event network-vif-plugged-82c2968b-a7ec-41d6-924f-25ce67ec14b1 for instance with vm_state deleted and task_state None.
Nov 28 17:26:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "22705851-8092-4be3-ab20-3712b62e40f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "22705851-8092-4be3-ab20-3712b62e40f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:26:53 user nova-compute[75246]: INFO nova.compute.manager [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Detaching volume 881b569a-8d54-4f38-9fc2-2a59c93eaa8a
Nov 28 17:26:53 user nova-compute[75246]: INFO nova.virt.block_device [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Attempting to driver detach volume 881b569a-8d54-4f38-9fc2-2a59c93eaa8a from mountpoint /dev/vdb
Nov 28 17:26:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Attempting to detach device vdb from instance 22705851-8092-4be3-ab20-3712b62e40f5 from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:26:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:26:53 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:26:53 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:26:53 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:26:53 user nova-compute[75246]:   <serial>881b569a-8d54-4f38-9fc2-2a59c93eaa8a</serial>
Nov 28 17:26:53 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:26:53 user nova-compute[75246]: </disk>
Nov 28 17:26:53 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:26:53 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Successfully detached device vdb from instance 22705851-8092-4be3-ab20-3712b62e40f5 from the persistent domain config.
Nov 28 17:26:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22705851-8092-4be3-ab20-3712b62e40f5 from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:26:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:26:53 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:26:53 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:26:53 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:26:53 user nova-compute[75246]:   <serial>881b569a-8d54-4f38-9fc2-2a59c93eaa8a</serial>
Nov 28 17:26:53 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:26:53 user nova-compute[75246]: </disk>
Nov 28 17:26:53 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:26:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "22705851-8092-4be3-ab20-3712b62e40f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:26:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22705851-8092-4be3-ab20-3712b62e40f5 {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:26:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:55 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:26:55 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:26:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-ae257aa8-78c3-499e-a5cf-1021deefe6d8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:26:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-ae257aa8-78c3-499e-a5cf-1021deefe6d8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:26:55 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:26:55 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Updating instance_info_cache with network_info: [{"id": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "address": "fa:16:3e:1e:ed:6e", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e83fee-b8", "ovs_interfaceid": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:26:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-ae257aa8-78c3-499e-a5cf-1021deefe6d8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:26:55 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:26:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:26:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:27:14 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 22705851-8092-4be3-ab20-3712b62e40f5 is timed out.
Nov 28 17:27:14 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Successfully detached device vdb from instance 22705851-8092-4be3-ab20-3712b62e40f5 from the live domain config.
Nov 28 17:27:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dHsmPiAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:27:14 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55060f5-7456-4787-a93b-fdc786c9c438]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:27:14 user nova-compute[75246]: No targets found.
Nov 28 17:27:14 user nova-compute[75246]: iSNS:
Nov 28 17:27:14 user nova-compute[75246]: No targets found.
Nov 28 17:27:14 user nova-compute[75246]: STATIC:
Nov 28 17:27:14 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a
Nov 28 17:27:14 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:27:14 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:27:14 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75
Nov 28 17:27:14 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:27:14 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:27:14 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f
Nov 28 17:27:14 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:27:14 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:27:14 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:27:14 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:27:14 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:27:14 user nova-compute[75246]: FIRMWARE:
Nov 28 17:27:14 user nova-compute[75246]: No targets found.
Nov 28 17:27:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:27:14 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:27:14 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[703ca9f2-5026-4136-9ec8-0fd3ede00f24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53cf730-c0cc-48b6-9a32-d24e57acdb80]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:27:14 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:27:14 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:27:14 user nova-compute[75246]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a (non-flash)
Nov 28 17:27:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:27:14 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:27:14 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:27:14 user nova-compute[75246]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a (non-flash)
Nov 28 17:27:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d8361510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a'): ({'sdc'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Removing single pathed devices sdc {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de0d2a5-2937-409b-af0a-0b3fb0ef8fb8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb8616d-452e-40be-b245-a47609a0f7cf]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Flushing IO for device /dev/sdc {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dde3cd1-5c89-4582-a18a-a462e1c00010]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ef44b9-64e1-4c74-8a2d-8e97dc674d71]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[330ca969-f89a-47bc-b969-b7e4af730690]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d2c3eb-bacf-4247-b68b-9201fbb4a87c]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a, portal: 172.16.0.220,3260]
Nov 28 17:27:14 user nova-compute[75246]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a, portal: 172.16.0.220,3260] successful.
Nov 28 17:27:14 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[62568626-3c82-43de-a2ce-64a442834f17]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] <== disconnect_volume: return (325ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:27:14 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:27:15 user nova-compute[75246]: INFO nova.compute.manager [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Rescuing
Nov 28 17:27:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "refresh_cache-aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquired lock "refresh_cache-aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG nova.network.neutron [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lazy-loading 'flavor' on Instance uuid 22705851-8092-4be3-ab20-3712b62e40f5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6fb18289-b48b-4e0f-9828-bb4142be3a2f tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "22705851-8092-4be3-ab20-3712b62e40f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.704s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "22705851-8092-4be3-ab20-3712b62e40f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.578s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "22705851-8092-4be3-ab20-3712b62e40f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "22705851-8092-4be3-ab20-3712b62e40f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "22705851-8092-4be3-ab20-3712b62e40f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:15 user nova-compute[75246]: INFO nova.compute.manager [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Terminating instance
Nov 28 17:27:15 user nova-compute[75246]: DEBUG nova.compute.manager [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG nova.network.neutron [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Updating instance_info_cache with network_info: [{"id": "dc3270f2-afa6-474a-8db6-26146f76efc6", "address": "fa:16:3e:5c:ed:e4", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3270f2-af", "ovs_interfaceid": "dc3270f2-afa6-474a-8db6-26146f76efc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Releasing lock "refresh_cache-aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-aefbbbe5-8e39-4a24-81bf-bdfb4a6ab1eb req-2cbf73f7-8814-46c2-b61d-3f458128784d service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received event network-vif-unplugged-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-aefbbbe5-8e39-4a24-81bf-bdfb4a6ab1eb req-2cbf73f7-8814-46c2-b61d-3f458128784d service nova] Acquiring lock "22705851-8092-4be3-ab20-3712b62e40f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-aefbbbe5-8e39-4a24-81bf-bdfb4a6ab1eb req-2cbf73f7-8814-46c2-b61d-3f458128784d service nova] Lock "22705851-8092-4be3-ab20-3712b62e40f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-aefbbbe5-8e39-4a24-81bf-bdfb4a6ab1eb req-2cbf73f7-8814-46c2-b61d-3f458128784d service nova] Lock "22705851-8092-4be3-ab20-3712b62e40f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-aefbbbe5-8e39-4a24-81bf-bdfb4a6ab1eb req-2cbf73f7-8814-46c2-b61d-3f458128784d service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] No waiting events found dispatching network-vif-unplugged-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG nova.compute.manager [req-aefbbbe5-8e39-4a24-81bf-bdfb4a6ab1eb req-2cbf73f7-8814-46c2-b61d-3f458128784d service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received event network-vif-unplugged-7166f3eb-0624-4f3a-85e1-db89b444907d for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Instance destroyed successfully.
Nov 28 17:27:16 user nova-compute[75246]: DEBUG nova.objects.instance [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lazy-loading 'resources' on Instance uuid 22705851-8092-4be3-ab20-3712b62e40f5 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:27:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Instance destroyed successfully.
Nov 28 17:27:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Attempting a stable device rescue
Nov 28 17:27:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:24:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-492535018',display_name='tempest-VolumesSnapshotTestJSON-instance-492535018',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-492535018',id=47,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHVmBN3kLp/ygSOyonzB4KVQcmo+Xh+uW5tHV200ZRVwt8OhioJygpiRPcmUGSa5IvXZqJ3Uy+87vpV2I1EbikdwCAkBcOfdbEkWeI6vtpaeIa5c7WvE9aHiNPCXxJ83g==',key_name='tempest-keypair-815578317',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:24:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45c961f690054959a9a92a3383ff6ff7',ramdisk_id='',reservation_id='r-ecf065tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1977855474',owner_user_name='tempest-VolumesSnapshotTestJSON-1977855474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124d4cbebf644cd1a6de6aeccd4d4030',uuid=22705851-8092-4be3-ab20-3712b62e40f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7166f3eb-0624-4f3a-85e1-db89b444907d", "address": "fa:16:3e:7b:81:81", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7166f3eb-06", "ovs_interfaceid": "7166f3eb-0624-4f3a-85e1-db89b444907d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Converting VIF {"id": "7166f3eb-0624-4f3a-85e1-db89b444907d", "address": "fa:16:3e:7b:81:81", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7166f3eb-06", "ovs_interfaceid": "7166f3eb-0624-4f3a-85e1-db89b444907d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:81:81,bridge_name='br-int',has_traffic_filtering=True,id=7166f3eb-0624-4f3a-85e1-db89b444907d,network=Network(6297eef9-9b93-47d1-bffa-cd1a7cc5925b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7166f3eb-06') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG os_vif [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:81:81,bridge_name='br-int',has_traffic_filtering=True,id=7166f3eb-0624-4f3a-85e1-db89b444907d,network=Network(6297eef9-9b93-47d1-bffa-cd1a7cc5925b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7166f3eb-06') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7166f3eb-06, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7d14e5e-b360-4219-867f-b69ef23690b7) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:16 user nova-compute[75246]: INFO os_vif [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:81:81,bridge_name='br-int',has_traffic_filtering=True,id=7166f3eb-0624-4f3a-85e1-db89b444907d,network=Network(6297eef9-9b93-47d1-bffa-cd1a7cc5925b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7166f3eb-06')
Nov 28 17:27:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75246) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dHsmPiAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:27:16 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:27:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Instance directory exists: not creating {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 17:27:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Creating image(s)
Nov 28 17:27:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "/opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "/opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG nova.objects.instance [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'trusted_certs' on Instance uuid aa6b050c-ffd6-4a40-ab64-59f7ae8bef78 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "8d520c14f5a7e31a73072120dc7d186ff0fbf80a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "8d520c14f5a7e31a73072120dc7d186ff0fbf80a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f86a3b-98e9-41fb-8174-12e62994974b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:27:16 user nova-compute[75246]: No targets found.
Nov 28 17:27:16 user nova-compute[75246]: iSNS:
Nov 28 17:27:16 user nova-compute[75246]: No targets found.
Nov 28 17:27:16 user nova-compute[75246]: STATIC:
Nov 28 17:27:16 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75
Nov 28 17:27:16 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:27:16 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:27:16 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f
Nov 28 17:27:16 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:27:16 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:27:16 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:27:16 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:27:16 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:27:16 user nova-compute[75246]: FIRMWARE:
Nov 28 17:27:16 user nova-compute[75246]: No targets found.
Nov 28 17:27:16 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:27:16 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:27:16 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:881b569a-8d54-4f38-9fc2-2a59c93eaa8a', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b56827-76e8-49c6-b9ce-0a6dc5c98929]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e822e4-832f-4673-876a-ad8e5b5b2ea0]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:27:16 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:27:16 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:27:16 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:27:16 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:27:16 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:27:16 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4fbbdd510>, {}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Disconnecting from: [] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.090s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] <== disconnect_volume: return (91ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:27:16 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:27:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Deleting instance files /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5_del
Nov 28 17:27:16 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Deletion of /opt/stack/data/nova/instances/22705851-8092-4be3-ab20-3712b62e40f5_del complete
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d520c14f5a7e31a73072120dc7d186ff0fbf80a.part --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:17 user nova-compute[75246]: INFO nova.compute.manager [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Took 2.29 seconds to destroy the instance on the hypervisor.
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received event network-vif-plugged-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Acquiring lock "22705851-8092-4be3-ab20-3712b62e40f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Lock "22705851-8092-4be3-ab20-3712b62e40f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Lock "22705851-8092-4be3-ab20-3712b62e40f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] No waiting events found dispatching network-vif-plugged-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:27:17 user nova-compute[75246]: WARNING nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received unexpected event network-vif-plugged-7166f3eb-0624-4f3a-85e1-db89b444907d for instance with vm_state active and task_state deleting.
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received event network-vif-unplugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Acquiring lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] No waiting events found dispatching network-vif-unplugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:27:17 user nova-compute[75246]: WARNING nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received unexpected event network-vif-unplugged-dc3270f2-afa6-474a-8db6-26146f76efc6 for instance with vm_state active and task_state rescuing.
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received event network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Acquiring lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] No waiting events found dispatching network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:27:17 user nova-compute[75246]: WARNING nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received unexpected event network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 for instance with vm_state active and task_state rescuing.
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received event network-vif-plugged-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Acquiring lock "22705851-8092-4be3-ab20-3712b62e40f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Lock "22705851-8092-4be3-ab20-3712b62e40f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Lock "22705851-8092-4be3-ab20-3712b62e40f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] No waiting events found dispatching network-vif-plugged-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:27:17 user nova-compute[75246]: WARNING nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received unexpected event network-vif-plugged-7166f3eb-0624-4f3a-85e1-db89b444907d for instance with vm_state active and task_state deleting.
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received event network-vif-plugged-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Acquiring lock "22705851-8092-4be3-ab20-3712b62e40f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Lock "22705851-8092-4be3-ab20-3712b62e40f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Lock "22705851-8092-4be3-ab20-3712b62e40f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] No waiting events found dispatching network-vif-plugged-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:27:17 user nova-compute[75246]: WARNING nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received unexpected event network-vif-plugged-7166f3eb-0624-4f3a-85e1-db89b444907d for instance with vm_state active and task_state deleting.
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received event network-vif-unplugged-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Acquiring lock "22705851-8092-4be3-ab20-3712b62e40f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Lock "22705851-8092-4be3-ab20-3712b62e40f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Lock "22705851-8092-4be3-ab20-3712b62e40f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] No waiting events found dispatching network-vif-unplugged-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received event network-vif-unplugged-7166f3eb-0624-4f3a-85e1-db89b444907d for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received event network-vif-plugged-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Acquiring lock "22705851-8092-4be3-ab20-3712b62e40f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Lock "22705851-8092-4be3-ab20-3712b62e40f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] Lock "22705851-8092-4be3-ab20-3712b62e40f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] No waiting events found dispatching network-vif-plugged-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:27:17 user nova-compute[75246]: WARNING nova.compute.manager [req-4be94b92-9294-4844-84d6-7990a6dd0dd1 req-f9f13859-75b4-4f7c-a270-a2831ec8d48a service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received unexpected event network-vif-plugged-7166f3eb-0624-4f3a-85e1-db89b444907d for instance with vm_state active and task_state deleting.
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d520c14f5a7e31a73072120dc7d186ff0fbf80a.part --force-share --output=json" returned: 0 in 0.194s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.virt.images [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] e8403295-629c-4ab5-ad5d-30f9c4aedbd8 was qcow2, converting to raw {{(pid=75246) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG nova.privsep.utils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75246) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 17:27:17 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8d520c14f5a7e31a73072120dc7d186ff0fbf80a.part /opt/stack/data/nova/instances/_base/8d520c14f5a7e31a73072120dc7d186ff0fbf80a.converted {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8d520c14f5a7e31a73072120dc7d186ff0fbf80a.part /opt/stack/data/nova/instances/_base/8d520c14f5a7e31a73072120dc7d186ff0fbf80a.converted" returned: 0 in 0.684s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d520c14f5a7e31a73072120dc7d186ff0fbf80a.converted --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-a9cb2b69-a607-4754-8701-e05adda9e7e4 req-c99a3c0e-461f-48c1-8fd9-9b8b5f941980 service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Received event network-vif-deleted-7166f3eb-0624-4f3a-85e1-db89b444907d {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:18 user nova-compute[75246]: INFO nova.compute.manager [req-a9cb2b69-a607-4754-8701-e05adda9e7e4 req-c99a3c0e-461f-48c1-8fd9-9b8b5f941980 service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Neutron deleted interface 7166f3eb-0624-4f3a-85e1-db89b444907d; detaching it from the instance and deleting it from the info cache
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.network.neutron [req-a9cb2b69-a607-4754-8701-e05adda9e7e4 req-c99a3c0e-461f-48c1-8fd9-9b8b5f941980 service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:27:18 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Took 0.90 seconds to deallocate network for instance.
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.compute.manager [req-a9cb2b69-a607-4754-8701-e05adda9e7e4 req-c99a3c0e-461f-48c1-8fd9-9b8b5f941980 service nova] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Detach interface failed, port_id=7166f3eb-0624-4f3a-85e1-db89b444907d, reason: Instance 22705851-8092-4be3-ab20-3712b62e40f5 could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:27:18 user nova-compute[75246]: WARNING nova.volume.cinder [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Attachment 286b671c-293a-48b7-b8bf-3e58cb399d8c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 286b671c-293a-48b7-b8bf-3e58cb399d8c. (HTTP 404) (Request-ID: req-c6d42629-fda1-4870-a01a-9c189da35304)
Nov 28 17:27:18 user nova-compute[75246]: INFO nova.compute.manager [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: 22705851-8092-4be3-ab20-3712b62e40f5] Took 0.03 seconds to detach 1 volumes for instance.
Nov 28 17:27:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d520c14f5a7e31a73072120dc7d186ff0fbf80a.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "8d520c14f5a7e31a73072120dc7d186ff0fbf80a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.114s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "8d520c14f5a7e31a73072120dc7d186ff0fbf80a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "8d520c14f5a7e31a73072120dc7d186ff0fbf80a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d520c14f5a7e31a73072120dc7d186ff0fbf80a --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d520c14f5a7e31a73072120dc7d186ff0fbf80a --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8d520c14f5a7e31a73072120dc7d186ff0fbf80a,backing_fmt=raw /opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78/disk.rescue {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8d520c14f5a7e31a73072120dc7d186ff0fbf80a,backing_fmt=raw /opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78/disk.rescue" returned: 0 in 0.068s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "8d520c14f5a7e31a73072120dc7d186ff0fbf80a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.objects.instance [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'migration_context' on Instance uuid aa6b050c-ffd6-4a40-ab64-59f7ae8bef78 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.objects.base [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Object Instance<aa6b050c-ffd6-4a40-ab64-59f7ae8bef78> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Start _get_guest_xml network_info=[{"id": "dc3270f2-afa6-474a-8db6-26146f76efc6", "address": "fa:16:3e:5c:ed:e4", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "vif_mac": "fa:16:3e:5c:ed:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3270f2-af", "ovs_interfaceid": "dc3270f2-afa6-474a-8db6-26146f76efc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e8403295-629c-4ab5-ad5d-30f9c4aedbd8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '275dc3d9-ffde-4834-9272-ae5a6d208cf4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yvAsZloz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'aa6b050c-ffd6-4a40-ab64-59f7ae8bef78', 'attached_at': '', 'detached_at': '', 'volume_id': '168870a5-6858-4a8f-82ea-514b95a8b19f', 'serial': '168870a5-6858-4a8f-82ea-514b95a8b19f'}, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.objects.instance [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'resources' on Instance uuid aa6b050c-ffd6-4a40-ab64-59f7ae8bef78 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.objects.base [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Object Instance<aa6b050c-ffd6-4a40-ab64-59f7ae8bef78> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.objects.instance [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'numa_topology' on Instance uuid aa6b050c-ffd6-4a40-ab64-59f7ae8bef78 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.objects.base [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Object Instance<aa6b050c-ffd6-4a40-ab64-59f7ae8bef78> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:27:18 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:27:18 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.objects.instance [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'vcpu_model' on Instance uuid aa6b050c-ffd6-4a40-ab64-59f7ae8bef78 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:27:18 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Deleted allocations for instance 22705851-8092-4be3-ab20-3712b62e40f5
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.objects.base [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Object Instance<aa6b050c-ffd6-4a40-ab64-59f7ae8bef78> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yvAsZloz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:27:18 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:27:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:27:18 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:27:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:27:18 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:27:18 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:27:18 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260" returned: 0 in 0.029s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[396a9134-5f9f-40c0-8ee6-6a008975dc37]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = yvAsZloz\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 17:27:19 user nova-compute[75246]: node.name = iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f
Nov 28 17:27:19 user nova-compute[75246]: node.tpgt = -1
Nov 28 17:27:19 user nova-compute[75246]: node.startup = automatic
Nov 28 17:27:19 user nova-compute[75246]: node.leading_login = No
Nov 28 17:27:19 user nova-compute[75246]: iface.iscsi_ifacename = default
Nov 28 17:27:19 user nova-compute[75246]: iface.net_ifacename = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.ipaddress = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.prefix_len = 0
Nov 28 17:27:19 user nova-compute[75246]: iface.hwaddress = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.transport_name = tcp
Nov 28 17:27:19 user nova-compute[75246]: iface.initiatorname = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.state = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.vlan_id = 0
Nov 28 17:27:19 user nova-compute[75246]: iface.vlan_priority = 0
Nov 28 17:27:19 user nova-compute[75246]: iface.vlan_state = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.iface_num = 0
Nov 28 17:27:19 user nova-compute[75246]: iface.mtu = 0
Nov 28 17:27:19 user nova-compute[75246]: iface.port = 0
Nov 28 17:27:19 user nova-compute[75246]: iface.bootproto = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.subnet_mask = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.gateway = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.dhcp_alt_client_id = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.dhcp_dns = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.dhcp_learn_iqn = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.dhcp_vendor_id_state = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.dhcp_vendor_id = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.dhcp_slp_da = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.fragmentation = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.gratuitous_arp = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.incoming_forwarding = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.tos_state = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.tos = 0
Nov 28 17:27:19 user nova-compute[75246]: iface.ttl = 0
Nov 28 17:27:19 user nova-compute[75246]: iface.delayed_ack = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.tcp_nagle = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.tcp_wsf_state = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.tcp_wsf = 0
Nov 28 17:27:19 user nova-compute[75246]: iface.tcp_timer_scale = 0
Nov 28 17:27:19 user nova-compute[75246]: iface.tcp_timestamp = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.redirect = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.def_task_mgmt_timeout = 0
Nov 28 17:27:19 user nova-compute[75246]: iface.header_digest = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.data_digest = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.immediate_data = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.initial_r2t = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.data_seq_inorder = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.data_pdu_inorder = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.erl = 0
Nov 28 17:27:19 user nova-compute[75246]: iface.max_receive_data_len = 0
Nov 28 17:27:19 user nova-compute[75246]: iface.first_burst_len = 0
Nov 28 17:27:19 user nova-compute[75246]: iface.max_outstanding_r2t = 0
Nov 28 17:27:19 user nova-compute[75246]: iface.max_burst_len = 0
Nov 28 17:27:19 user nova-compute[75246]: iface.chap_auth = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.bidi_chap = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.strict_login_compliance = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.discovery_auth = <empty>
Nov 28 17:27:19 user nova-compute[75246]: iface.discovery_logout = <empty>
Nov 28 17:27:19 user nova-compute[75246]: node.discovery_address = <empty>
Nov 28 17:27:19 user nova-compute[75246]: node.discovery_port = 0
Nov 28 17:27:19 user nova-compute[75246]: node.discovery_type = static
Nov 28 17:27:19 user nova-compute[75246]: node.session.initial_cmdsn = 0
Nov 28 17:27:19 user nova-compute[75246]: node.session.initial_login_retry_max = 8
Nov 28 17:27:19 user nova-compute[75246]: node.session.xmit_thread_priority = -20
Nov 28 17:27:19 user nova-compute[75246]: node.session.cmds_max = 128
Nov 28 17:27:19 user nova-compute[75246]: node.session.queue_depth = 32
Nov 28 17:27:19 user nova-compute[75246]: node.session.nr_sessions = 1
Nov 28 17:27:19 user nova-compute[75246]: node.session.auth.authmethod = CHAP
Nov 28 17:27:19 user nova-compute[75246]: node.session.auth.username = yvAsZloz
Nov 28 17:27:19 user nova-compute[75246]: node.session.auth.password = ***
Nov 28 17:27:19 user nova-compute[75246]: node.session.auth.username_in = <empty>
Nov 28 17:27:19 user nova-compute[75246]: node.session.auth.password_in = <empty>
Nov 28 17:27:19 user nova-compute[75246]: node.session.auth.chap_algs = MD5
Nov 28 17:27:19 user nova-compute[75246]: node.session.timeo.replacement_timeout = 120
Nov 28 17:27:19 user nova-compute[75246]: node.session.err_timeo.abort_timeout = 15
Nov 28 17:27:19 user nova-compute[75246]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 17:27:19 user nova-compute[75246]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 17:27:19 user nova-compute[75246]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 17:27:19 user nova-compute[75246]: node.session.iscsi.FastAbort = Yes
Nov 28 17:27:19 user nova-compute[75246]: node.session.iscsi.InitialR2T = No
Nov 28 17:27:19 user nova-compute[75246]: node.session.iscsi.ImmediateData = Yes
Nov 28 17:27:19 user nova-compute[75246]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 17:27:19 user nova-compute[75246]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 17:27:19 user nova-compute[75246]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 17:27:19 user nova-compute[75246]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 17:27:19 user nova-compute[75246]: node.session.iscsi.MaxConnections = 1
Nov 28 17:27:19 user nova-compute[75246]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 17:27:19 user nova-compute[75246]: node.session.iscsi.ERL = 0
Nov 28 17:27:19 user nova-compute[75246]: node.session.scan = manual
Nov 28 17:27:19 user nova-compute[75246]: node.session.reopen_max = 0
Nov 28 17:27:19 user nova-compute[75246]: node.conn[0].address = 172.16.0.220
Nov 28 17:27:19 user nova-compute[75246]: node.conn[0].port = 3260
Nov 28 17:27:19 user nova-compute[75246]: node.conn[0].startup = manual
Nov 28 17:27:19 user nova-compute[75246]: node.conn[0].tcp.window_size = 524288
Nov 28 17:27:19 user nova-compute[75246]: node.conn[0].tcp.type_of_service = 0
Nov 28 17:27:19 user nova-compute[75246]: node.conn[0].timeo.logout_timeout = 15
Nov 28 17:27:19 user nova-compute[75246]: node.conn[0].timeo.login_timeout = 15
Nov 28 17:27:19 user nova-compute[75246]: node.conn[0].timeo.auth_timeout = 45
Nov 28 17:27:19 user nova-compute[75246]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 17:27:19 user nova-compute[75246]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 17:27:19 user nova-compute[75246]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 17:27:19 user nova-compute[75246]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 17:27:19 user nova-compute[75246]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 17:27:19 user nova-compute[75246]: node.conn[0].iscsi.DataDigest = None
Nov 28 17:27:19 user nova-compute[75246]: node.conn[0].iscsi.IFMarker = No
Nov 28 17:27:19 user nova-compute[75246]: node.conn[0].iscsi.OFMarker = No
Nov 28 17:27:19 user nova-compute[75246]: # END RECORD
Nov 28 17:27:19 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c62ae62-9dc4-4857-8e32-6d9d38748492]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.049s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ab3621-d50e-4f2e-a161-67c8348d9b79]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yvAsZloz {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-24964bfc-0f66-4d26-9a8d-af338896219c tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "22705851-8092-4be3-ab20-3712b62e40f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.848s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yvAsZloz" returned: 0 in 0.049s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dfb88f-4267-4bc2-83f3-07a2ab963cb8]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yvAsZloz'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.056s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a3257c-ab18-42b6-bf67-815331f1cc72]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab10358e-b9d7-426c-9415-c9755a91a004]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:27:19 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:27:19 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:27:19 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:27:19 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:27:19 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:27:19 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] HCTL ('37', '0', '0', 0) found on session 53 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b5e565-25bf-49e9-bd59-f713524f9f05]: (4, ('0 0 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Searching for a device in session 53 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yvAsZloz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.285s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] <== connect_volume: return (286ms) {'type': 'block', 'scsi_wwn': '23866313338373837', 'path': '/dev/sdf'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866313338373837', 'path': '/dev/sdf'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:25:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-464990600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-464990600',id=49,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:25:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faec5bcef3e2441fba30b593c13d5516',ramdisk_id='',reservation_id='r-ot3xyjx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-506006079',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:25:50Z,user_data=None,user_id='af8b6c3f092547dbbf3debe96c594590',uuid=aa6b050c-ffd6-4a40-ab64-59f7ae8bef78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc3270f2-afa6-474a-8db6-26146f76efc6", "address": "fa:16:3e:5c:ed:e4", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "vif_mac": "fa:16:3e:5c:ed:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3270f2-af", "ovs_interfaceid": "dc3270f2-afa6-474a-8db6-26146f76efc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converting VIF {"id": "dc3270f2-afa6-474a-8db6-26146f76efc6", "address": "fa:16:3e:5c:ed:e4", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "vif_mac": "fa:16:3e:5c:ed:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3270f2-af", "ovs_interfaceid": "dc3270f2-afa6-474a-8db6-26146f76efc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:ed:e4,bridge_name='br-int',has_traffic_filtering=True,id=dc3270f2-afa6-474a-8db6-26146f76efc6,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3270f2-af') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG nova.objects.instance [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'pci_devices' on Instance uuid aa6b050c-ffd6-4a40-ab64-59f7ae8bef78 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG nova.objects.base [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Object Instance<aa6b050c-ffd6-4a40-ab64-59f7ae8bef78> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:27:19 user nova-compute[75246]:   <uuid>aa6b050c-ffd6-4a40-ab64-59f7ae8bef78</uuid>
Nov 28 17:27:19 user nova-compute[75246]:   <name>instance-00000031</name>
Nov 28 17:27:19 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:27:19 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:27:19 user nova-compute[75246]:   <metadata>
Nov 28 17:27:19 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:27:19 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:27:19 user nova-compute[75246]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-464990600</nova:name>
Nov 28 17:27:19 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:27:18</nova:creationTime>
Nov 28 17:27:19 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:27:19 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:27:19 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:27:19 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:27:19 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:27:19 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:27:19 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:27:19 user nova-compute[75246]:       <nova:owner>
Nov 28 17:27:19 user nova-compute[75246]:         <nova:user uuid="af8b6c3f092547dbbf3debe96c594590">tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member</nova:user>
Nov 28 17:27:19 user nova-compute[75246]:         <nova:project uuid="faec5bcef3e2441fba30b593c13d5516">tempest-ServerBootFromVolumeStableRescueTest-506006079</nova:project>
Nov 28 17:27:19 user nova-compute[75246]:       </nova:owner>
Nov 28 17:27:19 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:27:19 user nova-compute[75246]:       <nova:ports>
Nov 28 17:27:19 user nova-compute[75246]:         <nova:port uuid="dc3270f2-afa6-474a-8db6-26146f76efc6">
Nov 28 17:27:19 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 17:27:19 user nova-compute[75246]:         </nova:port>
Nov 28 17:27:19 user nova-compute[75246]:       </nova:ports>
Nov 28 17:27:19 user nova-compute[75246]:     </nova:instance>
Nov 28 17:27:19 user nova-compute[75246]:   </metadata>
Nov 28 17:27:19 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:27:19 user nova-compute[75246]:     <system>
Nov 28 17:27:19 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:27:19 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:27:19 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:27:19 user nova-compute[75246]:       <entry name="serial">aa6b050c-ffd6-4a40-ab64-59f7ae8bef78</entry>
Nov 28 17:27:19 user nova-compute[75246]:       <entry name="uuid">aa6b050c-ffd6-4a40-ab64-59f7ae8bef78</entry>
Nov 28 17:27:19 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:27:19 user nova-compute[75246]:     </system>
Nov 28 17:27:19 user nova-compute[75246]:   </sysinfo>
Nov 28 17:27:19 user nova-compute[75246]:   <os>
Nov 28 17:27:19 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:27:19 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:27:19 user nova-compute[75246]:   </os>
Nov 28 17:27:19 user nova-compute[75246]:   <features>
Nov 28 17:27:19 user nova-compute[75246]:     <acpi/>
Nov 28 17:27:19 user nova-compute[75246]:     <apic/>
Nov 28 17:27:19 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:27:19 user nova-compute[75246]:   </features>
Nov 28 17:27:19 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:27:19 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:27:19 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:27:19 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:27:19 user nova-compute[75246]:   </clock>
Nov 28 17:27:19 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:27:19 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:27:19 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:27:19 user nova-compute[75246]:   </cpu>
Nov 28 17:27:19 user nova-compute[75246]:   <devices>
Nov 28 17:27:19 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:27:19 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:27:19 user nova-compute[75246]:       <source dev="/dev/sdf"/>
Nov 28 17:27:19 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:27:19 user nova-compute[75246]:       <serial>168870a5-6858-4a8f-82ea-514b95a8b19f</serial>
Nov 28 17:27:19 user nova-compute[75246]:     </disk>
Nov 28 17:27:19 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:27:19 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:27:19 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78/disk.rescue"/>
Nov 28 17:27:19 user nova-compute[75246]:       <target dev="vdb" bus="virtio"/>
Nov 28 17:27:19 user nova-compute[75246]:       <boot order="1"/>
Nov 28 17:27:19 user nova-compute[75246]:     </disk>
Nov 28 17:27:19 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:27:19 user nova-compute[75246]:       <mac address="fa:16:3e:5c:ed:e4"/>
Nov 28 17:27:19 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:27:19 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:27:19 user nova-compute[75246]:       <target dev="tapdc3270f2-af"/>
Nov 28 17:27:19 user nova-compute[75246]:     </interface>
Nov 28 17:27:19 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:27:19 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78/console.log" append="off"/>
Nov 28 17:27:19 user nova-compute[75246]:     </serial>
Nov 28 17:27:19 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:27:19 user nova-compute[75246]:     <video>
Nov 28 17:27:19 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:27:19 user nova-compute[75246]:     </video>
Nov 28 17:27:19 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:27:19 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:27:19 user nova-compute[75246]:     </rng>
Nov 28 17:27:19 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:27:19 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:27:19 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:27:19 user nova-compute[75246]:     </memballoon>
Nov 28 17:27:19 user nova-compute[75246]:   </devices>
Nov 28 17:27:19 user nova-compute[75246]: </domain>
Nov 28 17:27:19 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:27:19 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Instance destroyed successfully.
Nov 28 17:27:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:27:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] No VIF found with MAC fa:16:3e:5c:ed:e4, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:27:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-cc3f066a-b7b3-4a18-9201-df2b569a8cc4 req-89d946fc-a4ea-48d8-bb05-9bcde709e812 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received event network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cc3f066a-b7b3-4a18-9201-df2b569a8cc4 req-89d946fc-a4ea-48d8-bb05-9bcde709e812 service nova] Acquiring lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cc3f066a-b7b3-4a18-9201-df2b569a8cc4 req-89d946fc-a4ea-48d8-bb05-9bcde709e812 service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cc3f066a-b7b3-4a18-9201-df2b569a8cc4 req-89d946fc-a4ea-48d8-bb05-9bcde709e812 service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:20 user nova-compute[75246]: DEBUG nova.compute.manager [req-cc3f066a-b7b3-4a18-9201-df2b569a8cc4 req-89d946fc-a4ea-48d8-bb05-9bcde709e812 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] No waiting events found dispatching network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:27:20 user nova-compute[75246]: WARNING nova.compute.manager [req-cc3f066a-b7b3-4a18-9201-df2b569a8cc4 req-89d946fc-a4ea-48d8-bb05-9bcde709e812 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received unexpected event network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 for instance with vm_state active and task_state rescuing.
Nov 28 17:27:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:22 user nova-compute[75246]: DEBUG nova.compute.manager [None req-42552d11-e91d-48cb-ae72-2d94cbb0bd65 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:27:22 user nova-compute[75246]: DEBUG nova.compute.manager [req-806de5d0-4c66-4434-95ff-090b73b5ea7c req-440ba675-9647-4ba5-b601-61e9182dfc40 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received event network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-806de5d0-4c66-4434-95ff-090b73b5ea7c req-440ba675-9647-4ba5-b601-61e9182dfc40 service nova] Acquiring lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-806de5d0-4c66-4434-95ff-090b73b5ea7c req-440ba675-9647-4ba5-b601-61e9182dfc40 service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:22 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-806de5d0-4c66-4434-95ff-090b73b5ea7c req-440ba675-9647-4ba5-b601-61e9182dfc40 service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:22 user nova-compute[75246]: DEBUG nova.compute.manager [req-806de5d0-4c66-4434-95ff-090b73b5ea7c req-440ba675-9647-4ba5-b601-61e9182dfc40 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] No waiting events found dispatching network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:27:22 user nova-compute[75246]: WARNING nova.compute.manager [req-806de5d0-4c66-4434-95ff-090b73b5ea7c req-440ba675-9647-4ba5-b601-61e9182dfc40 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received unexpected event network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 for instance with vm_state rescued and task_state None.
Nov 28 17:27:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:27:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:41 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:27:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:42 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:27:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:27:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:27:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:27:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:43 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:27:43 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:27:43 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8442MB free_disk=24.99309539794922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:27:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:43 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:27:43 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a796152e-e8df-41bf-a5ea-ae94d4fa8b41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:27:43 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance ae257aa8-78c3-499e-a5cf-1021deefe6d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:27:43 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance f7c26790-8596-4151-94f3-e5bfa9fb7586 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:27:43 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance aa6b050c-ffd6-4a40-ab64-59f7ae8bef78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:27:43 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:27:43 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:27:43 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:27:43 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:27:43 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:27:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-52bc3741-c3b0-4933-9628-03050b686c4f req-5d9a7baf-56e2-4539-8837-0bb646d78aa8 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received event network-changed-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-52bc3741-c3b0-4933-9628-03050b686c4f req-5d9a7baf-56e2-4539-8837-0bb646d78aa8 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Refreshing instance network info cache due to event network-changed-034ab47e-b974-4aab-b608-25f52c0fea75. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:27:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-52bc3741-c3b0-4933-9628-03050b686c4f req-5d9a7baf-56e2-4539-8837-0bb646d78aa8 service nova] Acquiring lock "refresh_cache-f7c26790-8596-4151-94f3-e5bfa9fb7586" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:27:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-52bc3741-c3b0-4933-9628-03050b686c4f req-5d9a7baf-56e2-4539-8837-0bb646d78aa8 service nova] Acquired lock "refresh_cache-f7c26790-8596-4151-94f3-e5bfa9fb7586" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:27:44 user nova-compute[75246]: DEBUG nova.network.neutron [req-52bc3741-c3b0-4933-9628-03050b686c4f req-5d9a7baf-56e2-4539-8837-0bb646d78aa8 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Refreshing network info cache for port 034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:27:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "f7c26790-8596-4151-94f3-e5bfa9fb7586" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:44 user nova-compute[75246]: INFO nova.compute.manager [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Terminating instance
Nov 28 17:27:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG nova.network.neutron [req-52bc3741-c3b0-4933-9628-03050b686c4f req-5d9a7baf-56e2-4539-8837-0bb646d78aa8 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Updated VIF entry in instance network info cache for port 034ab47e-b974-4aab-b608-25f52c0fea75. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG nova.network.neutron [req-52bc3741-c3b0-4933-9628-03050b686c4f req-5d9a7baf-56e2-4539-8837-0bb646d78aa8 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Updating instance_info_cache with network_info: [{"id": "034ab47e-b974-4aab-b608-25f52c0fea75", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034ab47e-b9", "ovs_interfaceid": "034ab47e-b974-4aab-b608-25f52c0fea75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-52bc3741-c3b0-4933-9628-03050b686c4f req-5d9a7baf-56e2-4539-8837-0bb646d78aa8 service nova] Releasing lock "refresh_cache-f7c26790-8596-4151-94f3-e5bfa9fb7586" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:45 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Instance destroyed successfully.
Nov 28 17:27:45 user nova-compute[75246]: DEBUG nova.objects.instance [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lazy-loading 'resources' on Instance uuid f7c26790-8596-4151-94f3-e5bfa9fb7586 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:22:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-163192544',display_name='tempest-TestVolumeBootPattern-server-163192544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-163192544',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrg6dgmwLxM+qOiUQmkZP+lby3sIcjedzAt6Qr2Vg5lrRzmZuOCIGPTCAvsPt68uI6UbSOJN/oyUTe5OqihGAovpc3vgI5qK/6ApsKxZfDXJBHGmnIe3WgtSfAKkR6e4g==',key_name='tempest-TestVolumeBootPattern-1591090964',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe0eebdd39c54a74be8d2e0f9842b165',ramdisk_id='',reservation_id='r-006oh214',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-389869337',owner_user_name='tempest-TestVolumeBootPattern-389869337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:23:07Z,user_data=None,user_id='c334f73c5bf1473aadf865c8f032c0cb',uuid=f7c26790-8596-4151-94f3-e5bfa9fb7586,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "034ab47e-b974-4aab-b608-25f52c0fea75", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034ab47e-b9", "ovs_interfaceid": "034ab47e-b974-4aab-b608-25f52c0fea75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converting VIF {"id": "034ab47e-b974-4aab-b608-25f52c0fea75", "address": "fa:16:3e:f0:1b:b0", "network": {"id": "a1fd50f2-5a20-4747-859d-5abe993eeec8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1660948480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe0eebdd39c54a74be8d2e0f9842b165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034ab47e-b9", "ovs_interfaceid": "034ab47e-b974-4aab-b608-25f52c0fea75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:1b:b0,bridge_name='br-int',has_traffic_filtering=True,id=034ab47e-b974-4aab-b608-25f52c0fea75,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap034ab47e-b9') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG os_vif [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:1b:b0,bridge_name='br-int',has_traffic_filtering=True,id=034ab47e-b974-4aab-b608-25f52c0fea75,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap034ab47e-b9') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap034ab47e-b9, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a94d9e0c-cfba-4832-83d8-f53162a5acfa) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:45 user nova-compute[75246]: INFO os_vif [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:1b:b0,bridge_name='br-int',has_traffic_filtering=True,id=034ab47e-b974-4aab-b608-25f52c0fea75,network=Network(a1fd50f2-5a20-4747-859d-5abe993eeec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap034ab47e-b9')
Nov 28 17:27:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goEuwIjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:27:45 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:27:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c21e4f-ccee-4e59-a8b0-26ffbefaaba2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:27:45 user nova-compute[75246]: No targets found.
Nov 28 17:27:45 user nova-compute[75246]: iSNS:
Nov 28 17:27:45 user nova-compute[75246]: No targets found.
Nov 28 17:27:45 user nova-compute[75246]: STATIC:
Nov 28 17:27:45 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75
Nov 28 17:27:45 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:27:45 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:27:45 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f
Nov 28 17:27:45 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:27:45 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:27:45 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:27:45 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:27:45 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:27:45 user nova-compute[75246]: FIRMWARE:
Nov 28 17:27:45 user nova-compute[75246]: No targets found.
Nov 28 17:27:45 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:27:45 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:27:45 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[112fb511-25e2-4b46-9b92-4246242e2108]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc4da5d-5ebe-4534-9208-1a85543042dd]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:27:45 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:27:45 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:27:45 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:27:45 user nova-compute[75246]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 (non-flash)
Nov 28 17:27:45 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:27:45 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d83625f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75'): ({'sdd'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Removing single pathed devices sdd {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ab0bff-ab94-46f8-965c-ed4d4f48e94d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6697373a-86dd-45b2-92a4-d010d13eab70]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Flushing IO for device /dev/sdd {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:27:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2bd20c-683f-493b-9a4c-208f5597afb0]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.067s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4339c3e-bbf3-424b-8394-4a6cf6d1fe35]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_abe17e3', '/dev/disk/by-id/scsi-23538666564313061', '/dev/disk/by-id/scsi-1SCST_BIOabe17e3-58fed10a6db5a785') {{(pid=85745) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8087b53-8ff7-4bf2-86c0-0a7aff0c69ca]: (4, None) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e8c637-3f03-4c51-a02b-875a0893fd08]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f88b843-802b-469d-87d1-f5f88801df7e]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75, portal: 172.16.0.220,3260]
Nov 28 17:27:46 user nova-compute[75246]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75, portal: 172.16.0.220,3260] successful.
Nov 28 17:27:46 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816a4875-3799-4b5e-aac5-f1461aca0f75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d462b39-f94a-407a-9e5a-54fef46c2341]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] <== disconnect_volume: return (386ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:27:46 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Deleting instance files /opt/stack/data/nova/instances/f7c26790-8596-4151-94f3-e5bfa9fb7586_del
Nov 28 17:27:46 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Deletion of /opt/stack/data/nova/instances/f7c26790-8596-4151-94f3-e5bfa9fb7586_del complete
Nov 28 17:27:46 user nova-compute[75246]: INFO nova.compute.manager [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:27:46 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Took 0.56 seconds to deallocate network for instance.
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-67ee685b-548f-482d-823a-bfa740f748dc req-eb3c8617-7ff4-4b78-9715-3d7ab6a16acd service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received event network-vif-deleted-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received event network-vif-unplugged-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] Acquiring lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] No waiting events found dispatching network-vif-unplugged-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received event network-vif-unplugged-034ab47e-b974-4aab-b608-25f52c0fea75 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received event network-vif-plugged-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] Acquiring lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] No waiting events found dispatching network-vif-plugged-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:27:46 user nova-compute[75246]: WARNING nova.compute.manager [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received unexpected event network-vif-plugged-034ab47e-b974-4aab-b608-25f52c0fea75 for instance with vm_state active and task_state deleting.
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received event network-vif-plugged-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] Acquiring lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] No waiting events found dispatching network-vif-plugged-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:27:46 user nova-compute[75246]: WARNING nova.compute.manager [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received unexpected event network-vif-plugged-034ab47e-b974-4aab-b608-25f52c0fea75 for instance with vm_state active and task_state deleting.
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received event network-vif-plugged-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] Acquiring lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] No waiting events found dispatching network-vif-plugged-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:27:46 user nova-compute[75246]: WARNING nova.compute.manager [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received unexpected event network-vif-plugged-034ab47e-b974-4aab-b608-25f52c0fea75 for instance with vm_state active and task_state deleting.
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received event network-vif-unplugged-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] Acquiring lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] No waiting events found dispatching network-vif-unplugged-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received event network-vif-unplugged-034ab47e-b974-4aab-b608-25f52c0fea75 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received event network-vif-plugged-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] Acquiring lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] No waiting events found dispatching network-vif-plugged-034ab47e-b974-4aab-b608-25f52c0fea75 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:27:46 user nova-compute[75246]: WARNING nova.compute.manager [req-a0a52745-5f54-4780-99b2-6ed979f7b182 req-611bfc4c-5ae9-4cef-918e-936664e74a68 service nova] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Received unexpected event network-vif-plugged-034ab47e-b974-4aab-b608-25f52c0fea75 for instance with vm_state active and task_state deleting.
Nov 28 17:27:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:47 user nova-compute[75246]: INFO nova.compute.manager [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] [instance: f7c26790-8596-4151-94f3-e5bfa9fb7586] Took 0.75 seconds to detach 1 volumes for instance.
Nov 28 17:27:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:47 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:27:47 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:27:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:47 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Deleted allocations for instance f7c26790-8596-4151-94f3-e5bfa9fb7586
Nov 28 17:27:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-0104d2d5-446d-4815-9c9e-2fd191363be5 tempest-TestVolumeBootPattern-389869337 tempest-TestVolumeBootPattern-389869337-project-member] Lock "f7c26790-8596-4151-94f3-e5bfa9fb7586" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.087s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:48 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:27:48 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:27:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:51 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:27:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:27:56 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:27:56 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:27:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:27:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:27:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:27:58 user nova-compute[75246]: INFO nova.compute.claims [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Claim successful on node user
Nov 28 17:27:58 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:27:58 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:27:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:58 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:27:58 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:27:58 user nova-compute[75246]: DEBUG nova.network.neutron [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:27:58 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:27:58 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:27:58 user nova-compute[75246]: DEBUG nova.policy [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0c78d20df77421389d4fb0c5a6d2add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5e8b8b1dc2469bb172fdc843b8f39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:27:58 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:27:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:27:58 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Creating image(s)
Nov 28 17:27:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "/opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "/opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.189s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk 1073741824" returned: 0 in 0.051s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:27:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:59 user nova-compute[75246]: DEBUG nova.network.neutron [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Successfully created port: 747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:27:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.212s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:59 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:27:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:27:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:27:59 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Cannot resize image /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:27:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:27:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Ensure instance console log exists: /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:27:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:27:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:27:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.network.neutron [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Successfully updated port: 747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquired lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.network.neutron [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-357d7a5e-199e-44c5-aba5-7ee4c604b27b req-c97916f8-879e-4bf4-876b-f5edd3249550 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received event network-changed-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-357d7a5e-199e-44c5-aba5-7ee4c604b27b req-c97916f8-879e-4bf4-876b-f5edd3249550 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Refreshing instance network info cache due to event network-changed-747a269b-3828-4182-b28d-8656cbcdfcfb. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-357d7a5e-199e-44c5-aba5-7ee4c604b27b req-c97916f8-879e-4bf4-876b-f5edd3249550 service nova] Acquiring lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.network.neutron [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.network.neutron [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updating instance_info_cache with network_info: [{"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Releasing lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Instance network_info: |[{"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-357d7a5e-199e-44c5-aba5-7ee4c604b27b req-c97916f8-879e-4bf4-876b-f5edd3249550 service nova] Acquired lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.network.neutron [req-357d7a5e-199e-44c5-aba5-7ee4c604b27b req-c97916f8-879e-4bf4-876b-f5edd3249550 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Refreshing network info cache for port 747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Start _get_guest_xml network_info=[{"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:28:00 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:28:00 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-293166483',display_name='tempest-AttachVolumeTestJSON-server-293166483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-293166483',id=50,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqe0fw+kudngaeCOPjFm0lglWTUIvqOQoZjQoYYQ9pcKjeJDQFeO5BSrL84EkaMlPyRW3L6sgdr0rYGfEMmOz0UEjXhN0KEjP44F28rNwSbmltWXOH66c/sbByz6lIy7Q==',key_name='tempest-keypair-1328117536',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce5e8b8b1dc2469bb172fdc843b8f39c',ramdisk_id='',reservation_id='r-hhnksif4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-32273339',owner_user_name='tempest-AttachVolumeTestJSON-32273339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:27:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c78d20df77421389d4fb0c5a6d2add',uuid=a4be3afd-5e52-4915-9cfe-83bf205d3c19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converting VIF {"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.objects.instance [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'pci_devices' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:28:00 user nova-compute[75246]:   <uuid>a4be3afd-5e52-4915-9cfe-83bf205d3c19</uuid>
Nov 28 17:28:00 user nova-compute[75246]:   <name>instance-00000032</name>
Nov 28 17:28:00 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:28:00 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:28:00 user nova-compute[75246]:   <metadata>
Nov 28 17:28:00 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:28:00 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:28:00 user nova-compute[75246]:       <nova:name>tempest-AttachVolumeTestJSON-server-293166483</nova:name>
Nov 28 17:28:00 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:28:00</nova:creationTime>
Nov 28 17:28:00 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:28:00 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:28:00 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:28:00 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:28:00 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:28:00 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:28:00 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:28:00 user nova-compute[75246]:       <nova:owner>
Nov 28 17:28:00 user nova-compute[75246]:         <nova:user uuid="c0c78d20df77421389d4fb0c5a6d2add">tempest-AttachVolumeTestJSON-32273339-project-member</nova:user>
Nov 28 17:28:00 user nova-compute[75246]:         <nova:project uuid="ce5e8b8b1dc2469bb172fdc843b8f39c">tempest-AttachVolumeTestJSON-32273339</nova:project>
Nov 28 17:28:00 user nova-compute[75246]:       </nova:owner>
Nov 28 17:28:00 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:28:00 user nova-compute[75246]:       <nova:ports>
Nov 28 17:28:00 user nova-compute[75246]:         <nova:port uuid="747a269b-3828-4182-b28d-8656cbcdfcfb">
Nov 28 17:28:00 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 17:28:00 user nova-compute[75246]:         </nova:port>
Nov 28 17:28:00 user nova-compute[75246]:       </nova:ports>
Nov 28 17:28:00 user nova-compute[75246]:     </nova:instance>
Nov 28 17:28:00 user nova-compute[75246]:   </metadata>
Nov 28 17:28:00 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:28:00 user nova-compute[75246]:     <system>
Nov 28 17:28:00 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:28:00 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:28:00 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:28:00 user nova-compute[75246]:       <entry name="serial">a4be3afd-5e52-4915-9cfe-83bf205d3c19</entry>
Nov 28 17:28:00 user nova-compute[75246]:       <entry name="uuid">a4be3afd-5e52-4915-9cfe-83bf205d3c19</entry>
Nov 28 17:28:00 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:28:00 user nova-compute[75246]:     </system>
Nov 28 17:28:00 user nova-compute[75246]:   </sysinfo>
Nov 28 17:28:00 user nova-compute[75246]:   <os>
Nov 28 17:28:00 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:28:00 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:28:00 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:28:00 user nova-compute[75246]:   </os>
Nov 28 17:28:00 user nova-compute[75246]:   <features>
Nov 28 17:28:00 user nova-compute[75246]:     <acpi/>
Nov 28 17:28:00 user nova-compute[75246]:     <apic/>
Nov 28 17:28:00 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:28:00 user nova-compute[75246]:   </features>
Nov 28 17:28:00 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:28:00 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:28:00 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:28:00 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:28:00 user nova-compute[75246]:   </clock>
Nov 28 17:28:00 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:28:00 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:28:00 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:28:00 user nova-compute[75246]:   </cpu>
Nov 28 17:28:00 user nova-compute[75246]:   <devices>
Nov 28 17:28:00 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:28:00 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:28:00 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk"/>
Nov 28 17:28:00 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:28:00 user nova-compute[75246]:     </disk>
Nov 28 17:28:00 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:28:00 user nova-compute[75246]:       <mac address="fa:16:3e:e0:a4:7b"/>
Nov 28 17:28:00 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:28:00 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:28:00 user nova-compute[75246]:       <target dev="tap747a269b-38"/>
Nov 28 17:28:00 user nova-compute[75246]:     </interface>
Nov 28 17:28:00 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:28:00 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/console.log" append="off"/>
Nov 28 17:28:00 user nova-compute[75246]:     </serial>
Nov 28 17:28:00 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:28:00 user nova-compute[75246]:     <video>
Nov 28 17:28:00 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:28:00 user nova-compute[75246]:     </video>
Nov 28 17:28:00 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:28:00 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:28:00 user nova-compute[75246]:     </rng>
Nov 28 17:28:00 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:28:00 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:28:00 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:28:00 user nova-compute[75246]:     </memballoon>
Nov 28 17:28:00 user nova-compute[75246]:   </devices>
Nov 28 17:28:00 user nova-compute[75246]: </domain>
Nov 28 17:28:00 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-293166483',display_name='tempest-AttachVolumeTestJSON-server-293166483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-293166483',id=50,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqe0fw+kudngaeCOPjFm0lglWTUIvqOQoZjQoYYQ9pcKjeJDQFeO5BSrL84EkaMlPyRW3L6sgdr0rYGfEMmOz0UEjXhN0KEjP44F28rNwSbmltWXOH66c/sbByz6lIy7Q==',key_name='tempest-keypair-1328117536',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce5e8b8b1dc2469bb172fdc843b8f39c',ramdisk_id='',reservation_id='r-hhnksif4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-32273339',owner_user_name='tempest-AttachVolumeTestJSON-32273339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:27:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c78d20df77421389d4fb0c5a6d2add',uuid=a4be3afd-5e52-4915-9cfe-83bf205d3c19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converting VIF {"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG os_vif [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b1e92a0-1b25-5fa3-ae66-8750ca8cad08', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap747a269b-38, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap747a269b-38, col_values=(('qos', UUID('17bfd879-6f92-4451-851c-c85963bd6460')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap747a269b-38, col_values=(('external_ids', {'iface-id': '747a269b-3828-4182-b28d-8656cbcdfcfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:a4:7b', 'vm-uuid': 'a4be3afd-5e52-4915-9cfe-83bf205d3c19'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:00 user nova-compute[75246]: INFO os_vif [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38')
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:28:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] No VIF found with MAC fa:16:3e:e0:a4:7b, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:28:01 user nova-compute[75246]: DEBUG nova.network.neutron [req-357d7a5e-199e-44c5-aba5-7ee4c604b27b req-c97916f8-879e-4bf4-876b-f5edd3249550 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updated VIF entry in instance network info cache for port 747a269b-3828-4182-b28d-8656cbcdfcfb. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:28:01 user nova-compute[75246]: DEBUG nova.network.neutron [req-357d7a5e-199e-44c5-aba5-7ee4c604b27b req-c97916f8-879e-4bf4-876b-f5edd3249550 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updating instance_info_cache with network_info: [{"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:28:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-357d7a5e-199e-44c5-aba5-7ee4c604b27b req-c97916f8-879e-4bf4-876b-f5edd3249550 service nova] Releasing lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:28:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:28:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:28:01 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:28:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:28:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:28:01 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:28:01 user nova-compute[75246]: INFO nova.compute.claims [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Claim successful on node user
Nov 28 17:28:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-22db8da0-9c26-4b2f-9542-7c15d2926b3f req-c160737f-3aff-48a0-b60e-7aac68a24351 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received event network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-22db8da0-9c26-4b2f-9542-7c15d2926b3f req-c160737f-3aff-48a0-b60e-7aac68a24351 service nova] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-22db8da0-9c26-4b2f-9542-7c15d2926b3f req-c160737f-3aff-48a0-b60e-7aac68a24351 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-22db8da0-9c26-4b2f-9542-7c15d2926b3f req-c160737f-3aff-48a0-b60e-7aac68a24351 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-22db8da0-9c26-4b2f-9542-7c15d2926b3f req-c160737f-3aff-48a0-b60e-7aac68a24351 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] No waiting events found dispatching network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:28:02 user nova-compute[75246]: WARNING nova.compute.manager [req-22db8da0-9c26-4b2f-9542-7c15d2926b3f req-c160737f-3aff-48a0-b60e-7aac68a24351 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received unexpected event network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb for instance with vm_state building and task_state spawning.
Nov 28 17:28:02 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG nova.network.neutron [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:28:02 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:28:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG nova.policy [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '124d4cbebf644cd1a6de6aeccd4d4030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c961f690054959a9a92a3383ff6ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:28:02 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Creating image(s)
Nov 28 17:28:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "/opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "/opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:28:02 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/disk 1073741824" returned: 0 in 0.054s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG nova.network.neutron [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Successfully created port: d37fdc36-acc4-4419-a9e1-d7063b072c67 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.204s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Cannot resize image /opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Ensure instance console log exists: /opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG nova.network.neutron [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Successfully updated port: d37fdc36-acc4-4419-a9e1-d7063b072c67 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "refresh_cache-c2227a63-14e7-498f-b8f5-3bf0fc9802ab" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquired lock "refresh_cache-c2227a63-14e7-498f-b8f5-3bf0fc9802ab" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG nova.network.neutron [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-9c19ed70-7471-4f3e-8890-82635b2365a8 req-d959a434-85a8-4e5d-895c-6314fc10a67b service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Received event network-changed-d37fdc36-acc4-4419-a9e1-d7063b072c67 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG nova.compute.manager [req-9c19ed70-7471-4f3e-8890-82635b2365a8 req-d959a434-85a8-4e5d-895c-6314fc10a67b service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Refreshing instance network info cache due to event network-changed-d37fdc36-acc4-4419-a9e1-d7063b072c67. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9c19ed70-7471-4f3e-8890-82635b2365a8 req-d959a434-85a8-4e5d-895c-6314fc10a67b service nova] Acquiring lock "refresh_cache-c2227a63-14e7-498f-b8f5-3bf0fc9802ab" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG nova.network.neutron [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG nova.network.neutron [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Updating instance_info_cache with network_info: [{"id": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "address": "fa:16:3e:82:b2:e2", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37fdc36-ac", "ovs_interfaceid": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:28:03 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Instance spawned successfully.
Nov 28 17:28:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Releasing lock "refresh_cache-c2227a63-14e7-498f-b8f5-3bf0fc9802ab" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Instance network_info: |[{"id": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "address": "fa:16:3e:82:b2:e2", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37fdc36-ac", "ovs_interfaceid": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9c19ed70-7471-4f3e-8890-82635b2365a8 req-d959a434-85a8-4e5d-895c-6314fc10a67b service nova] Acquired lock "refresh_cache-c2227a63-14e7-498f-b8f5-3bf0fc9802ab" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG nova.network.neutron [req-9c19ed70-7471-4f3e-8890-82635b2365a8 req-d959a434-85a8-4e5d-895c-6314fc10a67b service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Refreshing network info cache for port d37fdc36-acc4-4419-a9e1-d7063b072c67 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:28:03 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Start _get_guest_xml network_info=[{"id": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "address": "fa:16:3e:82:b2:e2", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37fdc36-ac", "ovs_interfaceid": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:28:03 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:28:03 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:28:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-96884646',display_name='tempest-VolumesSnapshotTestJSON-instance-96884646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-96884646',id=51,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPKN4V8nqhsWoYNiYzc4QAjzthwDJUquADTOgS2/4APUJmo7aljAQ/U97l896wNPsn/XAIZT0oW24r6sRTVE4Kn7xF659VBJtNBVc0nDKb9TqLuhR8Upksa6tROIWwxmA==',key_name='tempest-keypair-741947439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45c961f690054959a9a92a3383ff6ff7',ramdisk_id='',reservation_id='r-jhj8slog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1977855474',owner_user_name='tempest-VolumesSnapshotTestJSON-1977855474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124d4cbebf644cd1a6de6aeccd4d4030',uuid=c2227a63-14e7-498f-b8f5-3bf0fc9802ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "address": "fa:16:3e:82:b2:e2", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37fdc36-ac", "ovs_interfaceid": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Converting VIF {"id": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "address": "fa:16:3e:82:b2:e2", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37fdc36-ac", "ovs_interfaceid": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:b2:e2,bridge_name='br-int',has_traffic_filtering=True,id=d37fdc36-acc4-4419-a9e1-d7063b072c67,network=Network(6297eef9-9b93-47d1-bffa-cd1a7cc5925b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd37fdc36-ac') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.objects.instance [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lazy-loading 'pci_devices' on Instance uuid c2227a63-14e7-498f-b8f5-3bf0fc9802ab {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-a9aff85e-96ee-41f4-b31c-ff069b2f5d02 req-d264585f-f0f8-400f-bf96-606154ee03d9 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received event network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a9aff85e-96ee-41f4-b31c-ff069b2f5d02 req-d264585f-f0f8-400f-bf96-606154ee03d9 service nova] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a9aff85e-96ee-41f4-b31c-ff069b2f5d02 req-d264585f-f0f8-400f-bf96-606154ee03d9 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-a9aff85e-96ee-41f4-b31c-ff069b2f5d02 req-d264585f-f0f8-400f-bf96-606154ee03d9 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-a9aff85e-96ee-41f4-b31c-ff069b2f5d02 req-d264585f-f0f8-400f-bf96-606154ee03d9 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] No waiting events found dispatching network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:28:04 user nova-compute[75246]: WARNING nova.compute.manager [req-a9aff85e-96ee-41f4-b31c-ff069b2f5d02 req-d264585f-f0f8-400f-bf96-606154ee03d9 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received unexpected event network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb for instance with vm_state building and task_state spawning.
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:28:04 user nova-compute[75246]:   <uuid>c2227a63-14e7-498f-b8f5-3bf0fc9802ab</uuid>
Nov 28 17:28:04 user nova-compute[75246]:   <name>instance-00000033</name>
Nov 28 17:28:04 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:28:04 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:28:04 user nova-compute[75246]:   <metadata>
Nov 28 17:28:04 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:28:04 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:28:04 user nova-compute[75246]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-96884646</nova:name>
Nov 28 17:28:04 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:28:03</nova:creationTime>
Nov 28 17:28:04 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:28:04 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:28:04 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:28:04 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:28:04 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:28:04 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:28:04 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:28:04 user nova-compute[75246]:       <nova:owner>
Nov 28 17:28:04 user nova-compute[75246]:         <nova:user uuid="124d4cbebf644cd1a6de6aeccd4d4030">tempest-VolumesSnapshotTestJSON-1977855474-project-member</nova:user>
Nov 28 17:28:04 user nova-compute[75246]:         <nova:project uuid="45c961f690054959a9a92a3383ff6ff7">tempest-VolumesSnapshotTestJSON-1977855474</nova:project>
Nov 28 17:28:04 user nova-compute[75246]:       </nova:owner>
Nov 28 17:28:04 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:28:04 user nova-compute[75246]:       <nova:ports>
Nov 28 17:28:04 user nova-compute[75246]:         <nova:port uuid="d37fdc36-acc4-4419-a9e1-d7063b072c67">
Nov 28 17:28:04 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 17:28:04 user nova-compute[75246]:         </nova:port>
Nov 28 17:28:04 user nova-compute[75246]:       </nova:ports>
Nov 28 17:28:04 user nova-compute[75246]:     </nova:instance>
Nov 28 17:28:04 user nova-compute[75246]:   </metadata>
Nov 28 17:28:04 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:28:04 user nova-compute[75246]:     <system>
Nov 28 17:28:04 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:28:04 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:28:04 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:28:04 user nova-compute[75246]:       <entry name="serial">c2227a63-14e7-498f-b8f5-3bf0fc9802ab</entry>
Nov 28 17:28:04 user nova-compute[75246]:       <entry name="uuid">c2227a63-14e7-498f-b8f5-3bf0fc9802ab</entry>
Nov 28 17:28:04 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:28:04 user nova-compute[75246]:     </system>
Nov 28 17:28:04 user nova-compute[75246]:   </sysinfo>
Nov 28 17:28:04 user nova-compute[75246]:   <os>
Nov 28 17:28:04 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:28:04 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:28:04 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:28:04 user nova-compute[75246]:   </os>
Nov 28 17:28:04 user nova-compute[75246]:   <features>
Nov 28 17:28:04 user nova-compute[75246]:     <acpi/>
Nov 28 17:28:04 user nova-compute[75246]:     <apic/>
Nov 28 17:28:04 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:28:04 user nova-compute[75246]:   </features>
Nov 28 17:28:04 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:28:04 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:28:04 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:28:04 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:28:04 user nova-compute[75246]:   </clock>
Nov 28 17:28:04 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:28:04 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:28:04 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:28:04 user nova-compute[75246]:   </cpu>
Nov 28 17:28:04 user nova-compute[75246]:   <devices>
Nov 28 17:28:04 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:28:04 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:28:04 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/disk"/>
Nov 28 17:28:04 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:28:04 user nova-compute[75246]:     </disk>
Nov 28 17:28:04 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:28:04 user nova-compute[75246]:       <mac address="fa:16:3e:82:b2:e2"/>
Nov 28 17:28:04 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:28:04 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:28:04 user nova-compute[75246]:       <target dev="tapd37fdc36-ac"/>
Nov 28 17:28:04 user nova-compute[75246]:     </interface>
Nov 28 17:28:04 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:28:04 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/console.log" append="off"/>
Nov 28 17:28:04 user nova-compute[75246]:     </serial>
Nov 28 17:28:04 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:28:04 user nova-compute[75246]:     <video>
Nov 28 17:28:04 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:28:04 user nova-compute[75246]:     </video>
Nov 28 17:28:04 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:28:04 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:28:04 user nova-compute[75246]:     </rng>
Nov 28 17:28:04 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:28:04 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:28:04 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:28:04 user nova-compute[75246]:     </memballoon>
Nov 28 17:28:04 user nova-compute[75246]:   </devices>
Nov 28 17:28:04 user nova-compute[75246]: </domain>
Nov 28 17:28:04 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:28:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-96884646',display_name='tempest-VolumesSnapshotTestJSON-instance-96884646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-96884646',id=51,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPKN4V8nqhsWoYNiYzc4QAjzthwDJUquADTOgS2/4APUJmo7aljAQ/U97l896wNPsn/XAIZT0oW24r6sRTVE4Kn7xF659VBJtNBVc0nDKb9TqLuhR8Upksa6tROIWwxmA==',key_name='tempest-keypair-741947439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45c961f690054959a9a92a3383ff6ff7',ramdisk_id='',reservation_id='r-jhj8slog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1977855474',owner_user_name='tempest-VolumesSnapshotTestJSON-1977855474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124d4cbebf644cd1a6de6aeccd4d4030',uuid=c2227a63-14e7-498f-b8f5-3bf0fc9802ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "address": "fa:16:3e:82:b2:e2", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37fdc36-ac", "ovs_interfaceid": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Converting VIF {"id": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "address": "fa:16:3e:82:b2:e2", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37fdc36-ac", "ovs_interfaceid": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:b2:e2,bridge_name='br-int',has_traffic_filtering=True,id=d37fdc36-acc4-4419-a9e1-d7063b072c67,network=Network(6297eef9-9b93-47d1-bffa-cd1a7cc5925b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd37fdc36-ac') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG os_vif [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:b2:e2,bridge_name='br-int',has_traffic_filtering=True,id=d37fdc36-acc4-4419-a9e1-d7063b072c67,network=Network(6297eef9-9b93-47d1-bffa-cd1a7cc5925b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd37fdc36-ac') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:28:04 user nova-compute[75246]: INFO nova.compute.manager [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.compute.manager [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37171891-03ab-5a6a-a506-1fe011a0c3e2', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd37fdc36-ac, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd37fdc36-ac, col_values=(('qos', UUID('40ec1944-c34d-4439-821f-2df070ba7351')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd37fdc36-ac, col_values=(('external_ids', {'iface-id': 'd37fdc36-acc4-4419-a9e1-d7063b072c67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:b2:e2', 'vm-uuid': 'c2227a63-14e7-498f-b8f5-3bf0fc9802ab'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:04 user nova-compute[75246]: INFO os_vif [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:b2:e2,bridge_name='br-int',has_traffic_filtering=True,id=d37fdc36-acc4-4419-a9e1-d7063b072c67,network=Network(6297eef9-9b93-47d1-bffa-cd1a7cc5925b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd37fdc36-ac')
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] No VIF found with MAC fa:16:3e:82:b2:e2, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:28:04 user nova-compute[75246]: INFO nova.compute.manager [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Took 6.18 seconds to build instance.
Nov 28 17:28:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-f0563fcc-7f9e-481b-8c8f-e8576816d481 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.295s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.network.neutron [req-9c19ed70-7471-4f3e-8890-82635b2365a8 req-d959a434-85a8-4e5d-895c-6314fc10a67b service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Updated VIF entry in instance network info cache for port d37fdc36-acc4-4419-a9e1-d7063b072c67. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG nova.network.neutron [req-9c19ed70-7471-4f3e-8890-82635b2365a8 req-d959a434-85a8-4e5d-895c-6314fc10a67b service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Updating instance_info_cache with network_info: [{"id": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "address": "fa:16:3e:82:b2:e2", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37fdc36-ac", "ovs_interfaceid": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:28:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9c19ed70-7471-4f3e-8890-82635b2365a8 req-d959a434-85a8-4e5d-895c-6314fc10a67b service nova] Releasing lock "refresh_cache-c2227a63-14e7-498f-b8f5-3bf0fc9802ab" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:28:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-55a0235d-0ca0-4fcd-9c77-02802f1920dd req-1e630a64-9b5c-485e-9500-204e68a92b10 service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Received event network-vif-plugged-d37fdc36-acc4-4419-a9e1-d7063b072c67 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:28:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-55a0235d-0ca0-4fcd-9c77-02802f1920dd req-1e630a64-9b5c-485e-9500-204e68a92b10 service nova] Acquiring lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:28:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-55a0235d-0ca0-4fcd-9c77-02802f1920dd req-1e630a64-9b5c-485e-9500-204e68a92b10 service nova] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:28:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-55a0235d-0ca0-4fcd-9c77-02802f1920dd req-1e630a64-9b5c-485e-9500-204e68a92b10 service nova] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:28:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-55a0235d-0ca0-4fcd-9c77-02802f1920dd req-1e630a64-9b5c-485e-9500-204e68a92b10 service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] No waiting events found dispatching network-vif-plugged-d37fdc36-acc4-4419-a9e1-d7063b072c67 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:28:06 user nova-compute[75246]: WARNING nova.compute.manager [req-55a0235d-0ca0-4fcd-9c77-02802f1920dd req-1e630a64-9b5c-485e-9500-204e68a92b10 service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Received unexpected event network-vif-plugged-d37fdc36-acc4-4419-a9e1-d7063b072c67 for instance with vm_state building and task_state spawning.
Nov 28 17:28:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-55a0235d-0ca0-4fcd-9c77-02802f1920dd req-1e630a64-9b5c-485e-9500-204e68a92b10 service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Received event network-vif-plugged-d37fdc36-acc4-4419-a9e1-d7063b072c67 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:28:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-55a0235d-0ca0-4fcd-9c77-02802f1920dd req-1e630a64-9b5c-485e-9500-204e68a92b10 service nova] Acquiring lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:28:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-55a0235d-0ca0-4fcd-9c77-02802f1920dd req-1e630a64-9b5c-485e-9500-204e68a92b10 service nova] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:28:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-55a0235d-0ca0-4fcd-9c77-02802f1920dd req-1e630a64-9b5c-485e-9500-204e68a92b10 service nova] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:28:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-55a0235d-0ca0-4fcd-9c77-02802f1920dd req-1e630a64-9b5c-485e-9500-204e68a92b10 service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] No waiting events found dispatching network-vif-plugged-d37fdc36-acc4-4419-a9e1-d7063b072c67 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:28:06 user nova-compute[75246]: WARNING nova.compute.manager [req-55a0235d-0ca0-4fcd-9c77-02802f1920dd req-1e630a64-9b5c-485e-9500-204e68a92b10 service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Received unexpected event network-vif-plugged-d37fdc36-acc4-4419-a9e1-d7063b072c67 for instance with vm_state building and task_state spawning.
Nov 28 17:28:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:28:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:28:07 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Instance spawned successfully.
Nov 28 17:28:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:28:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:28:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:28:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:28:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:28:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:28:07 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:28:07 user nova-compute[75246]: INFO nova.compute.manager [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 28 17:28:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:28:07 user nova-compute[75246]: INFO nova.compute.manager [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Took 6.07 seconds to build instance.
Nov 28 17:28:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b730a7c5-a7ea-4322-91fa-df04874ed02d tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.199s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:28:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:28:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:28:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:28:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:28:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:41 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:28:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:28:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:28:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:28:42 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:28:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:28:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:28:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:28:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78/disk.rescue --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:28:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:28:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:28:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:28:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:28:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:28:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:28:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:28:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:28:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:28:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:28:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:28:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:28:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:28:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:28:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:28:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:28:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:28:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:28:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:44 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:28:44 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:28:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8310MB free_disk=24.9244384765625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:28:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:28:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:28:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:28:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a796152e-e8df-41bf-a5ea-ae94d4fa8b41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:28:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance ae257aa8-78c3-499e-a5cf-1021deefe6d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:28:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance aa6b050c-ffd6-4a40-ab64-59f7ae8bef78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:28:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a4be3afd-5e52-4915-9cfe-83bf205d3c19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:28:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c2227a63-14e7-498f-b8f5-3bf0fc9802ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:28:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:28:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:28:44 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:28:44 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:28:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:28:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:28:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:46 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:28:46 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:28:46 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:28:46 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:28:46 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:28:46 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:28:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:50 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:28:50 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:28:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:28:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:28:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:28:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:28:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:57 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:28:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:28:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:28:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-894da7a3-9c67-417e-b0f4-306335a533e6" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:28:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-894da7a3-9c67-417e-b0f4-306335a533e6" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:28:58 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:28:58 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lazy-loading 'info_cache' on Instance uuid 894da7a3-9c67-417e-b0f4-306335a533e6 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:28:58 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Updating instance_info_cache with network_info: [{"id": "003f5480-4452-4891-8713-532403877f31", "address": "fa:16:3e:8d:b0:79", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap003f5480-44", "ovs_interfaceid": "003f5480-4452-4891-8713-532403877f31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:28:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-894da7a3-9c67-417e-b0f4-306335a533e6" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:28:58 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:28:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:28:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:28:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:28:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:28:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:28:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:29:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:29:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:29:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:29:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:05 user nova-compute[75246]: INFO nova.compute.manager [None req-3a967f79-08c0-40f7-923b-a7d4806c2721 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Unrescuing
Nov 28 17:29:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3a967f79-08c0-40f7-923b-a7d4806c2721 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "refresh_cache-aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:29:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3a967f79-08c0-40f7-923b-a7d4806c2721 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquired lock "refresh_cache-aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:29:05 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3a967f79-08c0-40f7-923b-a7d4806c2721 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:29:06 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3a967f79-08c0-40f7-923b-a7d4806c2721 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Updating instance_info_cache with network_info: [{"id": "dc3270f2-afa6-474a-8db6-26146f76efc6", "address": "fa:16:3e:5c:ed:e4", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3270f2-af", "ovs_interfaceid": "dc3270f2-afa6-474a-8db6-26146f76efc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:29:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3a967f79-08c0-40f7-923b-a7d4806c2721 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Releasing lock "refresh_cache-aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:29:06 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3a967f79-08c0-40f7-923b-a7d4806c2721 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'flavor' on Instance uuid aa6b050c-ffd6-4a40-ab64-59f7ae8bef78 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:29:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-eb889241-e707-42e5-bedf-f0b145a899f7 req-2a7452cc-7d19-4618-899b-5455631c8459 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received event network-vif-unplugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:29:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-eb889241-e707-42e5-bedf-f0b145a899f7 req-2a7452cc-7d19-4618-899b-5455631c8459 service nova] Acquiring lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:29:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-eb889241-e707-42e5-bedf-f0b145a899f7 req-2a7452cc-7d19-4618-899b-5455631c8459 service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:29:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-eb889241-e707-42e5-bedf-f0b145a899f7 req-2a7452cc-7d19-4618-899b-5455631c8459 service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:29:06 user nova-compute[75246]: DEBUG nova.compute.manager [req-eb889241-e707-42e5-bedf-f0b145a899f7 req-2a7452cc-7d19-4618-899b-5455631c8459 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] No waiting events found dispatching network-vif-unplugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:29:06 user nova-compute[75246]: WARNING nova.compute.manager [req-eb889241-e707-42e5-bedf-f0b145a899f7 req-2a7452cc-7d19-4618-899b-5455631c8459 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received unexpected event network-vif-unplugged-dc3270f2-afa6-474a-8db6-26146f76efc6 for instance with vm_state rescued and task_state unrescuing.
Nov 28 17:29:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:07 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Instance destroyed successfully.
Nov 28 17:29:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:08 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:08 user nova-compute[75246]: DEBUG nova.compute.manager [req-3e866fa6-0cb5-4fde-8443-86d6e8d08a7b req-aaf9d1fc-fd62-40e9-8c9b-453c7bebfe1d service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received event network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:29:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3e866fa6-0cb5-4fde-8443-86d6e8d08a7b req-aaf9d1fc-fd62-40e9-8c9b-453c7bebfe1d service nova] Acquiring lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:29:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3e866fa6-0cb5-4fde-8443-86d6e8d08a7b req-aaf9d1fc-fd62-40e9-8c9b-453c7bebfe1d service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:29:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3e866fa6-0cb5-4fde-8443-86d6e8d08a7b req-aaf9d1fc-fd62-40e9-8c9b-453c7bebfe1d service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:29:08 user nova-compute[75246]: DEBUG nova.compute.manager [req-3e866fa6-0cb5-4fde-8443-86d6e8d08a7b req-aaf9d1fc-fd62-40e9-8c9b-453c7bebfe1d service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] No waiting events found dispatching network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:29:08 user nova-compute[75246]: WARNING nova.compute.manager [req-3e866fa6-0cb5-4fde-8443-86d6e8d08a7b req-aaf9d1fc-fd62-40e9-8c9b-453c7bebfe1d service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received unexpected event network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 for instance with vm_state rescued and task_state unrescuing.
Nov 28 17:29:08 user nova-compute[75246]: DEBUG nova.compute.manager [req-3e866fa6-0cb5-4fde-8443-86d6e8d08a7b req-aaf9d1fc-fd62-40e9-8c9b-453c7bebfe1d service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received event network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:29:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3e866fa6-0cb5-4fde-8443-86d6e8d08a7b req-aaf9d1fc-fd62-40e9-8c9b-453c7bebfe1d service nova] Acquiring lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:29:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3e866fa6-0cb5-4fde-8443-86d6e8d08a7b req-aaf9d1fc-fd62-40e9-8c9b-453c7bebfe1d service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:29:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3e866fa6-0cb5-4fde-8443-86d6e8d08a7b req-aaf9d1fc-fd62-40e9-8c9b-453c7bebfe1d service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:29:08 user nova-compute[75246]: DEBUG nova.compute.manager [req-3e866fa6-0cb5-4fde-8443-86d6e8d08a7b req-aaf9d1fc-fd62-40e9-8c9b-453c7bebfe1d service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] No waiting events found dispatching network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:29:08 user nova-compute[75246]: WARNING nova.compute.manager [req-3e866fa6-0cb5-4fde-8443-86d6e8d08a7b req-aaf9d1fc-fd62-40e9-8c9b-453c7bebfe1d service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received unexpected event network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 for instance with vm_state rescued and task_state unrescuing.
Nov 28 17:29:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:10 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3a967f79-08c0-40f7-923b-a7d4806c2721 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:29:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-bfcb33fc-73b1-4c31-8038-1cab7c0790bf req-ae2e7e37-ec27-41d7-946c-1b8ee39a3845 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received event network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:29:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-bfcb33fc-73b1-4c31-8038-1cab7c0790bf req-ae2e7e37-ec27-41d7-946c-1b8ee39a3845 service nova] Acquiring lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:29:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-bfcb33fc-73b1-4c31-8038-1cab7c0790bf req-ae2e7e37-ec27-41d7-946c-1b8ee39a3845 service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:29:10 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-bfcb33fc-73b1-4c31-8038-1cab7c0790bf req-ae2e7e37-ec27-41d7-946c-1b8ee39a3845 service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:29:10 user nova-compute[75246]: DEBUG nova.compute.manager [req-bfcb33fc-73b1-4c31-8038-1cab7c0790bf req-ae2e7e37-ec27-41d7-946c-1b8ee39a3845 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] No waiting events found dispatching network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:29:10 user nova-compute[75246]: WARNING nova.compute.manager [req-bfcb33fc-73b1-4c31-8038-1cab7c0790bf req-ae2e7e37-ec27-41d7-946c-1b8ee39a3845 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received unexpected event network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 for instance with vm_state active and task_state None.
Nov 28 17:29:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:29:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:29:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:29:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:29:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:29:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:41 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:29:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:29:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:29:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:29:42 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:29:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:29:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:29:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:44 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:29:44 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:29:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8350MB free_disk=24.923328399658203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:29:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:29:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:29:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:29:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a796152e-e8df-41bf-a5ea-ae94d4fa8b41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:29:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance ae257aa8-78c3-499e-a5cf-1021deefe6d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:29:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance aa6b050c-ffd6-4a40-ab64-59f7ae8bef78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:29:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a4be3afd-5e52-4915-9cfe-83bf205d3c19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:29:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance c2227a63-14e7-498f-b8f5-3bf0fc9802ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:29:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:29:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:29:44 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:29:44 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:29:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:29:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:29:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:47 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:29:47 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:29:47 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:29:47 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:29:47 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:29:47 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:29:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-30b1e056-850d-44b2-84e3-7039414f83be req-7bb1f844-5abd-4b32-8c07-4ac2b736c0ce service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received event network-changed-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:29:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-30b1e056-850d-44b2-84e3-7039414f83be req-7bb1f844-5abd-4b32-8c07-4ac2b736c0ce service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Refreshing instance network info cache due to event network-changed-747a269b-3828-4182-b28d-8656cbcdfcfb. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:29:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-30b1e056-850d-44b2-84e3-7039414f83be req-7bb1f844-5abd-4b32-8c07-4ac2b736c0ce service nova] Acquiring lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:29:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-30b1e056-850d-44b2-84e3-7039414f83be req-7bb1f844-5abd-4b32-8c07-4ac2b736c0ce service nova] Acquired lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:29:49 user nova-compute[75246]: DEBUG nova.network.neutron [req-30b1e056-850d-44b2-84e3-7039414f83be req-7bb1f844-5abd-4b32-8c07-4ac2b736c0ce service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Refreshing network info cache for port 747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:29:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:29:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:29:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:29:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:29:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:49 user nova-compute[75246]: DEBUG nova.network.neutron [req-30b1e056-850d-44b2-84e3-7039414f83be req-7bb1f844-5abd-4b32-8c07-4ac2b736c0ce service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updated VIF entry in instance network info cache for port 747a269b-3828-4182-b28d-8656cbcdfcfb. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:29:49 user nova-compute[75246]: DEBUG nova.network.neutron [req-30b1e056-850d-44b2-84e3-7039414f83be req-7bb1f844-5abd-4b32-8c07-4ac2b736c0ce service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updating instance_info_cache with network_info: [{"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:29:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-30b1e056-850d-44b2-84e3-7039414f83be req-7bb1f844-5abd-4b32-8c07-4ac2b736c0ce service nova] Releasing lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:29:50 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:29:50 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:29:51 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG nova.objects.instance [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'flavor' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:29:52 user nova-compute[75246]: INFO nova.compute.manager [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Attaching volume d8810c2e-42cd-4534-a172-019140500ba0 to /dev/vdb
Nov 28 17:29:52 user nova-compute[75246]: DEBUG os_brick.utils [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[10574d89-22d2-4036-b162-0e1bfc344a09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1ed15e-33a4-4511-9041-c030285a35f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4367f6f-d327-4b72-9273-c3d080bf5804]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[148eb0ba-1247-4061-9c10-7733091d76a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:29:52 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:29:52 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ab3468-d913-493c-9d83-ab3d7a1e61f5]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG os_brick.utils [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:29:52 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updating existing volume attachment record: dd6460d9-427e-4b59-a350-3a81fd71ecd4 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-7550b149-d6f0-4fe2-87e8-b98adce74c62 req-b9321ed3-9768-4422-aade-78b452789ea4 service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Received event network-changed-d37fdc36-acc4-4419-a9e1-d7063b072c67 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG nova.compute.manager [req-7550b149-d6f0-4fe2-87e8-b98adce74c62 req-b9321ed3-9768-4422-aade-78b452789ea4 service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Refreshing instance network info cache due to event network-changed-d37fdc36-acc4-4419-a9e1-d7063b072c67. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7550b149-d6f0-4fe2-87e8-b98adce74c62 req-b9321ed3-9768-4422-aade-78b452789ea4 service nova] Acquiring lock "refresh_cache-c2227a63-14e7-498f-b8f5-3bf0fc9802ab" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7550b149-d6f0-4fe2-87e8-b98adce74c62 req-b9321ed3-9768-4422-aade-78b452789ea4 service nova] Acquired lock "refresh_cache-c2227a63-14e7-498f-b8f5-3bf0fc9802ab" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG nova.network.neutron [req-7550b149-d6f0-4fe2-87e8-b98adce74c62 req-b9321ed3-9768-4422-aade-78b452789ea4 service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Refreshing network info cache for port d37fdc36-acc4-4419-a9e1-d7063b072c67 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG nova.objects.instance [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lazy-loading 'flavor' on Instance uuid c2227a63-14e7-498f-b8f5-3bf0fc9802ab {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:29:53 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Ignoring supplied device name: /dev/vdb
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG nova.network.neutron [req-7550b149-d6f0-4fe2-87e8-b98adce74c62 req-b9321ed3-9768-4422-aade-78b452789ea4 service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Updated VIF entry in instance network info cache for port d37fdc36-acc4-4419-a9e1-d7063b072c67. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG nova.network.neutron [req-7550b149-d6f0-4fe2-87e8-b98adce74c62 req-b9321ed3-9768-4422-aade-78b452789ea4 service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Updating instance_info_cache with network_info: [{"id": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "address": "fa:16:3e:82:b2:e2", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37fdc36-ac", "ovs_interfaceid": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7550b149-d6f0-4fe2-87e8-b98adce74c62 req-b9321ed3-9768-4422-aade-78b452789ea4 service nova] Releasing lock "refresh_cache-c2227a63-14e7-498f-b8f5-3bf0fc9802ab" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:29:53 user nova-compute[75246]: INFO nova.compute.manager [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Attaching volume a8872b8f-6ab4-4246-a659-8436052d7227 to /dev/vdb
Nov 28 17:29:53 user nova-compute[75246]: DEBUG os_brick.utils [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[320428d3-876f-4164-b88e-54ebc9c3a4ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc36a7aa-09e3-4cc4-b2df-4eb3257a86f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1de3cc-4e39-4755-b10e-e93bc5867c71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c195793d-2ce1-4af1-9e49-9458f6804e12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:29:53 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[32503b2c-72a4-4260-a121-a4844bae156e]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG os_brick.utils [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Updating existing volume attachment record: c2cb151e-055e-49aa-8b04-b3e7776906dd {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:29:53 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:29:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:57 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:29:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:29:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:29:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:29:58 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:29:58 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Updating instance_info_cache with network_info: [{"id": "a311cb50-be83-4bf0-b889-d02170d667d6", "address": "fa:16:3e:65:bd:fb", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa311cb50-be", "ovs_interfaceid": "a311cb50-be83-4bf0-b889-d02170d667d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:29:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-a796152e-e8df-41bf-a5ea-ae94d4fa8b41" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:29:58 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEjTQZkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:29:59 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:29:59 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:29:59 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e04264-3cf0-481e-8dcb-804dd137e2b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:29:59 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2051a922-ad06-4d8d-bf91-fbee08231952]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0] added
Nov 28 17:29:59 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a32fe72-9a44-4669-9276-a20cef9e7cfe]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd04ae21-e8c5-41b7-8c63-c66659260b2e]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yEjTQZkh {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yEjTQZkh" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4ac348-2be1-46b1-8530-723e10ff1eae]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yEjTQZkh'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c246be0-cb6b-440d-b245-042af4cb764e]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ac1896-8470-4d0f-b15a-75f9300af749]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:29:59 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:29:59 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:29:59 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:29:59 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f6319b-b6f5-4ea8-ba10-9bbbe354d026]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0, portal: 172.16.0.220,3260]
Nov 28 17:29:59 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0, portal: 172.16.0.220,3260] successful.
Nov 28 17:29:59 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[22682a99-3a2d-4e7f-b0ba-11b8df807431]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b4dac5-982b-47e2-bbb7-65143ca299f8]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:29:59 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:29:59 user nova-compute[75246]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:29:59 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:29:59 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:29:59 user nova-compute[75246]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:29:59 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd8943b-528b-4da7-b384-00dd5e450f6d]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:29:59 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEjTQZkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ofOewHdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:30:00 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:30:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23834613331333933', 'path': '/dev/sdc'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834613331333933', 'path': '/dev/sdc'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.348s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:30:00 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:30:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:30:00 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG nova.objects.instance [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'flavor' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6537d13d-1b28-430f-9cde-039c481b3016]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:30:00 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:30:00 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:30:00 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:30:00 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:30:00 user nova-compute[75246]:   <serial>d8810c2e-42cd-4534-a172-019140500ba0</serial>
Nov 28 17:30:00 user nova-compute[75246]: </disk>
Nov 28 17:30:00 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07dad04-3951-456e-949e-2f06788dd7eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227] added
Nov 28 17:30:00 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[82872bad-25e2-4fa9-80a9-2c9e8b0924c8]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[476a5c43-c0a7-4170-bac6-eb7e690c5966]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ofOewHdQ {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ofOewHdQ" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b5dc76-88eb-49bd-a16a-888d450646ab]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ofOewHdQ'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e374b2-a1d9-4fb7-88bb-7c0df4ffaf73]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2f2639-cd44-45fa-a671-0146ba8f88e1]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:30:00 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:30:00 user nova-compute[75246]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:30:00 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:30:00 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:30:00 user nova-compute[75246]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:30:00 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:30:00 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cfbdfb-11a4-4764-b887-4628ccaead52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227, portal: 172.16.0.220,3260]
Nov 28 17:30:01 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227, portal: 172.16.0.220,3260] successful.
Nov 28 17:30:01 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b332c5-b606-4941-985c-371d0ebe16c1]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c2b11e-0891-48af-acc5-ecd4feb8b2e8]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:30:01 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:30:01 user nova-compute[75246]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:30:01 user nova-compute[75246]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 (non-flash)
Nov 28 17:30:01 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:30:01 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:30:01 user nova-compute[75246]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:30:01 user nova-compute[75246]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 (non-flash)
Nov 28 17:30:01 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f534ec-8909-40ae-93ef-80c1c50d231b]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ofOewHdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] No VIF found with MAC fa:16:3e:e0:a4:7b, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:30:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-be414719-1666-41fb-9709-e51ed56d0ce4 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.125s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] <== connect_volume: return (1654ms) {'type': 'block', 'scsi_wwn': '23635376139626530', 'path': '/dev/sdd'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635376139626530', 'path': '/dev/sdd'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-52e4391e-9d14-4d7c-ae2a-b42bd9bdd6eb tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-52e4391e-9d14-4d7c-ae2a-b42bd9bdd6eb tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-52e4391e-9d14-4d7c-ae2a-b42bd9bdd6eb tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG nova.objects.instance [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lazy-loading 'flavor' on Instance uuid c2227a63-14e7-498f-b8f5-3bf0fc9802ab {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-52e4391e-9d14-4d7c-ae2a-b42bd9bdd6eb tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75246) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG nova.objects.instance [None req-52e4391e-9d14-4d7c-ae2a-b42bd9bdd6eb tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'flavor' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:30:02 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:30:02 user nova-compute[75246]:   <source dev="/dev/sdd"/>
Nov 28 17:30:02 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:30:02 user nova-compute[75246]:   <serial>a8872b8f-6ab4-4246-a659-8436052d7227</serial>
Nov 28 17:30:02 user nova-compute[75246]: </disk>
Nov 28 17:30:02 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-cff8aacd-0b8f-4eeb-9ad2-a512bd6656ae req-b71939be-ffa3-4255-9441-a18f6a8dd3dd service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received event network-vif-unplugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cff8aacd-0b8f-4eeb-9ad2-a512bd6656ae req-b71939be-ffa3-4255-9441-a18f6a8dd3dd service nova] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cff8aacd-0b8f-4eeb-9ad2-a512bd6656ae req-b71939be-ffa3-4255-9441-a18f6a8dd3dd service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-cff8aacd-0b8f-4eeb-9ad2-a512bd6656ae req-b71939be-ffa3-4255-9441-a18f6a8dd3dd service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-cff8aacd-0b8f-4eeb-9ad2-a512bd6656ae req-b71939be-ffa3-4255-9441-a18f6a8dd3dd service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] No waiting events found dispatching network-vif-unplugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:30:02 user nova-compute[75246]: WARNING nova.compute.manager [req-cff8aacd-0b8f-4eeb-9ad2-a512bd6656ae req-b71939be-ffa3-4255-9441-a18f6a8dd3dd service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received unexpected event network-vif-unplugged-747a269b-3828-4182-b28d-8656cbcdfcfb for instance with vm_state active and task_state powering-off.
Nov 28 17:30:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] No VIF found with MAC fa:16:3e:82:b2:e2, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2a4862ff-e184-4ce9-aef4-e901683e81aa tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.265s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:02 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Instance destroyed successfully.
Nov 28 17:30:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-52e4391e-9d14-4d7c-ae2a-b42bd9bdd6eb tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:30:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-52e4391e-9d14-4d7c-ae2a-b42bd9bdd6eb tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.850s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:30:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-6374b8c7-e1bc-48f7-9e07-82998674aba5 req-95615498-1d2b-4e0b-978b-195818b14101 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received event network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:30:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6374b8c7-e1bc-48f7-9e07-82998674aba5 req-95615498-1d2b-4e0b-978b-195818b14101 service nova] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:30:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6374b8c7-e1bc-48f7-9e07-82998674aba5 req-95615498-1d2b-4e0b-978b-195818b14101 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:30:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6374b8c7-e1bc-48f7-9e07-82998674aba5 req-95615498-1d2b-4e0b-978b-195818b14101 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:30:04 user nova-compute[75246]: DEBUG nova.compute.manager [req-6374b8c7-e1bc-48f7-9e07-82998674aba5 req-95615498-1d2b-4e0b-978b-195818b14101 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] No waiting events found dispatching network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:30:04 user nova-compute[75246]: WARNING nova.compute.manager [req-6374b8c7-e1bc-48f7-9e07-82998674aba5 req-95615498-1d2b-4e0b-978b-195818b14101 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received unexpected event network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb for instance with vm_state stopped and task_state None.
Nov 28 17:30:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:30:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:30:19 user nova-compute[75246]: INFO nova.compute.manager [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Detaching volume a8872b8f-6ab4-4246-a659-8436052d7227
Nov 28 17:30:19 user nova-compute[75246]: INFO nova.virt.block_device [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Attempting to driver detach volume a8872b8f-6ab4-4246-a659-8436052d7227 from mountpoint /dev/vdb
Nov 28 17:30:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Attempting to detach device vdb from instance c2227a63-14e7-498f-b8f5-3bf0fc9802ab from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:30:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:30:19 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:30:19 user nova-compute[75246]:   <source dev="/dev/sdd"/>
Nov 28 17:30:19 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:30:19 user nova-compute[75246]:   <serial>a8872b8f-6ab4-4246-a659-8436052d7227</serial>
Nov 28 17:30:19 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:30:19 user nova-compute[75246]: </disk>
Nov 28 17:30:19 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:30:19 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Successfully detached device vdb from instance c2227a63-14e7-498f-b8f5-3bf0fc9802ab from the persistent domain config.
Nov 28 17:30:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c2227a63-14e7-498f-b8f5-3bf0fc9802ab from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:30:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:30:19 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:30:19 user nova-compute[75246]:   <source dev="/dev/sdd"/>
Nov 28 17:30:19 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:30:19 user nova-compute[75246]:   <serial>a8872b8f-6ab4-4246-a659-8436052d7227</serial>
Nov 28 17:30:19 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:30:19 user nova-compute[75246]: </disk>
Nov 28 17:30:19 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:30:19 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:30:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:30:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:30:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:30:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:30:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:30:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c2227a63-14e7-498f-b8f5-3bf0fc9802ab {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:30:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:37 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:30:37 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 17:30:38 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] There are 0 instances to clean {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:39 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c2227a63-14e7-498f-b8f5-3bf0fc9802ab is timed out.
Nov 28 17:30:39 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Successfully detached device vdb from instance c2227a63-14e7-498f-b8f5-3bf0fc9802ab from the live domain config.
Nov 28 17:30:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ofOewHdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:30:39 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:30:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a49f382-056d-489c-865b-db3165706f7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:30:39 user nova-compute[75246]: No targets found.
Nov 28 17:30:39 user nova-compute[75246]: iSNS:
Nov 28 17:30:39 user nova-compute[75246]: No targets found.
Nov 28 17:30:39 user nova-compute[75246]: STATIC:
Nov 28 17:30:39 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0
Nov 28 17:30:39 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:30:39 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:30:39 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227
Nov 28 17:30:39 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:30:39 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:30:39 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f
Nov 28 17:30:39 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:30:39 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:30:39 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:30:39 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:30:39 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:30:39 user nova-compute[75246]: FIRMWARE:
Nov 28 17:30:39 user nova-compute[75246]: No targets found.
Nov 28 17:30:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:30:39 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:30:39 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7594c7d-6e00-4087-bcb6-f4415af0f5bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a825f8ea-4c7f-43ad-9334-e53af1ddcd18]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:30:39 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:30:39 user nova-compute[75246]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:30:39 user nova-compute[75246]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 (non-flash)
Nov 28 17:30:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:30:39 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:30:39 user nova-compute[75246]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:30:39 user nova-compute[75246]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 (non-flash)
Nov 28 17:30:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4b86584c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227'): ({'sdd'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Removing single pathed devices sdd {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4075052a-88de-4e2a-912a-f077869ed2bf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81ebe98-aa94-4bf5-b32b-344548f4d9e1]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Flushing IO for device /dev/sdd {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[54585f18-9ef6-44f8-bb2d-552f43e63071]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[37312b07-a71f-4a94-8924-8aafb4eb8ff7]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] SCSI volumes sdd have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a877839-37ee-49bb-8ace-921a22609e48]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9f553e-79fc-4b85-a8d6-9dc37a284342]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227, portal: 172.16.0.220,3260]
Nov 28 17:30:40 user nova-compute[75246]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227, portal: 172.16.0.220,3260] successful.
Nov 28 17:30:40 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbc2a61-f0d7-457d-abb1-ad69eae6c0b4]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] <== disconnect_volume: return (320ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:30:40 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lazy-loading 'flavor' on Instance uuid c2227a63-14e7-498f-b8f5-3bf0fc9802ab {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3fb602c4-358b-4e1f-a77f-4e189a6d7b05 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.906s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.788s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:30:41 user nova-compute[75246]: INFO nova.compute.manager [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Terminating instance
Nov 28 17:30:41 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG nova.compute.manager [req-45f6e788-60e4-4c8d-9248-68c64c9ce2d4 req-73a9a829-0aac-4df5-9480-765b8194e861 service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Received event network-vif-unplugged-d37fdc36-acc4-4419-a9e1-d7063b072c67 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-45f6e788-60e4-4c8d-9248-68c64c9ce2d4 req-73a9a829-0aac-4df5-9480-765b8194e861 service nova] Acquiring lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-45f6e788-60e4-4c8d-9248-68c64c9ce2d4 req-73a9a829-0aac-4df5-9480-765b8194e861 service nova] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-45f6e788-60e4-4c8d-9248-68c64c9ce2d4 req-73a9a829-0aac-4df5-9480-765b8194e861 service nova] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG nova.compute.manager [req-45f6e788-60e4-4c8d-9248-68c64c9ce2d4 req-73a9a829-0aac-4df5-9480-765b8194e861 service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] No waiting events found dispatching network-vif-unplugged-d37fdc36-acc4-4419-a9e1-d7063b072c67 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG nova.compute.manager [req-45f6e788-60e4-4c8d-9248-68c64c9ce2d4 req-73a9a829-0aac-4df5-9480-765b8194e861 service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Received event network-vif-unplugged-d37fdc36-acc4-4419-a9e1-d7063b072c67 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:30:41 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Instance destroyed successfully.
Nov 28 17:30:41 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lazy-loading 'resources' on Instance uuid c2227a63-14e7-498f-b8f5-3bf0fc9802ab {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:28:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-96884646',display_name='tempest-VolumesSnapshotTestJSON-instance-96884646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-96884646',id=51,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPKN4V8nqhsWoYNiYzc4QAjzthwDJUquADTOgS2/4APUJmo7aljAQ/U97l896wNPsn/XAIZT0oW24r6sRTVE4Kn7xF659VBJtNBVc0nDKb9TqLuhR8Upksa6tROIWwxmA==',key_name='tempest-keypair-741947439',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:28:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45c961f690054959a9a92a3383ff6ff7',ramdisk_id='',reservation_id='r-jhj8slog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1977855474',owner_user_name='tempest-VolumesSnapshotTestJSON-1977855474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:28:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124d4cbebf644cd1a6de6aeccd4d4030',uuid=c2227a63-14e7-498f-b8f5-3bf0fc9802ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "address": "fa:16:3e:82:b2:e2", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37fdc36-ac", "ovs_interfaceid": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Converting VIF {"id": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "address": "fa:16:3e:82:b2:e2", "network": {"id": "6297eef9-9b93-47d1-bffa-cd1a7cc5925b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-34552573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c961f690054959a9a92a3383ff6ff7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37fdc36-ac", "ovs_interfaceid": "d37fdc36-acc4-4419-a9e1-d7063b072c67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:b2:e2,bridge_name='br-int',has_traffic_filtering=True,id=d37fdc36-acc4-4419-a9e1-d7063b072c67,network=Network(6297eef9-9b93-47d1-bffa-cd1a7cc5925b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd37fdc36-ac') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG os_vif [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:b2:e2,bridge_name='br-int',has_traffic_filtering=True,id=d37fdc36-acc4-4419-a9e1-d7063b072c67,network=Network(6297eef9-9b93-47d1-bffa-cd1a7cc5925b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd37fdc36-ac') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd37fdc36-ac, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:41 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40ec1944-c34d-4439-821f-2df070ba7351) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:42 user nova-compute[75246]: INFO os_vif [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:b2:e2,bridge_name='br-int',has_traffic_filtering=True,id=d37fdc36-acc4-4419-a9e1-d7063b072c67,network=Network(6297eef9-9b93-47d1-bffa-cd1a7cc5925b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd37fdc36-ac')
Nov 28 17:30:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ofOewHdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:30:42 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:30:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[be93ab30-ea37-468f-ad11-29e8ab030e5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:30:42 user nova-compute[75246]: No targets found.
Nov 28 17:30:42 user nova-compute[75246]: iSNS:
Nov 28 17:30:42 user nova-compute[75246]: No targets found.
Nov 28 17:30:42 user nova-compute[75246]: STATIC:
Nov 28 17:30:42 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0
Nov 28 17:30:42 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:30:42 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:30:42 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f
Nov 28 17:30:42 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:30:42 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:30:42 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:30:42 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:30:42 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:30:42 user nova-compute[75246]: FIRMWARE:
Nov 28 17:30:42 user nova-compute[75246]: No targets found.
Nov 28 17:30:42 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:30:42 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:30:42 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8872b8f-6ab4-4246-a659-8436052d7227', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[97196bea-4148-48b0-9edd-1aef1841eb07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e49056-2e63-40fc-bb16-c9278066f204]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:30:42 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:30:42 user nova-compute[75246]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:30:42 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:30:42 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:30:42 user nova-compute[75246]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:30:42 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d85a30a0>, {}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Disconnecting from: [] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] <== disconnect_volume: return (78ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:30:42 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Deleting instance files /opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab_del
Nov 28 17:30:42 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Deletion of /opt/stack/data/nova/instances/c2227a63-14e7-498f-b8f5-3bf0fc9802ab_del complete
Nov 28 17:30:42 user nova-compute[75246]: INFO nova.compute.manager [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 28 17:30:42 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:30:42 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Took 0.68 seconds to deallocate network for instance.
Nov 28 17:30:42 user nova-compute[75246]: DEBUG nova.compute.manager [req-87d93810-02ee-46ac-ad95-bad0299ba179 req-721c239b-4426-47a0-8665-bed81443ea9d service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Received event network-vif-deleted-d37fdc36-acc4-4419-a9e1-d7063b072c67 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:30:42 user nova-compute[75246]: WARNING nova.volume.cinder [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Attachment c2cb151e-055e-49aa-8b04-b3e7776906dd does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c2cb151e-055e-49aa-8b04-b3e7776906dd. (HTTP 404) (Request-ID: req-608c41c4-c2a2-4710-9c2a-2ebc0c503049)
Nov 28 17:30:42 user nova-compute[75246]: INFO nova.compute.manager [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Took 0.03 seconds to detach 1 volumes for instance.
Nov 28 17:30:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:30:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:30:43 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Refreshing inventories for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 17:30:43 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Updating ProviderTree inventory for provider 241ad926-9deb-44ba-a618-a49e4ac21089 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 17:30:43 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Updating inventory in ProviderTree for provider 241ad926-9deb-44ba-a618-a49e4ac21089 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 17:30:43 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Refreshing aggregate associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, aggregates: None {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 17:30:43 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Refreshing trait associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 17:30:43 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:30:43 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:30:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:30:43 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Deleted allocations for instance c2227a63-14e7-498f-b8f5-3bf0fc9802ab
Nov 28 17:30:43 user nova-compute[75246]: DEBUG nova.compute.manager [req-6b84fb4e-1e99-4c58-9c18-9fddf18e89e0 req-fb59a6bc-3638-46c9-83ce-f780029e689f service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Received event network-vif-plugged-d37fdc36-acc4-4419-a9e1-d7063b072c67 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:30:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6b84fb4e-1e99-4c58-9c18-9fddf18e89e0 req-fb59a6bc-3638-46c9-83ce-f780029e689f service nova] Acquiring lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:30:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6b84fb4e-1e99-4c58-9c18-9fddf18e89e0 req-fb59a6bc-3638-46c9-83ce-f780029e689f service nova] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:30:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6b84fb4e-1e99-4c58-9c18-9fddf18e89e0 req-fb59a6bc-3638-46c9-83ce-f780029e689f service nova] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:30:43 user nova-compute[75246]: DEBUG nova.compute.manager [req-6b84fb4e-1e99-4c58-9c18-9fddf18e89e0 req-fb59a6bc-3638-46c9-83ce-f780029e689f service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] No waiting events found dispatching network-vif-plugged-d37fdc36-acc4-4419-a9e1-d7063b072c67 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:30:43 user nova-compute[75246]: WARNING nova.compute.manager [req-6b84fb4e-1e99-4c58-9c18-9fddf18e89e0 req-fb59a6bc-3638-46c9-83ce-f780029e689f service nova] [instance: c2227a63-14e7-498f-b8f5-3bf0fc9802ab] Received unexpected event network-vif-plugged-d37fdc36-acc4-4419-a9e1-d7063b072c67 for instance with vm_state deleted and task_state None.
Nov 28 17:30:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6eae75be-4bfb-4d2a-8ea3-7e89cf2b1575 tempest-VolumesSnapshotTestJSON-1977855474 tempest-VolumesSnapshotTestJSON-1977855474-project-member] Lock "c2227a63-14e7-498f-b8f5-3bf0fc9802ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.428s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:30:44 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:30:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:30:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:30:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:30:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:30:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:30:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:30:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:30:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:45 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:30:45 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:30:45 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8666MB free_disk=24.94135284423828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:30:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:30:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:30:45 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:30:45 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a796152e-e8df-41bf-a5ea-ae94d4fa8b41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:30:45 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance ae257aa8-78c3-499e-a5cf-1021deefe6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:30:45 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance aa6b050c-ffd6-4a40-ab64-59f7ae8bef78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:30:45 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a4be3afd-5e52-4915-9cfe-83bf205d3c19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:30:45 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:30:45 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:30:45 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:30:45 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:30:45 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:30:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:30:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:48 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:30:48 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:30:48 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:30:48 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:30:48 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:30:48 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:30:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:30:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:30:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:30:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:30:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:52 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:30:52 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:30:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:30:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:30:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:30:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:30:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:30:56 user nova-compute[75246]: INFO nova.compute.manager [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Terminating instance
Nov 28 17:30:56 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:30:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-1ebecae2-6a58-48f0-b732-3c12e32e9260 req-d32889ac-1e72-455d-9d54-a676d966e5bc service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received event network-vif-unplugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1ebecae2-6a58-48f0-b732-3c12e32e9260 req-d32889ac-1e72-455d-9d54-a676d966e5bc service nova] Acquiring lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1ebecae2-6a58-48f0-b732-3c12e32e9260 req-d32889ac-1e72-455d-9d54-a676d966e5bc service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1ebecae2-6a58-48f0-b732-3c12e32e9260 req-d32889ac-1e72-455d-9d54-a676d966e5bc service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-1ebecae2-6a58-48f0-b732-3c12e32e9260 req-d32889ac-1e72-455d-9d54-a676d966e5bc service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] No waiting events found dispatching network-vif-unplugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG nova.compute.manager [req-1ebecae2-6a58-48f0-b732-3c12e32e9260 req-d32889ac-1e72-455d-9d54-a676d966e5bc service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received event network-vif-unplugged-dc3270f2-afa6-474a-8db6-26146f76efc6 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:57 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Instance destroyed successfully.
Nov 28 17:30:57 user nova-compute[75246]: DEBUG nova.objects.instance [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'resources' on Instance uuid aa6b050c-ffd6-4a40-ab64-59f7ae8bef78 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:25:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-464990600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-464990600',id=49,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:27:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faec5bcef3e2441fba30b593c13d5516',ramdisk_id='',reservation_id='r-ot3xyjx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-506006079',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:29:10Z,user_data=None,user_id='af8b6c3f092547dbbf3debe96c594590',uuid=aa6b050c-ffd6-4a40-ab64-59f7ae8bef78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc3270f2-afa6-474a-8db6-26146f76efc6", "address": "fa:16:3e:5c:ed:e4", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3270f2-af", "ovs_interfaceid": "dc3270f2-afa6-474a-8db6-26146f76efc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converting VIF {"id": "dc3270f2-afa6-474a-8db6-26146f76efc6", "address": "fa:16:3e:5c:ed:e4", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3270f2-af", "ovs_interfaceid": "dc3270f2-afa6-474a-8db6-26146f76efc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:ed:e4,bridge_name='br-int',has_traffic_filtering=True,id=dc3270f2-afa6-474a-8db6-26146f76efc6,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3270f2-af') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_vif [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:ed:e4,bridge_name='br-int',has_traffic_filtering=True,id=dc3270f2-afa6-474a-8db6-26146f76efc6,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3270f2-af') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc3270f2-af, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2102f844-c32d-4e9a-a489-4453b6bf3b49) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:30:57 user nova-compute[75246]: INFO os_vif [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:ed:e4,bridge_name='br-int',has_traffic_filtering=True,id=dc3270f2-afa6-474a-8db6-26146f76efc6,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3270f2-af')
Nov 28 17:30:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yvAsZloz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:30:57 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[595b121c-9335-4018-a49d-81b521fa9674]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:30:57 user nova-compute[75246]: No targets found.
Nov 28 17:30:57 user nova-compute[75246]: iSNS:
Nov 28 17:30:57 user nova-compute[75246]: No targets found.
Nov 28 17:30:57 user nova-compute[75246]: STATIC:
Nov 28 17:30:57 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0
Nov 28 17:30:57 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:30:57 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:30:57 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f
Nov 28 17:30:57 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:30:57 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:30:57 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:30:57 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:30:57 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:30:57 user nova-compute[75246]: FIRMWARE:
Nov 28 17:30:57 user nova-compute[75246]: No targets found.
Nov 28 17:30:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:30:57 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:30:57 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55fe092-10eb-4e44-86de-a5ce93e0053f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3544a99-7ac6-47d7-bef6-cbcd68efc13a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:30:57 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:30:57 user nova-compute[75246]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:30:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:30:57 user nova-compute[75246]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f (non-flash)
Nov 28 17:30:57 user nova-compute[75246]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:30:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d815fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f'): ({'sdf'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Removing single pathed devices sdf {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c357d47-9552-4713-b5cb-f399eb5bab3c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[70380468-ed33-408f-8905-36a0438c5258]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Flushing IO for device /dev/sdf {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0266aaeb-f736-49bc-b40e-2862c6b7b4c8]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bb88ba-ef00-4f99-a9c3-16db278612bc]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] SCSI volumes sdf have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23866313338373837', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5993992c', '/dev/disk/by-id/scsi-1SCST_BIO5993992c-8f138787fe605d30') {{(pid=85745) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[18709ff0-b641-4ea2-ae28-71179b187e62]: (4, None) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c3cd4b-038a-45f9-8cd5-9ce0650b4271]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[edeeccc2-6a93-4c64-8866-2e92bb37ae58]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f, portal: 172.16.0.220,3260]
Nov 28 17:30:57 user nova-compute[75246]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f, portal: 172.16.0.220,3260] successful.
Nov 28 17:30:57 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168870a5-6858-4a8f-82ea-514b95a8b19f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a45273-4c04-42ad-8611-022d3eb66ca7]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] <== disconnect_volume: return (307ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:30:57 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Deleting instance files /opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78_del
Nov 28 17:30:57 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Deletion of /opt/stack/data/nova/instances/aa6b050c-ffd6-4a40-ab64-59f7ae8bef78_del complete
Nov 28 17:30:57 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:30:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:30:58 user nova-compute[75246]: INFO nova.compute.manager [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 28 17:30:58 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:30:58 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:30:58 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:30:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-ae257aa8-78c3-499e-a5cf-1021deefe6d8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:30:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-ae257aa8-78c3-499e-a5cf-1021deefe6d8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:30:58 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:30:58 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:30:58 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Took 0.46 seconds to deallocate network for instance.
Nov 28 17:30:58 user nova-compute[75246]: DEBUG nova.compute.manager [req-867631dc-3a13-43e2-a3f8-1cb1e0970ed0 req-1ed0a80d-0a6d-4b98-90d3-83f91bbb5a74 service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received event network-vif-deleted-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:30:58 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Updating instance_info_cache with network_info: [{"id": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "address": "fa:16:3e:1e:ed:6e", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e83fee-b8", "ovs_interfaceid": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:30:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-ae257aa8-78c3-499e-a5cf-1021deefe6d8" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:30:58 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:30:59 user nova-compute[75246]: INFO nova.compute.manager [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Took 0.73 seconds to detach 1 volumes for instance.
Nov 28 17:30:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-60675211-8d99-46a4-811c-595a9ba999c7 req-8b8721b8-3718-4345-86cb-7c1930d80fca service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received event network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:30:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-60675211-8d99-46a4-811c-595a9ba999c7 req-8b8721b8-3718-4345-86cb-7c1930d80fca service nova] Acquiring lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:30:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-60675211-8d99-46a4-811c-595a9ba999c7 req-8b8721b8-3718-4345-86cb-7c1930d80fca service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:30:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-60675211-8d99-46a4-811c-595a9ba999c7 req-8b8721b8-3718-4345-86cb-7c1930d80fca service nova] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:30:59 user nova-compute[75246]: DEBUG nova.compute.manager [req-60675211-8d99-46a4-811c-595a9ba999c7 req-8b8721b8-3718-4345-86cb-7c1930d80fca service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] No waiting events found dispatching network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:30:59 user nova-compute[75246]: WARNING nova.compute.manager [req-60675211-8d99-46a4-811c-595a9ba999c7 req-8b8721b8-3718-4345-86cb-7c1930d80fca service nova] [instance: aa6b050c-ffd6-4a40-ab64-59f7ae8bef78] Received unexpected event network-vif-plugged-dc3270f2-afa6-474a-8db6-26146f76efc6 for instance with vm_state active and task_state deleting.
Nov 28 17:30:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:30:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:30:59 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:30:59 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:30:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:30:59 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Deleted allocations for instance aa6b050c-ffd6-4a40-ab64-59f7ae8bef78
Nov 28 17:30:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c2b20a13-e964-48ad-9a91-9b88d0f9381d tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "aa6b050c-ffd6-4a40-ab64-59f7ae8bef78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.739s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:31:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:31:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:31:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:31:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:31:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:07 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:31:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75246) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 17:31:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:31:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:31:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:43 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:31:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:31:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:31:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:31:44 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:31:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:31:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:31:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:45 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:31:45 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:31:45 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8799MB free_disk=24.93966293334961GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:31:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:31:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:31:45 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:31:45 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a796152e-e8df-41bf-a5ea-ae94d4fa8b41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:31:45 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance ae257aa8-78c3-499e-a5cf-1021deefe6d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:31:45 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a4be3afd-5e52-4915-9cfe-83bf205d3c19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:31:45 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:31:45 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:31:45 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:31:45 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:31:45 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:31:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:31:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:31:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:31:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:31:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:31:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:31:47 user nova-compute[75246]: INFO nova.compute.manager [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Terminating instance
Nov 28 17:31:47 user nova-compute[75246]: DEBUG nova.compute.manager [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:31:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG nova.compute.manager [req-d8ea7a2f-dd49-4b25-bf1d-cc727edf1b32 req-14f3c928-d871-4dcf-9975-58626b818b07 service nova] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Received event network-vif-unplugged-53e83fee-b8ec-4d6a-a3ce-d831c58e7e86 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d8ea7a2f-dd49-4b25-bf1d-cc727edf1b32 req-14f3c928-d871-4dcf-9975-58626b818b07 service nova] Acquiring lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d8ea7a2f-dd49-4b25-bf1d-cc727edf1b32 req-14f3c928-d871-4dcf-9975-58626b818b07 service nova] Lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d8ea7a2f-dd49-4b25-bf1d-cc727edf1b32 req-14f3c928-d871-4dcf-9975-58626b818b07 service nova] Lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG nova.compute.manager [req-d8ea7a2f-dd49-4b25-bf1d-cc727edf1b32 req-14f3c928-d871-4dcf-9975-58626b818b07 service nova] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] No waiting events found dispatching network-vif-unplugged-53e83fee-b8ec-4d6a-a3ce-d831c58e7e86 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG nova.compute.manager [req-d8ea7a2f-dd49-4b25-bf1d-cc727edf1b32 req-14f3c928-d871-4dcf-9975-58626b818b07 service nova] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Received event network-vif-unplugged-53e83fee-b8ec-4d6a-a3ce-d831c58e7e86 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:48 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Instance destroyed successfully.
Nov 28 17:31:48 user nova-compute[75246]: DEBUG nova.objects.instance [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'resources' on Instance uuid ae257aa8-78c3-499e-a5cf-1021deefe6d8 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1576074089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1576074089',id=44,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:22:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faec5bcef3e2441fba30b593c13d5516',ramdisk_id='',reservation_id='r-wotnwtc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-506006079',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:24:21Z,user_data=None,user_id='af8b6c3f092547dbbf3debe96c594590',uuid=ae257aa8-78c3-499e-a5cf-1021deefe6d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "address": "fa:16:3e:1e:ed:6e", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e83fee-b8", "ovs_interfaceid": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converting VIF {"id": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "address": "fa:16:3e:1e:ed:6e", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e83fee-b8", "ovs_interfaceid": "53e83fee-b8ec-4d6a-a3ce-d831c58e7e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=53e83fee-b8ec-4d6a-a3ce-d831c58e7e86,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e83fee-b8') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG os_vif [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=53e83fee-b8ec-4d6a-a3ce-d831c58e7e86,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e83fee-b8') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53e83fee-b8, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66f5a60c-5f37-4541-abb9-3ccb42fa53cd) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:48 user nova-compute[75246]: INFO os_vif [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=53e83fee-b8ec-4d6a-a3ce-d831c58e7e86,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e83fee-b8')
Nov 28 17:31:48 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Deleting instance files /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8_del
Nov 28 17:31:48 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Deletion of /opt/stack/data/nova/instances/ae257aa8-78c3-499e-a5cf-1021deefe6d8_del complete
Nov 28 17:31:48 user nova-compute[75246]: INFO nova.compute.manager [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Took 0.76 seconds to destroy the instance on the hypervisor.
Nov 28 17:31:48 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:31:48 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:31:49 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:31:49 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Took 0.53 seconds to deallocate network for instance.
Nov 28 17:31:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-e7453379-a5e8-4f4f-a1a6-c7988ab01636 req-393c3e36-9d2e-4ea2-9ba9-713f17596a0f service nova] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Received event network-vif-deleted-53e83fee-b8ec-4d6a-a3ce-d831c58e7e86 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:31:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:31:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:31:49 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:31:49 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:31:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:31:49 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Deleted allocations for instance ae257aa8-78c3-499e-a5cf-1021deefe6d8
Nov 28 17:31:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-b7cbadd3-16bc-4995-bd8d-7467b4a87db1 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.686s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:31:49 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:31:49 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:31:49 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:31:49 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:31:49 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:31:50 user nova-compute[75246]: DEBUG nova.compute.manager [req-c998465f-8696-4a46-8039-c7c383317f72 req-1aaf1e65-76f9-4142-8973-b1a5291407f2 service nova] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Received event network-vif-plugged-53e83fee-b8ec-4d6a-a3ce-d831c58e7e86 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:31:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c998465f-8696-4a46-8039-c7c383317f72 req-1aaf1e65-76f9-4142-8973-b1a5291407f2 service nova] Acquiring lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:31:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c998465f-8696-4a46-8039-c7c383317f72 req-1aaf1e65-76f9-4142-8973-b1a5291407f2 service nova] Lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:31:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c998465f-8696-4a46-8039-c7c383317f72 req-1aaf1e65-76f9-4142-8973-b1a5291407f2 service nova] Lock "ae257aa8-78c3-499e-a5cf-1021deefe6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:31:50 user nova-compute[75246]: DEBUG nova.compute.manager [req-c998465f-8696-4a46-8039-c7c383317f72 req-1aaf1e65-76f9-4142-8973-b1a5291407f2 service nova] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] No waiting events found dispatching network-vif-plugged-53e83fee-b8ec-4d6a-a3ce-d831c58e7e86 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:31:50 user nova-compute[75246]: WARNING nova.compute.manager [req-c998465f-8696-4a46-8039-c7c383317f72 req-1aaf1e65-76f9-4142-8973-b1a5291407f2 service nova] [instance: ae257aa8-78c3-499e-a5cf-1021deefe6d8] Received unexpected event network-vif-plugged-53e83fee-b8ec-4d6a-a3ce-d831c58e7e86 for instance with vm_state deleted and task_state None.
Nov 28 17:31:50 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:31:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'flavor' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquired lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'info_cache' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG nova.objects.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Object Instance<a4be3afd-5e52-4915-9cfe-83bf205d3c19> lazy-loaded attributes: flavor,info_cache {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG nova.network.neutron [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updating instance_info_cache with network_info: [{"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Releasing lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:31:53 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Instance destroyed successfully.
Nov 28 17:31:53 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'resources' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG nova.objects.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Object Instance<a4be3afd-5e52-4915-9cfe-83bf205d3c19> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-293166483',display_name='tempest-AttachVolumeTestJSON-server-293166483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-293166483',id=50,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqe0fw+kudngaeCOPjFm0lglWTUIvqOQoZjQoYYQ9pcKjeJDQFeO5BSrL84EkaMlPyRW3L6sgdr0rYGfEMmOz0UEjXhN0KEjP44F28rNwSbmltWXOH66c/sbByz6lIy7Q==',key_name='tempest-keypair-1328117536',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:28:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ce5e8b8b1dc2469bb172fdc843b8f39c',ramdisk_id='',reservation_id='r-hhnksif4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-32273339',owner_user_name='tempest-AttachVolumeTestJSON-32273339-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c78d20df77421389d4fb0c5a6d2add',uuid=a4be3afd-5e52-4915-9cfe-83bf205d3c19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converting VIF {"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG os_vif [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap747a269b-38, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17bfd879-6f92-4451-851c-c85963bd6460) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:53 user nova-compute[75246]: INFO os_vif [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38')
Nov 28 17:31:53 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEjTQZkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:31:53 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:31:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[991d57af-2aa4-4fcc-99ba-ed462360ad80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:31:53 user nova-compute[75246]: No targets found.
Nov 28 17:31:53 user nova-compute[75246]: iSNS:
Nov 28 17:31:53 user nova-compute[75246]: No targets found.
Nov 28 17:31:53 user nova-compute[75246]: STATIC:
Nov 28 17:31:53 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0
Nov 28 17:31:53 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:31:53 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:31:53 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:31:53 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:31:53 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:31:53 user nova-compute[75246]: FIRMWARE:
Nov 28 17:31:53 user nova-compute[75246]: No targets found.
Nov 28 17:31:53 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:31:53 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:31:53 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6e20bd-469e-4625-8f12-a26b971cc8d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b68e428-38e3-4466-8451-72acd00df407]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:31:53 user nova-compute[75246]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:31:53 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:31:53 user nova-compute[75246]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:31:53 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f8cf3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0'): ({'sdc'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Removing single pathed devices sdc {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bbab0c-c741-4c07-b176-2798b47e50b5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a878910b-939c-490e-858c-ef42837752c0]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Flushing IO for device /dev/sdc {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5d9df3-8c67-4298-bf5d-0fca075ceef1]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:53 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac2e5ae-6899-4b1a-aaef-9d307775895b]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6de7e57-71d7-4892-9264-8c82c98cf471]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7e540f-b91a-41e7-a21b-5cbe55e8dde0]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0, portal: 172.16.0.220,3260]
Nov 28 17:31:54 user nova-compute[75246]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0, portal: 172.16.0.220,3260] successful.
Nov 28 17:31:54 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82055d2-884d-4c36-b302-a74f3ea10a97]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] <== disconnect_volume: return (286ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Start _get_guest_xml network_info=[{"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': 'dd6460d9-427e-4b59-a350-3a81fd71ecd4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEjTQZkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'a4be3afd-5e52-4915-9cfe-83bf205d3c19', 'attached_at': '', 'detached_at': '', 'volume_id': 'd8810c2e-42cd-4534-a172-019140500ba0', 'serial': 'd8810c2e-42cd-4534-a172-019140500ba0'}, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'numa_topology' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.objects.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Object Instance<a4be3afd-5e52-4915-9cfe-83bf205d3c19> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:31:54 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:31:54 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'vcpu_model' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.objects.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Object Instance<a4be3afd-5e52-4915-9cfe-83bf205d3c19> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEjTQZkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:31:54 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:31:54 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:31:54 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4e4d6e-3110-42a4-b24a-bbf96ad2ed85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:31:54 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49472ad-fa92-4b8e-8ac2-d9fc2e131ce6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0] added
Nov 28 17:31:54 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e039d4d1-9ada-4fe5-ad26-e78b78ee55ca]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b1f073-20df-4d04-83a8-65df340c62be]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yEjTQZkh {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yEjTQZkh" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63d3763-fcf6-41c8-846c-053b850d9cdd]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yEjTQZkh'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[348282a9-fd18-42b9-a2b9-12c87ffda575]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[351637a8-62c8-4fb3-ab54-56c3cf1e8ebd]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:31:54 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:31:54 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad3bca3-b062-4bc5-8349-e7d7c4028e67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0, portal: 172.16.0.220,3260]
Nov 28 17:31:54 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0, portal: 172.16.0.220,3260] successful.
Nov 28 17:31:54 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb86163-feca-4ebb-abe3-e074ca93e941]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c547fea0-499b-4af5-8eb5-18a61d883c29]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:31:54 user nova-compute[75246]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:31:54 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:31:54 user nova-compute[75246]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:31:54 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[52031c44-f5a2-47ec-b32c-fc8d1cbc08c9]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEjTQZkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:31:54 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:31:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:31:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23834613331333933', 'path': '/dev/sdc'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:31:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834613331333933', 'path': '/dev/sdc'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:31:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-293166483',display_name='tempest-AttachVolumeTestJSON-server-293166483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-293166483',id=50,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqe0fw+kudngaeCOPjFm0lglWTUIvqOQoZjQoYYQ9pcKjeJDQFeO5BSrL84EkaMlPyRW3L6sgdr0rYGfEMmOz0UEjXhN0KEjP44F28rNwSbmltWXOH66c/sbByz6lIy7Q==',key_name='tempest-keypair-1328117536',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:28:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ce5e8b8b1dc2469bb172fdc843b8f39c',ramdisk_id='',reservation_id='r-hhnksif4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-32273339',owner_user_name='tempest-AttachVolumeTestJSON-32273339-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c78d20df77421389d4fb0c5a6d2add',uuid=a4be3afd-5e52-4915-9cfe-83bf205d3c19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:31:55 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converting VIF {"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:31:55 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:31:55 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'pci_devices' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:31:55 user nova-compute[75246]: DEBUG nova.objects.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Object Instance<a4be3afd-5e52-4915-9cfe-83bf205d3c19> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:31:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:31:55 user nova-compute[75246]:   <uuid>a4be3afd-5e52-4915-9cfe-83bf205d3c19</uuid>
Nov 28 17:31:55 user nova-compute[75246]:   <name>instance-00000032</name>
Nov 28 17:31:55 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:31:55 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:31:55 user nova-compute[75246]:   <metadata>
Nov 28 17:31:55 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:31:55 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:31:55 user nova-compute[75246]:       <nova:name>tempest-AttachVolumeTestJSON-server-293166483</nova:name>
Nov 28 17:31:55 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:31:54</nova:creationTime>
Nov 28 17:31:55 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:31:55 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:31:55 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:31:55 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:31:55 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:31:55 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:31:55 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:31:55 user nova-compute[75246]:       <nova:owner>
Nov 28 17:31:55 user nova-compute[75246]:         <nova:user uuid="c0c78d20df77421389d4fb0c5a6d2add">tempest-AttachVolumeTestJSON-32273339-project-member</nova:user>
Nov 28 17:31:55 user nova-compute[75246]:         <nova:project uuid="ce5e8b8b1dc2469bb172fdc843b8f39c">tempest-AttachVolumeTestJSON-32273339</nova:project>
Nov 28 17:31:55 user nova-compute[75246]:       </nova:owner>
Nov 28 17:31:55 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:31:55 user nova-compute[75246]:       <nova:ports>
Nov 28 17:31:55 user nova-compute[75246]:         <nova:port uuid="747a269b-3828-4182-b28d-8656cbcdfcfb">
Nov 28 17:31:55 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 17:31:55 user nova-compute[75246]:         </nova:port>
Nov 28 17:31:55 user nova-compute[75246]:       </nova:ports>
Nov 28 17:31:55 user nova-compute[75246]:     </nova:instance>
Nov 28 17:31:55 user nova-compute[75246]:   </metadata>
Nov 28 17:31:55 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:31:55 user nova-compute[75246]:     <system>
Nov 28 17:31:55 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:31:55 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:31:55 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:31:55 user nova-compute[75246]:       <entry name="serial">a4be3afd-5e52-4915-9cfe-83bf205d3c19</entry>
Nov 28 17:31:55 user nova-compute[75246]:       <entry name="uuid">a4be3afd-5e52-4915-9cfe-83bf205d3c19</entry>
Nov 28 17:31:55 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:31:55 user nova-compute[75246]:     </system>
Nov 28 17:31:55 user nova-compute[75246]:   </sysinfo>
Nov 28 17:31:55 user nova-compute[75246]:   <os>
Nov 28 17:31:55 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:31:55 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:31:55 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:31:55 user nova-compute[75246]:   </os>
Nov 28 17:31:55 user nova-compute[75246]:   <features>
Nov 28 17:31:55 user nova-compute[75246]:     <acpi/>
Nov 28 17:31:55 user nova-compute[75246]:     <apic/>
Nov 28 17:31:55 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:31:55 user nova-compute[75246]:   </features>
Nov 28 17:31:55 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:31:55 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:31:55 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:31:55 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:31:55 user nova-compute[75246]:   </clock>
Nov 28 17:31:55 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:31:55 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:31:55 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:31:55 user nova-compute[75246]:   </cpu>
Nov 28 17:31:55 user nova-compute[75246]:   <devices>
Nov 28 17:31:55 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:31:55 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:31:55 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk"/>
Nov 28 17:31:55 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:31:55 user nova-compute[75246]:     </disk>
Nov 28 17:31:55 user nova-compute[75246]:     <disk type="block" device="disk">
Nov 28 17:31:55 user nova-compute[75246]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:31:55 user nova-compute[75246]:       <source dev="/dev/sdc"/>
Nov 28 17:31:55 user nova-compute[75246]:       <target dev="vdb" bus="virtio"/>
Nov 28 17:31:55 user nova-compute[75246]:       <serial>d8810c2e-42cd-4534-a172-019140500ba0</serial>
Nov 28 17:31:55 user nova-compute[75246]:     </disk>
Nov 28 17:31:55 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:31:55 user nova-compute[75246]:       <mac address="fa:16:3e:e0:a4:7b"/>
Nov 28 17:31:55 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:31:55 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:31:55 user nova-compute[75246]:       <target dev="tap747a269b-38"/>
Nov 28 17:31:55 user nova-compute[75246]:     </interface>
Nov 28 17:31:55 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:31:55 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/console.log" append="off"/>
Nov 28 17:31:55 user nova-compute[75246]:     </serial>
Nov 28 17:31:55 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:31:55 user nova-compute[75246]:     <video>
Nov 28 17:31:55 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:31:55 user nova-compute[75246]:     </video>
Nov 28 17:31:55 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:31:55 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:31:55 user nova-compute[75246]:     </rng>
Nov 28 17:31:55 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:31:55 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:31:55 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:31:55 user nova-compute[75246]:     </memballoon>
Nov 28 17:31:55 user nova-compute[75246]:   </devices>
Nov 28 17:31:55 user nova-compute[75246]: </domain>
Nov 28 17:31:55 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:31:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:31:55 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'trusted_certs' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:31:55 user nova-compute[75246]: DEBUG nova.objects.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Object Instance<a4be3afd-5e52-4915-9cfe-83bf205d3c19> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:31:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Cannot resize image /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG nova.objects.instance [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'migration_context' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG nova.objects.base [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Object Instance<a4be3afd-5e52-4915-9cfe-83bf205d3c19> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-293166483',display_name='tempest-AttachVolumeTestJSON-server-293166483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-293166483',id=50,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqe0fw+kudngaeCOPjFm0lglWTUIvqOQoZjQoYYQ9pcKjeJDQFeO5BSrL84EkaMlPyRW3L6sgdr0rYGfEMmOz0UEjXhN0KEjP44F28rNwSbmltWXOH66c/sbByz6lIy7Q==',key_name='tempest-keypair-1328117536',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:28:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ce5e8b8b1dc2469bb172fdc843b8f39c',ramdisk_id='',reservation_id='r-hhnksif4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-32273339',owner_user_name='tempest-AttachVolumeTestJSON-32273339-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c78d20df77421389d4fb0c5a6d2add',uuid=a4be3afd-5e52-4915-9cfe-83bf205d3c19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converting VIF {"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG os_vif [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b1e92a0-1b25-5fa3-ae66-8750ca8cad08', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap747a269b-38, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap747a269b-38, col_values=(('qos', UUID('811ebde7-28e7-441f-b749-159f713c9cae')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap747a269b-38, col_values=(('external_ids', {'iface-id': '747a269b-3828-4182-b28d-8656cbcdfcfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:a4:7b', 'vm-uuid': 'a4be3afd-5e52-4915-9cfe-83bf205d3c19'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:31:56 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:56 user nova-compute[75246]: INFO os_vif [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38')
Nov 28 17:31:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:57 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:31:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:31:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:31:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:31:58 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:31:58 user nova-compute[75246]: DEBUG nova.compute.manager [req-2bbc88ef-e7de-4f8f-9ea6-8f2efb134e7a req-75980692-48ef-4f5b-b20a-1c6bc184e587 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received event network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:31:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2bbc88ef-e7de-4f8f-9ea6-8f2efb134e7a req-75980692-48ef-4f5b-b20a-1c6bc184e587 service nova] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:31:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2bbc88ef-e7de-4f8f-9ea6-8f2efb134e7a req-75980692-48ef-4f5b-b20a-1c6bc184e587 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:31:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-2bbc88ef-e7de-4f8f-9ea6-8f2efb134e7a req-75980692-48ef-4f5b-b20a-1c6bc184e587 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:31:58 user nova-compute[75246]: DEBUG nova.compute.manager [req-2bbc88ef-e7de-4f8f-9ea6-8f2efb134e7a req-75980692-48ef-4f5b-b20a-1c6bc184e587 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] No waiting events found dispatching network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:31:58 user nova-compute[75246]: WARNING nova.compute.manager [req-2bbc88ef-e7de-4f8f-9ea6-8f2efb134e7a req-75980692-48ef-4f5b-b20a-1c6bc184e587 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received unexpected event network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb for instance with vm_state stopped and task_state powering-on.
Nov 28 17:31:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:31:58 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updating instance_info_cache with network_info: [{"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:31:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:31:58 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:31:59 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:31:59 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Instance rebooted successfully.
Nov 28 17:31:59 user nova-compute[75246]: DEBUG nova.compute.manager [None req-6c5f8964-d944-40f3-86cb-b84adc9fee16 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:32:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-e2631f10-355e-454a-9026-cd087a890fe1 req-a06174d9-e206-4e18-a2bc-10ce83aa63e9 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received event network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:32:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e2631f10-355e-454a-9026-cd087a890fe1 req-a06174d9-e206-4e18-a2bc-10ce83aa63e9 service nova] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:32:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e2631f10-355e-454a-9026-cd087a890fe1 req-a06174d9-e206-4e18-a2bc-10ce83aa63e9 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:32:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-e2631f10-355e-454a-9026-cd087a890fe1 req-a06174d9-e206-4e18-a2bc-10ce83aa63e9 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:32:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-e2631f10-355e-454a-9026-cd087a890fe1 req-a06174d9-e206-4e18-a2bc-10ce83aa63e9 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] No waiting events found dispatching network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:32:00 user nova-compute[75246]: WARNING nova.compute.manager [req-e2631f10-355e-454a-9026-cd087a890fe1 req-a06174d9-e206-4e18-a2bc-10ce83aa63e9 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received unexpected event network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb for instance with vm_state active and task_state None.
Nov 28 17:32:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:11 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:16 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:32:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:21 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:26 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:31 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:33 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:36 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:32:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:32:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:32:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:32:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:32:38 user nova-compute[75246]: INFO nova.compute.manager [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Terminating instance
Nov 28 17:32:38 user nova-compute[75246]: DEBUG nova.compute.manager [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:32:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-37b0a2b0-2e90-43af-b056-32397d8b27a9 req-dbf620f0-685e-43ba-9bc2-7d0a238964c6 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-vif-unplugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:32:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-37b0a2b0-2e90-43af-b056-32397d8b27a9 req-dbf620f0-685e-43ba-9bc2-7d0a238964c6 service nova] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:32:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-37b0a2b0-2e90-43af-b056-32397d8b27a9 req-dbf620f0-685e-43ba-9bc2-7d0a238964c6 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:32:38 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-37b0a2b0-2e90-43af-b056-32397d8b27a9 req-dbf620f0-685e-43ba-9bc2-7d0a238964c6 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:32:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-37b0a2b0-2e90-43af-b056-32397d8b27a9 req-dbf620f0-685e-43ba-9bc2-7d0a238964c6 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] No waiting events found dispatching network-vif-unplugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:32:38 user nova-compute[75246]: DEBUG nova.compute.manager [req-37b0a2b0-2e90-43af-b056-32397d8b27a9 req-dbf620f0-685e-43ba-9bc2-7d0a238964c6 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-vif-unplugged-a311cb50-be83-4bf0-b889-d02170d667d6 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:32:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:38 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:39 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Instance destroyed successfully.
Nov 28 17:32:39 user nova-compute[75246]: DEBUG nova.objects.instance [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'resources' on Instance uuid a796152e-e8df-41bf-a5ea-ae94d4fa8b41 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:16:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1508108904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1508108904',id=38,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:18:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faec5bcef3e2441fba30b593c13d5516',ramdisk_id='',reservation_id='r-39xyyd05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-506006079',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:20:38Z,user_data=None,user_id='af8b6c3f092547dbbf3debe96c594590',uuid=a796152e-e8df-41bf-a5ea-ae94d4fa8b41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a311cb50-be83-4bf0-b889-d02170d667d6", "address": "fa:16:3e:65:bd:fb", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa311cb50-be", "ovs_interfaceid": "a311cb50-be83-4bf0-b889-d02170d667d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converting VIF {"id": "a311cb50-be83-4bf0-b889-d02170d667d6", "address": "fa:16:3e:65:bd:fb", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa311cb50-be", "ovs_interfaceid": "a311cb50-be83-4bf0-b889-d02170d667d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:bd:fb,bridge_name='br-int',has_traffic_filtering=True,id=a311cb50-be83-4bf0-b889-d02170d667d6,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa311cb50-be') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_vif [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:bd:fb,bridge_name='br-int',has_traffic_filtering=True,id=a311cb50-be83-4bf0-b889-d02170d667d6,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa311cb50-be') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa311cb50-be, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d90b41b-3523-4be3-a196-6f676d35d37b) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:32:39 user nova-compute[75246]: INFO os_vif [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:bd:fb,bridge_name='br-int',has_traffic_filtering=True,id=a311cb50-be83-4bf0-b889-d02170d667d6,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa311cb50-be')
Nov 28 17:32:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ueoZRldz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:32:39 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[27160899-7c88-40d3-bf32-482626e5647d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:32:39 user nova-compute[75246]: No targets found.
Nov 28 17:32:39 user nova-compute[75246]: iSNS:
Nov 28 17:32:39 user nova-compute[75246]: No targets found.
Nov 28 17:32:39 user nova-compute[75246]: STATIC:
Nov 28 17:32:39 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0
Nov 28 17:32:39 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:32:39 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:32:39 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435
Nov 28 17:32:39 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:32:39 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:32:39 user nova-compute[75246]: FIRMWARE:
Nov 28 17:32:39 user nova-compute[75246]: No targets found.
Nov 28 17:32:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:32:39 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:32:39 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e41bc1f-3538-4aec-8eda-f2d08ff912ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.183s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd07b44-8e27-4fed-84c5-b5a12e2b6d19]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:32:39 user nova-compute[75246]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:32:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 (non-flash)
Nov 28 17:32:39 user nova-compute[75246]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:32:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d8361510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435'): ({'sdb'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Removing single pathed devices sdb {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3a80d5-baa0-435d-bdcf-21b14683a817]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7644b641-b6af-4a35-9782-13f5024994e4]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Flushing IO for device /dev/sdb {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87c41c3-76a3-4180-a14d-859fd585b719]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.200s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8e9baa-351c-420a-9eb6-f5439f895068]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[70912bce-90a6-4b44-a964-236a15498e45]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d5d437-f340-434e-8707-fbd87cea43d8]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435, portal: 172.16.0.220,3260]
Nov 28 17:32:39 user nova-compute[75246]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435, portal: 172.16.0.220,3260] successful.
Nov 28 17:32:39 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e71659f-575e-45b1-81fb-67856b67b435 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4d7671-5055-46e6-8b41-adea63ba01b3]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.630s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] <== disconnect_volume: return (632ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:32:39 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Deleting instance files /opt/stack/data/nova/instances/a796152e-e8df-41bf-a5ea-ae94d4fa8b41_del
Nov 28 17:32:39 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Deletion of /opt/stack/data/nova/instances/a796152e-e8df-41bf-a5ea-ae94d4fa8b41_del complete
Nov 28 17:32:39 user nova-compute[75246]: INFO nova.compute.manager [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Took 1.48 seconds to destroy the instance on the hypervisor.
Nov 28 17:32:39 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:32:39 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:32:40 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:32:40 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Took 0.40 seconds to deallocate network for instance.
Nov 28 17:32:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-60c36f1d-a76d-49fe-adbd-750cb7d8b584 req-92f12efe-195f-40e5-ba01-acc12e713c3f service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-vif-deleted-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:32:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-c32232c4-474d-42e8-bfff-e4a8bf900dab req-3264f4a3-ec81-4da9-ae44-8583c460d899 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:32:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c32232c4-474d-42e8-bfff-e4a8bf900dab req-3264f4a3-ec81-4da9-ae44-8583c460d899 service nova] Acquiring lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:32:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c32232c4-474d-42e8-bfff-e4a8bf900dab req-3264f4a3-ec81-4da9-ae44-8583c460d899 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:32:40 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c32232c4-474d-42e8-bfff-e4a8bf900dab req-3264f4a3-ec81-4da9-ae44-8583c460d899 service nova] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:32:40 user nova-compute[75246]: DEBUG nova.compute.manager [req-c32232c4-474d-42e8-bfff-e4a8bf900dab req-3264f4a3-ec81-4da9-ae44-8583c460d899 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] No waiting events found dispatching network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:32:40 user nova-compute[75246]: WARNING nova.compute.manager [req-c32232c4-474d-42e8-bfff-e4a8bf900dab req-3264f4a3-ec81-4da9-ae44-8583c460d899 service nova] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Received unexpected event network-vif-plugged-a311cb50-be83-4bf0-b889-d02170d667d6 for instance with vm_state active and task_state deleting.
Nov 28 17:32:41 user nova-compute[75246]: INFO nova.compute.manager [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: a796152e-e8df-41bf-a5ea-ae94d4fa8b41] Took 0.77 seconds to detach 1 volumes for instance.
Nov 28 17:32:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:32:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:32:41 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:32:41 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:32:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:32:41 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Deleted allocations for instance a796152e-e8df-41bf-a5ea-ae94d4fa8b41
Nov 28 17:32:41 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-2b3e5b57-27ba-415b-8e91-067e16676864 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "a796152e-e8df-41bf-a5ea-ae94d4fa8b41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.016s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:32:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:32:44 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:32:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:32:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:32:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:32:45 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:32:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:32:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:32:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:32:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:32:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:32:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:32:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:32:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:32:45 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:32:46 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:32:46 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:32:46 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8751MB free_disk=25.053504943847656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:32:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:32:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:32:46 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 894da7a3-9c67-417e-b0f4-306335a533e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:32:46 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a4be3afd-5e52-4915-9cfe-83bf205d3c19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:32:46 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:32:46 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:32:46 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:32:46 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:32:46 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:32:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:32:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:32:49 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:32:49 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:32:49 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:32:49 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:32:50 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:32:50 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:32:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:32:54 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:32:54 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:32:57 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:32:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:32:58 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:32:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:33:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:33:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:33:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:33:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:33:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:33:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:33:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:33:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "894da7a3-9c67-417e-b0f4-306335a533e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "894da7a3-9c67-417e-b0f4-306335a533e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "894da7a3-9c67-417e-b0f4-306335a533e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "894da7a3-9c67-417e-b0f4-306335a533e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "894da7a3-9c67-417e-b0f4-306335a533e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:33:29 user nova-compute[75246]: INFO nova.compute.manager [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Terminating instance
Nov 28 17:33:29 user nova-compute[75246]: DEBUG nova.compute.manager [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG nova.compute.manager [req-6245b69d-6130-4030-af12-82e0fa9f22ae req-c15290d8-d563-4bef-9adc-24bb21684c1c service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Received event network-vif-unplugged-003f5480-4452-4891-8713-532403877f31 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6245b69d-6130-4030-af12-82e0fa9f22ae req-c15290d8-d563-4bef-9adc-24bb21684c1c service nova] Acquiring lock "894da7a3-9c67-417e-b0f4-306335a533e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6245b69d-6130-4030-af12-82e0fa9f22ae req-c15290d8-d563-4bef-9adc-24bb21684c1c service nova] Lock "894da7a3-9c67-417e-b0f4-306335a533e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-6245b69d-6130-4030-af12-82e0fa9f22ae req-c15290d8-d563-4bef-9adc-24bb21684c1c service nova] Lock "894da7a3-9c67-417e-b0f4-306335a533e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG nova.compute.manager [req-6245b69d-6130-4030-af12-82e0fa9f22ae req-c15290d8-d563-4bef-9adc-24bb21684c1c service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] No waiting events found dispatching network-vif-unplugged-003f5480-4452-4891-8713-532403877f31 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG nova.compute.manager [req-6245b69d-6130-4030-af12-82e0fa9f22ae req-c15290d8-d563-4bef-9adc-24bb21684c1c service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Received event network-vif-unplugged-003f5480-4452-4891-8713-532403877f31 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:33:29 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Instance destroyed successfully.
Nov 28 17:33:29 user nova-compute[75246]: DEBUG nova.objects.instance [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lazy-loading 'resources' on Instance uuid 894da7a3-9c67-417e-b0f4-306335a533e6 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:13:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-147363844',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-147363844',id=33,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:13:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faec5bcef3e2441fba30b593c13d5516',ramdisk_id='',reservation_id='r-i4q709fp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-506006079',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:15:49Z,user_data=None,user_id='af8b6c3f092547dbbf3debe96c594590',uuid=894da7a3-9c67-417e-b0f4-306335a533e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "003f5480-4452-4891-8713-532403877f31", "address": "fa:16:3e:8d:b0:79", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap003f5480-44", "ovs_interfaceid": "003f5480-4452-4891-8713-532403877f31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converting VIF {"id": "003f5480-4452-4891-8713-532403877f31", "address": "fa:16:3e:8d:b0:79", "network": {"id": "5e3b2006-2190-4db6-b7ba-38910e155e50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-608933712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faec5bcef3e2441fba30b593c13d5516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap003f5480-44", "ovs_interfaceid": "003f5480-4452-4891-8713-532403877f31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:b0:79,bridge_name='br-int',has_traffic_filtering=True,id=003f5480-4452-4891-8713-532403877f31,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap003f5480-44') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG os_vif [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:b0:79,bridge_name='br-int',has_traffic_filtering=True,id=003f5480-4452-4891-8713-532403877f31,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap003f5480-44') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap003f5480-44, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1a38657-172a-4d91-a9dc-61879b1e5416) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:33:29 user nova-compute[75246]: INFO os_vif [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:b0:79,bridge_name='br-int',has_traffic_filtering=True,id=003f5480-4452-4891-8713-532403877f31,network=Network(5e3b2006-2190-4db6-b7ba-38910e155e50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap003f5480-44')
Nov 28 17:33:29 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Deleting instance files /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6_del
Nov 28 17:33:29 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Deletion of /opt/stack/data/nova/instances/894da7a3-9c67-417e-b0f4-306335a533e6_del complete
Nov 28 17:33:29 user nova-compute[75246]: INFO nova.compute.manager [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 28 17:33:29 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:33:29 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:33:30 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:33:30 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Took 0.43 seconds to deallocate network for instance.
Nov 28 17:33:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-3631662e-2fe3-46b8-8ea6-7dc13e50eb2f req-c194bd48-3301-45bf-975f-f1b5b8cd2c4e service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Received event network-vif-deleted-003f5480-4452-4891-8713-532403877f31 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:33:30 user nova-compute[75246]: INFO nova.compute.manager [req-3631662e-2fe3-46b8-8ea6-7dc13e50eb2f req-c194bd48-3301-45bf-975f-f1b5b8cd2c4e service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Neutron deleted interface 003f5480-4452-4891-8713-532403877f31; detaching it from the instance and deleting it from the info cache
Nov 28 17:33:30 user nova-compute[75246]: DEBUG nova.network.neutron [req-3631662e-2fe3-46b8-8ea6-7dc13e50eb2f req-c194bd48-3301-45bf-975f-f1b5b8cd2c4e service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:33:30 user nova-compute[75246]: DEBUG nova.compute.manager [req-3631662e-2fe3-46b8-8ea6-7dc13e50eb2f req-c194bd48-3301-45bf-975f-f1b5b8cd2c4e service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Detach interface failed, port_id=003f5480-4452-4891-8713-532403877f31, reason: Instance 894da7a3-9c67-417e-b0f4-306335a533e6 could not be found. {{(pid=75246) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 17:33:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:33:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:33:30 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:33:30 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:33:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:33:30 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Deleted allocations for instance 894da7a3-9c67-417e-b0f4-306335a533e6
Nov 28 17:33:30 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-564b809a-ec76-4b70-9642-fc14d7c2f1b7 tempest-ServerBootFromVolumeStableRescueTest-506006079 tempest-ServerBootFromVolumeStableRescueTest-506006079-project-member] Lock "894da7a3-9c67-417e-b0f4-306335a533e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.442s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:33:31 user nova-compute[75246]: DEBUG nova.compute.manager [req-7f0f4435-0c3d-4e37-aae7-f938654a29a1 req-f271e6e5-0fe2-4af1-ac5a-8770fbe63871 service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Received event network-vif-plugged-003f5480-4452-4891-8713-532403877f31 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:33:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7f0f4435-0c3d-4e37-aae7-f938654a29a1 req-f271e6e5-0fe2-4af1-ac5a-8770fbe63871 service nova] Acquiring lock "894da7a3-9c67-417e-b0f4-306335a533e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:33:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7f0f4435-0c3d-4e37-aae7-f938654a29a1 req-f271e6e5-0fe2-4af1-ac5a-8770fbe63871 service nova] Lock "894da7a3-9c67-417e-b0f4-306335a533e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:33:31 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7f0f4435-0c3d-4e37-aae7-f938654a29a1 req-f271e6e5-0fe2-4af1-ac5a-8770fbe63871 service nova] Lock "894da7a3-9c67-417e-b0f4-306335a533e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:33:31 user nova-compute[75246]: DEBUG nova.compute.manager [req-7f0f4435-0c3d-4e37-aae7-f938654a29a1 req-f271e6e5-0fe2-4af1-ac5a-8770fbe63871 service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] No waiting events found dispatching network-vif-plugged-003f5480-4452-4891-8713-532403877f31 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:33:31 user nova-compute[75246]: WARNING nova.compute.manager [req-7f0f4435-0c3d-4e37-aae7-f938654a29a1 req-f271e6e5-0fe2-4af1-ac5a-8770fbe63871 service nova] [instance: 894da7a3-9c67-417e-b0f4-306335a533e6] Received unexpected event network-vif-plugged-003f5480-4452-4891-8713-532403877f31 for instance with vm_state deleted and task_state None.
Nov 28 17:33:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:33:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:33:44 user nova-compute[75246]: INFO nova.compute.manager [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Detaching volume d8810c2e-42cd-4534-a172-019140500ba0
Nov 28 17:33:44 user nova-compute[75246]: INFO nova.virt.block_device [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Attempting to driver detach volume d8810c2e-42cd-4534-a172-019140500ba0 from mountpoint /dev/vdb
Nov 28 17:33:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Attempting to detach device vdb from instance a4be3afd-5e52-4915-9cfe-83bf205d3c19 from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:33:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:33:44 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:33:44 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:33:44 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:33:44 user nova-compute[75246]:   <serial>d8810c2e-42cd-4534-a172-019140500ba0</serial>
Nov 28 17:33:44 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 17:33:44 user nova-compute[75246]: </disk>
Nov 28 17:33:44 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:33:44 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Successfully detached device vdb from instance a4be3afd-5e52-4915-9cfe-83bf205d3c19 from the persistent domain config.
Nov 28 17:33:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4be3afd-5e52-4915-9cfe-83bf205d3c19 from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:33:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:33:44 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:33:44 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:33:44 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:33:44 user nova-compute[75246]:   <serial>d8810c2e-42cd-4534-a172-019140500ba0</serial>
Nov 28 17:33:44 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 17:33:44 user nova-compute[75246]: </disk>
Nov 28 17:33:44 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:33:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:33:46 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:33:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:33:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:33:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:33:47 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:33:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:33:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:33:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:33:47 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:33:47 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:33:47 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:33:47 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8909MB free_disk=25.177841186523438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:33:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:33:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:33:47 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a4be3afd-5e52-4915-9cfe-83bf205d3c19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:33:47 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:33:47 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:33:47 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:33:47 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:33:47 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:33:47 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:33:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:49 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:33:50 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:33:50 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:33:50 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:33:51 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:33:51 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:33:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:53 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:33:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:56 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:33:56 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:33:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:33:59 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:33:59 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:33:59 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:34:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:34:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:34:00 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:34:00 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lazy-loading 'info_cache' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:34:00 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updating instance_info_cache with network_info: [{"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:34:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:34:00 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:34:04 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4be3afd-5e52-4915-9cfe-83bf205d3c19 is timed out.
Nov 28 17:34:04 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Successfully detached device vdb from instance a4be3afd-5e52-4915-9cfe-83bf205d3c19 from the live domain config.
Nov 28 17:34:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEjTQZkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:34:04 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ceac6f9-be34-4ec6-8db9-083c24cd5b94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:34:04 user nova-compute[75246]: No targets found.
Nov 28 17:34:04 user nova-compute[75246]: iSNS:
Nov 28 17:34:04 user nova-compute[75246]: No targets found.
Nov 28 17:34:04 user nova-compute[75246]: STATIC:
Nov 28 17:34:04 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0
Nov 28 17:34:04 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:34:04 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:34:04 user nova-compute[75246]: FIRMWARE:
Nov 28 17:34:04 user nova-compute[75246]: No targets found.
Nov 28 17:34:04 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:34:04 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:34:04 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16f4985-5a46-4d37-8a1e-b3018826ae1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e919e81d-3089-4c4d-839b-de399900ae9f]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:34:04 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 (non-flash)
Nov 28 17:34:04 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4fbbdfa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0'): ({'sdc'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Removing single pathed devices sdc {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[866572c7-c354-4f0a-9897-972e4675787a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7439f94d-be3f-489b-86f9-428fbdc26c06]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Flushing IO for device /dev/sdc {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9ccf93-476c-4b29-a114-2fc6b5bffb99]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef70760-82c1-4e78-b7ef-2d19f98192a6]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aae9354-cdb5-49ae-bbd6-34cab16b8d77]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63311fa-7e28-4280-a4ee-703b3925ca3a]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0, portal: 172.16.0.220,3260]
Nov 28 17:34:04 user nova-compute[75246]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0, portal: 172.16.0.220,3260] successful.
Nov 28 17:34:04 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8810c2e-42cd-4534-a172-019140500ba0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaeb56d7-4e0b-4028-a09c-5a5105e67600]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] <== disconnect_volume: return (295ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:34:04 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:34:05 user nova-compute[75246]: DEBUG nova.objects.instance [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'flavor' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:34:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-82235491-dde4-400c-a96b-91a09da88dd8 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.582s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:34:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96eeb0a8-e727-487d-8195-06fe434b8440 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:34:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96eeb0a8-e727-487d-8195-06fe434b8440 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:34:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-96eeb0a8-e727-487d-8195-06fe434b8440 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:34:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-96eeb0a8-e727-487d-8195-06fe434b8440 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75246) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 28 17:34:06 user nova-compute[75246]: DEBUG nova.objects.instance [None req-96eeb0a8-e727-487d-8195-06fe434b8440 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'flavor' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:34:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:34:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:34:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:34:06 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:34:07 user nova-compute[75246]: DEBUG nova.compute.manager [req-bec26977-6a98-47bb-95a6-7cec8a1f2df2 req-fc586ee4-99cf-476f-90b5-7c53ea3239d3 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received event network-vif-unplugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:34:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-bec26977-6a98-47bb-95a6-7cec8a1f2df2 req-fc586ee4-99cf-476f-90b5-7c53ea3239d3 service nova] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:34:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-bec26977-6a98-47bb-95a6-7cec8a1f2df2 req-fc586ee4-99cf-476f-90b5-7c53ea3239d3 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:34:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-bec26977-6a98-47bb-95a6-7cec8a1f2df2 req-fc586ee4-99cf-476f-90b5-7c53ea3239d3 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:34:07 user nova-compute[75246]: DEBUG nova.compute.manager [req-bec26977-6a98-47bb-95a6-7cec8a1f2df2 req-fc586ee4-99cf-476f-90b5-7c53ea3239d3 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] No waiting events found dispatching network-vif-unplugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:34:07 user nova-compute[75246]: WARNING nova.compute.manager [req-bec26977-6a98-47bb-95a6-7cec8a1f2df2 req-fc586ee4-99cf-476f-90b5-7c53ea3239d3 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received unexpected event network-vif-unplugged-747a269b-3828-4182-b28d-8656cbcdfcfb for instance with vm_state active and task_state powering-off.
Nov 28 17:34:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:34:07 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Instance destroyed successfully.
Nov 28 17:34:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-96eeb0a8-e727-487d-8195-06fe434b8440 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:34:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-96eeb0a8-e727-487d-8195-06fe434b8440 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.814s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:34:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-7f5159a7-c406-4912-a0ca-06362eba0bf2 req-4feeae98-ee66-4389-8dc0-135790659520 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received event network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:34:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7f5159a7-c406-4912-a0ca-06362eba0bf2 req-4feeae98-ee66-4389-8dc0-135790659520 service nova] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:34:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7f5159a7-c406-4912-a0ca-06362eba0bf2 req-4feeae98-ee66-4389-8dc0-135790659520 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:34:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-7f5159a7-c406-4912-a0ca-06362eba0bf2 req-4feeae98-ee66-4389-8dc0-135790659520 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:34:09 user nova-compute[75246]: DEBUG nova.compute.manager [req-7f5159a7-c406-4912-a0ca-06362eba0bf2 req-4feeae98-ee66-4389-8dc0-135790659520 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] No waiting events found dispatching network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:34:09 user nova-compute[75246]: WARNING nova.compute.manager [req-7f5159a7-c406-4912-a0ca-06362eba0bf2 req-4feeae98-ee66-4389-8dc0-135790659520 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received unexpected event network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb for instance with vm_state stopped and task_state None.
Nov 28 17:34:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:34:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:34:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:34:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:34:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:34:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:34:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:34:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:34:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:34:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:34:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:34:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:34:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:34:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:34:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:34:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:34:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:34:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:34:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:34:47 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:34:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:34:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:34:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:34:48 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:34:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:34:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:34:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:34:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:34:48 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:34:48 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:34:48 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9072MB free_disk=25.175800323486328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:34:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:34:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:34:48 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a4be3afd-5e52-4915-9cfe-83bf205d3c19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:34:48 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:34:48 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:34:48 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:34:48 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:34:49 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:34:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:34:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:34:50 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:34:50 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:34:51 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:34:52 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:34:52 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:34:53 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:34:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:34:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:34:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:34:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:34:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:34:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:34:57 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:34:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:34:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:34:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:34:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:34:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:34:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:34:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:35:00 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:35:00 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:35:00 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:35:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:35:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:35:01 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:35:01 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lazy-loading 'info_cache' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:35:01 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updating instance_info_cache with network_info: [{"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:35:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:35:01 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:35:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:35:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:35:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:35:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:35:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:35:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:35:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:35:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:35:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:35:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:35:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:35:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:35:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:35:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:35:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:35:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:35:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:35:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:35:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:35:14 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:35:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Verify base images {{(pid=75246) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 28 17:35:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Image id 1ef2d77e-6c24-4e9a-ba2a-b6759061c14d yields fingerprint 8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 {{(pid=75246) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 28 17:35:15 user nova-compute[75246]: INFO nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] image 1ef2d77e-6c24-4e9a-ba2a-b6759061c14d at (/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9): checking
Nov 28 17:35:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] image 1ef2d77e-6c24-4e9a-ba2a-b6759061c14d at (/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9): image is in use {{(pid=75246) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 28 17:35:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75246) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 28 17:35:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] a4be3afd-5e52-4915-9cfe-83bf205d3c19 is a valid instance name {{(pid=75246) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 28 17:35:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] a4be3afd-5e52-4915-9cfe-83bf205d3c19 has a disk file {{(pid=75246) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 28 17:35:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:35:15 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:35:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a4be3afd-5e52-4915-9cfe-83bf205d3c19 is backed by 8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 {{(pid=75246) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 28 17:35:15 user nova-compute[75246]: WARNING nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951
Nov 28 17:35:15 user nova-compute[75246]: WARNING nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc
Nov 28 17:35:15 user nova-compute[75246]: WARNING nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94
Nov 28 17:35:15 user nova-compute[75246]: WARNING nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d
Nov 28 17:35:15 user nova-compute[75246]: WARNING nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a444acb43f3e9fc14e27532062fae38275c7e0f1
Nov 28 17:35:15 user nova-compute[75246]: WARNING nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f0741349bd1a14c0c22dd4b3fac72ec41cd4324b
Nov 28 17:35:15 user nova-compute[75246]: WARNING nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904
Nov 28 17:35:15 user nova-compute[75246]: WARNING nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8d520c14f5a7e31a73072120dc7d186ff0fbf80a
Nov 28 17:35:15 user nova-compute[75246]: WARNING nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3
Nov 28 17:35:15 user nova-compute[75246]: INFO nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Active base files: /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9
Nov 28 17:35:15 user nova-compute[75246]: INFO nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Removable base files: /opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951 /opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc /opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94 /opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d /opt/stack/data/nova/instances/_base/a444acb43f3e9fc14e27532062fae38275c7e0f1 /opt/stack/data/nova/instances/_base/f0741349bd1a14c0c22dd4b3fac72ec41cd4324b /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904 /opt/stack/data/nova/instances/_base/8d520c14f5a7e31a73072120dc7d186ff0fbf80a /opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3
Nov 28 17:35:15 user nova-compute[75246]: INFO nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3c1523c047b31aa2dd58c5fa2fd28fd74bd62951
Nov 28 17:35:15 user nova-compute[75246]: INFO nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/98a4c755859047a9be7cb7200466afe02d4192dc
Nov 28 17:35:15 user nova-compute[75246]: INFO nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/48cc211e93c81418eb476cc0622bb08ddadd0c94
Nov 28 17:35:15 user nova-compute[75246]: INFO nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/348aa57f1044b5ca43d018011788b8dcb09c945d
Nov 28 17:35:15 user nova-compute[75246]: INFO nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a444acb43f3e9fc14e27532062fae38275c7e0f1
Nov 28 17:35:15 user nova-compute[75246]: INFO nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f0741349bd1a14c0c22dd4b3fac72ec41cd4324b
Nov 28 17:35:15 user nova-compute[75246]: INFO nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/462e134ce8e9ab66bc35c7320aac7946ae6a4904
Nov 28 17:35:15 user nova-compute[75246]: INFO nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8d520c14f5a7e31a73072120dc7d186ff0fbf80a
Nov 28 17:35:15 user nova-compute[75246]: INFO nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/daf7d68032796a5015789dabd65fbc150eb60ab3
Nov 28 17:35:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Verification complete {{(pid=75246) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 28 17:35:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Verify swap images {{(pid=75246) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 28 17:35:15 user nova-compute[75246]: DEBUG nova.virt.libvirt.imagecache [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Verify ephemeral images {{(pid=75246) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 28 17:35:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:35:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:35:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:35:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:35:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:35:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:35:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:35:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:35:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:35:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:35:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:35:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:35:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:35:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:35:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:35:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:35:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:35:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:35:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:35:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:35:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:35:49 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:35:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:35:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:35:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:35:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:35:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:35:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:35:49 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:35:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:35:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:35:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:35:50 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:35:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:35:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:35:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:35:50 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:35:50 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:35:50 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:35:50 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9133MB free_disk=25.17508316040039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:35:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:35:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:35:51 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a4be3afd-5e52-4915-9cfe-83bf205d3c19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:35:51 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:35:51 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:35:51 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing inventories for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 17:35:51 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating ProviderTree inventory for provider 241ad926-9deb-44ba-a618-a49e4ac21089 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 17:35:51 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating inventory in ProviderTree for provider 241ad926-9deb-44ba-a618-a49e4ac21089 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 17:35:51 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing aggregate associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, aggregates: None {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 17:35:51 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing trait associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 17:35:51 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:35:51 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:35:51 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:35:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:35:51 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:35:51 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 17:35:51 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] There are 0 instances to clean {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 17:35:53 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:35:53 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:35:53 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:35:53 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:35:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:35:54 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:35:56 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:35:57 user nova-compute[75246]: DEBUG nova.objects.instance [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'flavor' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:35:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:35:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquired lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:35:57 user nova-compute[75246]: DEBUG nova.network.neutron [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:35:57 user nova-compute[75246]: DEBUG nova.objects.instance [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'info_cache' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:35:57 user nova-compute[75246]: DEBUG nova.objects.base [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Object Instance<a4be3afd-5e52-4915-9cfe-83bf205d3c19> lazy-loaded attributes: flavor,info_cache {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:35:57 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:35:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.network.neutron [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updating instance_info_cache with network_info: [{"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Releasing lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:35:58 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Instance destroyed successfully.
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.objects.instance [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'resources' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.objects.base [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Object Instance<a4be3afd-5e52-4915-9cfe-83bf205d3c19> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-293166483',display_name='tempest-AttachVolumeTestJSON-server-293166483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-293166483',id=50,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqe0fw+kudngaeCOPjFm0lglWTUIvqOQoZjQoYYQ9pcKjeJDQFeO5BSrL84EkaMlPyRW3L6sgdr0rYGfEMmOz0UEjXhN0KEjP44F28rNwSbmltWXOH66c/sbByz6lIy7Q==',key_name='tempest-keypair-1328117536',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:28:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ce5e8b8b1dc2469bb172fdc843b8f39c',ramdisk_id='',reservation_id='r-hhnksif4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-32273339',owner_user_name='tempest-AttachVolumeTestJSON-32273339-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:34:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c78d20df77421389d4fb0c5a6d2add',uuid=a4be3afd-5e52-4915-9cfe-83bf205d3c19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converting VIF {"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG os_vif [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap747a269b-38, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=811ebde7-28e7-441f-b749-159f713c9cae) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:35:58 user nova-compute[75246]: INFO os_vif [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38')
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Start _get_guest_xml network_info=[{"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.objects.instance [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'numa_topology' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.objects.base [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Object Instance<a4be3afd-5e52-4915-9cfe-83bf205d3c19> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:35:58 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:35:58 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.objects.instance [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'vcpu_model' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.objects.base [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Object Instance<a4be3afd-5e52-4915-9cfe-83bf205d3c19> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-293166483',display_name='tempest-AttachVolumeTestJSON-server-293166483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-293166483',id=50,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqe0fw+kudngaeCOPjFm0lglWTUIvqOQoZjQoYYQ9pcKjeJDQFeO5BSrL84EkaMlPyRW3L6sgdr0rYGfEMmOz0UEjXhN0KEjP44F28rNwSbmltWXOH66c/sbByz6lIy7Q==',key_name='tempest-keypair-1328117536',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:28:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ce5e8b8b1dc2469bb172fdc843b8f39c',ramdisk_id='',reservation_id='r-hhnksif4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-32273339',owner_user_name='tempest-AttachVolumeTestJSON-32273339-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:34:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c78d20df77421389d4fb0c5a6d2add',uuid=a4be3afd-5e52-4915-9cfe-83bf205d3c19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converting VIF {"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.objects.instance [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'pci_devices' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.objects.base [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Object Instance<a4be3afd-5e52-4915-9cfe-83bf205d3c19> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:35:58 user nova-compute[75246]:   <uuid>a4be3afd-5e52-4915-9cfe-83bf205d3c19</uuid>
Nov 28 17:35:58 user nova-compute[75246]:   <name>instance-00000032</name>
Nov 28 17:35:58 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:35:58 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:35:58 user nova-compute[75246]:   <metadata>
Nov 28 17:35:58 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:35:58 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:35:58 user nova-compute[75246]:       <nova:name>tempest-AttachVolumeTestJSON-server-293166483</nova:name>
Nov 28 17:35:58 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:35:58</nova:creationTime>
Nov 28 17:35:58 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:35:58 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:35:58 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:35:58 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:35:58 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:35:58 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:35:58 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:35:58 user nova-compute[75246]:       <nova:owner>
Nov 28 17:35:58 user nova-compute[75246]:         <nova:user uuid="c0c78d20df77421389d4fb0c5a6d2add">tempest-AttachVolumeTestJSON-32273339-project-member</nova:user>
Nov 28 17:35:58 user nova-compute[75246]:         <nova:project uuid="ce5e8b8b1dc2469bb172fdc843b8f39c">tempest-AttachVolumeTestJSON-32273339</nova:project>
Nov 28 17:35:58 user nova-compute[75246]:       </nova:owner>
Nov 28 17:35:58 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:35:58 user nova-compute[75246]:       <nova:ports>
Nov 28 17:35:58 user nova-compute[75246]:         <nova:port uuid="747a269b-3828-4182-b28d-8656cbcdfcfb">
Nov 28 17:35:58 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 17:35:58 user nova-compute[75246]:         </nova:port>
Nov 28 17:35:58 user nova-compute[75246]:       </nova:ports>
Nov 28 17:35:58 user nova-compute[75246]:     </nova:instance>
Nov 28 17:35:58 user nova-compute[75246]:   </metadata>
Nov 28 17:35:58 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:35:58 user nova-compute[75246]:     <system>
Nov 28 17:35:58 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:35:58 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:35:58 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:35:58 user nova-compute[75246]:       <entry name="serial">a4be3afd-5e52-4915-9cfe-83bf205d3c19</entry>
Nov 28 17:35:58 user nova-compute[75246]:       <entry name="uuid">a4be3afd-5e52-4915-9cfe-83bf205d3c19</entry>
Nov 28 17:35:58 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:35:58 user nova-compute[75246]:     </system>
Nov 28 17:35:58 user nova-compute[75246]:   </sysinfo>
Nov 28 17:35:58 user nova-compute[75246]:   <os>
Nov 28 17:35:58 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:35:58 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:35:58 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:35:58 user nova-compute[75246]:   </os>
Nov 28 17:35:58 user nova-compute[75246]:   <features>
Nov 28 17:35:58 user nova-compute[75246]:     <acpi/>
Nov 28 17:35:58 user nova-compute[75246]:     <apic/>
Nov 28 17:35:58 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:35:58 user nova-compute[75246]:   </features>
Nov 28 17:35:58 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:35:58 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:35:58 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:35:58 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:35:58 user nova-compute[75246]:   </clock>
Nov 28 17:35:58 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:35:58 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:35:58 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:35:58 user nova-compute[75246]:   </cpu>
Nov 28 17:35:58 user nova-compute[75246]:   <devices>
Nov 28 17:35:58 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:35:58 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:35:58 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk"/>
Nov 28 17:35:58 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:35:58 user nova-compute[75246]:     </disk>
Nov 28 17:35:58 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:35:58 user nova-compute[75246]:       <mac address="fa:16:3e:e0:a4:7b"/>
Nov 28 17:35:58 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:35:58 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:35:58 user nova-compute[75246]:       <target dev="tap747a269b-38"/>
Nov 28 17:35:58 user nova-compute[75246]:     </interface>
Nov 28 17:35:58 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:35:58 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/console.log" append="off"/>
Nov 28 17:35:58 user nova-compute[75246]:     </serial>
Nov 28 17:35:58 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:35:58 user nova-compute[75246]:     <video>
Nov 28 17:35:58 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:35:58 user nova-compute[75246]:     </video>
Nov 28 17:35:58 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:35:58 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:35:58 user nova-compute[75246]:     </rng>
Nov 28 17:35:58 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:35:58 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:35:58 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:35:58 user nova-compute[75246]:     </memballoon>
Nov 28 17:35:58 user nova-compute[75246]:   </devices>
Nov 28 17:35:58 user nova-compute[75246]: </domain>
Nov 28 17:35:58 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.objects.instance [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'trusted_certs' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.objects.base [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Object Instance<a4be3afd-5e52-4915-9cfe-83bf205d3c19> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:35:58 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Cannot resize image /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG nova.objects.instance [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'migration_context' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG nova.objects.base [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Object Instance<a4be3afd-5e52-4915-9cfe-83bf205d3c19> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75246) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-293166483',display_name='tempest-AttachVolumeTestJSON-server-293166483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-293166483',id=50,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqe0fw+kudngaeCOPjFm0lglWTUIvqOQoZjQoYYQ9pcKjeJDQFeO5BSrL84EkaMlPyRW3L6sgdr0rYGfEMmOz0UEjXhN0KEjP44F28rNwSbmltWXOH66c/sbByz6lIy7Q==',key_name='tempest-keypair-1328117536',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:28:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ce5e8b8b1dc2469bb172fdc843b8f39c',ramdisk_id='',reservation_id='r-hhnksif4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-32273339',owner_user_name='tempest-AttachVolumeTestJSON-32273339-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:34:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c78d20df77421389d4fb0c5a6d2add',uuid=a4be3afd-5e52-4915-9cfe-83bf205d3c19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converting VIF {"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG os_vif [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b1e92a0-1b25-5fa3-ae66-8750ca8cad08', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap747a269b-38, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap747a269b-38, col_values=(('qos', UUID('6d40ca61-4905-4249-8ff6-5784882d1173')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap747a269b-38, col_values=(('external_ids', {'iface-id': '747a269b-3828-4182-b28d-8656cbcdfcfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:a4:7b', 'vm-uuid': 'a4be3afd-5e52-4915-9cfe-83bf205d3c19'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:35:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:35:59 user nova-compute[75246]: INFO os_vif [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38')
Nov 28 17:36:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-c9b2a18c-b4f7-4fe4-9ae9-ee9cfa897d0b req-e0cbd0f9-d7ef-4288-8340-9cdac175a368 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received event network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:36:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c9b2a18c-b4f7-4fe4-9ae9-ee9cfa897d0b req-e0cbd0f9-d7ef-4288-8340-9cdac175a368 service nova] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:36:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c9b2a18c-b4f7-4fe4-9ae9-ee9cfa897d0b req-e0cbd0f9-d7ef-4288-8340-9cdac175a368 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:36:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c9b2a18c-b4f7-4fe4-9ae9-ee9cfa897d0b req-e0cbd0f9-d7ef-4288-8340-9cdac175a368 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:36:00 user nova-compute[75246]: DEBUG nova.compute.manager [req-c9b2a18c-b4f7-4fe4-9ae9-ee9cfa897d0b req-e0cbd0f9-d7ef-4288-8340-9cdac175a368 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] No waiting events found dispatching network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:36:00 user nova-compute[75246]: WARNING nova.compute.manager [req-c9b2a18c-b4f7-4fe4-9ae9-ee9cfa897d0b req-e0cbd0f9-d7ef-4288-8340-9cdac175a368 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received unexpected event network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb for instance with vm_state stopped and task_state powering-on.
Nov 28 17:36:00 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:36:00 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:36:00 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:36:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:36:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:36:01 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:36:01 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lazy-loading 'info_cache' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:36:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:01 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:01 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updating instance_info_cache with network_info: [{"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:36:01 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:36:01 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:36:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-9e95208e-83b9-4847-97d7-9df3ed8e3ca6 req-d5dab3b6-ad2c-4488-93c8-491181a9c3e9 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received event network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:36:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e95208e-83b9-4847-97d7-9df3ed8e3ca6 req-d5dab3b6-ad2c-4488-93c8-491181a9c3e9 service nova] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:36:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e95208e-83b9-4847-97d7-9df3ed8e3ca6 req-d5dab3b6-ad2c-4488-93c8-491181a9c3e9 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:36:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-9e95208e-83b9-4847-97d7-9df3ed8e3ca6 req-d5dab3b6-ad2c-4488-93c8-491181a9c3e9 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:36:02 user nova-compute[75246]: DEBUG nova.compute.manager [req-9e95208e-83b9-4847-97d7-9df3ed8e3ca6 req-d5dab3b6-ad2c-4488-93c8-491181a9c3e9 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] No waiting events found dispatching network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:36:02 user nova-compute[75246]: WARNING nova.compute.manager [req-9e95208e-83b9-4847-97d7-9df3ed8e3ca6 req-d5dab3b6-ad2c-4488-93c8-491181a9c3e9 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received unexpected event network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb for instance with vm_state stopped and task_state powering-on.
Nov 28 17:36:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:36:02 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Instance rebooted successfully.
Nov 28 17:36:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-17d8e5eb-b259-46ba-9f64-855afc360865 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:36:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:36:14 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75246) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 17:36:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:19 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:36:22 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:27 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:32 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:36:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:36:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:36:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:36:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:36:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:36:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:36:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:36:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:36:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:36:49 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:36:51 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:36:51 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:36:51 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:36:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:36:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:36:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:36:52 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:36:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:36:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:36:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:36:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:36:52 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:36:52 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:36:52 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8963MB free_disk=25.173641204833984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:36:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:36:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:36:52 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance a4be3afd-5e52-4915-9cfe-83bf205d3c19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:36:52 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:36:52 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:36:52 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:36:52 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:36:53 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:36:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:36:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:36:55 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:36:55 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:36:55 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:36:57 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:36:57 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:36:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:37:01 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:37:01 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:37:01 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:37:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:37:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:37:02 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:37:02 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lazy-loading 'info_cache' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:37:02 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updating instance_info_cache with network_info: [{"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:37:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-a4be3afd-5e52-4915-9cfe-83bf205d3c19" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:37:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:37:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:37:08 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:37:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Triggering sync for uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 17:37:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:37:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:37:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:37:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:37:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:37:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:37:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:37:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:37:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:37:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:37:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:37:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:37:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:37:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:37:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:37:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:37:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:37:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:37:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:37:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:37:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:37:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:37:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:37:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:37:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:37:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:37:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:37:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:37:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:37:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:37:48 user nova-compute[75246]: INFO nova.compute.manager [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Terminating instance
Nov 28 17:37:48 user nova-compute[75246]: DEBUG nova.compute.manager [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:37:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:48 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-3fffc244-a76c-487c-850b-b96af115c034 req-fc742371-40df-4a32-b215-00a9a1303d27 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received event network-vif-unplugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3fffc244-a76c-487c-850b-b96af115c034 req-fc742371-40df-4a32-b215-00a9a1303d27 service nova] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3fffc244-a76c-487c-850b-b96af115c034 req-fc742371-40df-4a32-b215-00a9a1303d27 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-3fffc244-a76c-487c-850b-b96af115c034 req-fc742371-40df-4a32-b215-00a9a1303d27 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-3fffc244-a76c-487c-850b-b96af115c034 req-fc742371-40df-4a32-b215-00a9a1303d27 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] No waiting events found dispatching network-vif-unplugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG nova.compute.manager [req-3fffc244-a76c-487c-850b-b96af115c034 req-fc742371-40df-4a32-b215-00a9a1303d27 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received event network-vif-unplugged-747a269b-3828-4182-b28d-8656cbcdfcfb for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:49 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Instance destroyed successfully.
Nov 28 17:37:49 user nova-compute[75246]: DEBUG nova.objects.instance [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'resources' on Instance uuid a4be3afd-5e52-4915-9cfe-83bf205d3c19 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-293166483',display_name='tempest-AttachVolumeTestJSON-server-293166483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-293166483',id=50,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqe0fw+kudngaeCOPjFm0lglWTUIvqOQoZjQoYYQ9pcKjeJDQFeO5BSrL84EkaMlPyRW3L6sgdr0rYGfEMmOz0UEjXhN0KEjP44F28rNwSbmltWXOH66c/sbByz6lIy7Q==',key_name='tempest-keypair-1328117536',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:28:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce5e8b8b1dc2469bb172fdc843b8f39c',ramdisk_id='',reservation_id='r-hhnksif4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-32273339',owner_user_name='tempest-AttachVolumeTestJSON-32273339-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c78d20df77421389d4fb0c5a6d2add',uuid=a4be3afd-5e52-4915-9cfe-83bf205d3c19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converting VIF {"id": "747a269b-3828-4182-b28d-8656cbcdfcfb", "address": "fa:16:3e:e0:a4:7b", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap747a269b-38", "ovs_interfaceid": "747a269b-3828-4182-b28d-8656cbcdfcfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG os_vif [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap747a269b-38, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d40ca61-4905-4249-8ff6-5784882d1173) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:37:49 user nova-compute[75246]: INFO os_vif [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a4:7b,bridge_name='br-int',has_traffic_filtering=True,id=747a269b-3828-4182-b28d-8656cbcdfcfb,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap747a269b-38')
Nov 28 17:37:49 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Deleting instance files /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19_del
Nov 28 17:37:49 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Deletion of /opt/stack/data/nova/instances/a4be3afd-5e52-4915-9cfe-83bf205d3c19_del complete
Nov 28 17:37:49 user nova-compute[75246]: INFO nova.compute.manager [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 28 17:37:49 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:37:49 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:37:50 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:37:50 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Took 0.73 seconds to deallocate network for instance.
Nov 28 17:37:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:37:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:37:50 user nova-compute[75246]: DEBUG nova.compute.manager [req-111909f3-33e4-4673-9b6c-e7f60c3e16e1 req-784d989a-1a16-4c45-ab5f-3efbb997657b service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received event network-vif-deleted-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:37:50 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:37:50 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:37:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:37:50 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Deleted allocations for instance a4be3afd-5e52-4915-9cfe-83bf205d3c19
Nov 28 17:37:50 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-4f9a995f-4457-4efb-82a1-e33fdf48acce tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.967s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:37:51 user nova-compute[75246]: DEBUG nova.compute.manager [req-f20cc967-9777-4965-acf0-3d2f90f8411d req-6d2d8e02-2c9b-42d8-8799-1c05f2aec3b8 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received event network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:37:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f20cc967-9777-4965-acf0-3d2f90f8411d req-6d2d8e02-2c9b-42d8-8799-1c05f2aec3b8 service nova] Acquiring lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:37:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f20cc967-9777-4965-acf0-3d2f90f8411d req-6d2d8e02-2c9b-42d8-8799-1c05f2aec3b8 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:37:51 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-f20cc967-9777-4965-acf0-3d2f90f8411d req-6d2d8e02-2c9b-42d8-8799-1c05f2aec3b8 service nova] Lock "a4be3afd-5e52-4915-9cfe-83bf205d3c19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:37:51 user nova-compute[75246]: DEBUG nova.compute.manager [req-f20cc967-9777-4965-acf0-3d2f90f8411d req-6d2d8e02-2c9b-42d8-8799-1c05f2aec3b8 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] No waiting events found dispatching network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:37:51 user nova-compute[75246]: WARNING nova.compute.manager [req-f20cc967-9777-4965-acf0-3d2f90f8411d req-6d2d8e02-2c9b-42d8-8799-1c05f2aec3b8 service nova] [instance: a4be3afd-5e52-4915-9cfe-83bf205d3c19] Received unexpected event network-vif-plugged-747a269b-3828-4182-b28d-8656cbcdfcfb for instance with vm_state deleted and task_state None.
Nov 28 17:37:51 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:37:51 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:37:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:37:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:37:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:37:52 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:37:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:52 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:37:52 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:37:52 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9109MB free_disk=25.201152801513672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:37:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:37:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:37:52 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:37:52 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:37:52 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:37:52 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:37:52 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:37:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:37:53 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:37:53 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:37:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:54 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:37:54 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:37:54 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:37:57 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:37:58 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:37:58 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:37:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:01 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:38:02 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:38:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:38:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:38:03 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:38:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:38:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:38:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:38:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:38:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:38:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:09 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:38:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:38:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:38:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:38:14 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:19 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:38:24 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:29 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:38:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:39 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:38:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:38:42 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Starting instance... {{(pid=75246) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75246) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 17:38:43 user nova-compute[75246]: INFO nova.compute.claims [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Claim successful on node user
Nov 28 17:38:43 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.177s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Start building networks asynchronously for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Allocating IP information in the background. {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] allocate_for_instance() {{(pid=75246) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 17:38:43 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 17:38:43 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Start building block device mappings for instance. {{(pid=75246) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG nova.policy [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0c78d20df77421389d4fb0c5a6d2add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5e8b8b1dc2469bb172fdc843b8f39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75246) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Start spawning the instance on the hypervisor. {{(pid=75246) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Creating instance directory {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 17:38:43 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Creating image(s)
Nov 28 17:38:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "/opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "/opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "/opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.168s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.181s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk 1073741824 {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9,backing_fmt=raw /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk 1073741824" returned: 0 in 0.047s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "8c3bab1f4983e192e97a11992fe8af6ccd28d0d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c3bab1f4983e192e97a11992fe8af6ccd28d0d9 --force-share --output=json" returned: 0 in 0.170s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk. size=1073741824 {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 17:38:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:38:44 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Successfully created port: c616f895-4bba-477a-b7d6-06c84e91fe79 {{(pid=75246) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 17:38:44 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:38:44 user nova-compute[75246]: DEBUG nova.virt.disk.api [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Cannot resize image /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk to a smaller size. {{(pid=75246) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 17:38:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Created local disks {{(pid=75246) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 17:38:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Ensure instance console log exists: /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/console.log {{(pid=75246) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 17:38:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:38:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:38:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:38:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:44 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Successfully updated port: c616f895-4bba-477a-b7d6-06c84e91fe79 {{(pid=75246) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 17:38:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "refresh_cache-68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:38:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquired lock "refresh_cache-68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:38:44 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Building network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 17:38:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-fb30d5f2-a023-44e0-8502-c659de8f4a65 req-99fba27c-ebe7-424b-9f09-fe614af36f59 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Received event network-changed-c616f895-4bba-477a-b7d6-06c84e91fe79 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:38:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-fb30d5f2-a023-44e0-8502-c659de8f4a65 req-99fba27c-ebe7-424b-9f09-fe614af36f59 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Refreshing instance network info cache due to event network-changed-c616f895-4bba-477a-b7d6-06c84e91fe79. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:38:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb30d5f2-a023-44e0-8502-c659de8f4a65 req-99fba27c-ebe7-424b-9f09-fe614af36f59 service nova] Acquiring lock "refresh_cache-68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:38:44 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Instance cache missing network info. {{(pid=75246) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Updating instance_info_cache with network_info: [{"id": "c616f895-4bba-477a-b7d6-06c84e91fe79", "address": "fa:16:3e:b5:a1:81", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc616f895-4b", "ovs_interfaceid": "c616f895-4bba-477a-b7d6-06c84e91fe79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Releasing lock "refresh_cache-68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Instance network_info: |[{"id": "c616f895-4bba-477a-b7d6-06c84e91fe79", "address": "fa:16:3e:b5:a1:81", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc616f895-4b", "ovs_interfaceid": "c616f895-4bba-477a-b7d6-06c84e91fe79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75246) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb30d5f2-a023-44e0-8502-c659de8f4a65 req-99fba27c-ebe7-424b-9f09-fe614af36f59 service nova] Acquired lock "refresh_cache-68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.network.neutron [req-fb30d5f2-a023-44e0-8502-c659de8f4a65 req-99fba27c-ebe7-424b-9f09-fe614af36f59 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Refreshing network info cache for port c616f895-4bba-477a-b7d6-06c84e91fe79 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Start _get_guest_xml network_info=[{"id": "c616f895-4bba-477a-b7d6-06c84e91fe79", "address": "fa:16:3e:b5:a1:81", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc616f895-4b", "ovs_interfaceid": "c616f895-4bba-477a-b7d6-06c84e91fe79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'guest_format': None, 'image_id': '1ef2d77e-6c24-4e9a-ba2a-b6759061c14d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 17:38:45 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:38:45 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CPU controller missing on host. {{(pid=75246) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.host [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CPU controller found on host. {{(pid=75246) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75246) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T16:55:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T16:55:44Z,direct_url=<?>,disk_format='qcow2',id=1ef2d77e-6c24-4e9a-ba2a-b6759061c14d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b8ef2b06a1514b5088e6adece7f4f2f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T16:55:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Flavor limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Image limits 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Flavor pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Image pref 0:0:0 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Got 1 possible topologies {{(pid=75246) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.hardware [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75246) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-482843426',display_name='tempest-AttachVolumeTestJSON-server-482843426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-482843426',id=52,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+LVd+mi2B6E+xx2BnRVOsbGwQ5ZulyhmhHOmo3VfFrJuv7pvSrOdgRK5j0fUMCZyLwrYb4NVCEiRFdHscF3FqHvt+4ZK5u3rJnCja7k9+D7RIGKKxtHqgxZOOfgJXYWQ==',key_name='tempest-keypair-1037248659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce5e8b8b1dc2469bb172fdc843b8f39c',ramdisk_id='',reservation_id='r-je62onpp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-32273339',owner_user_name='tempest-AttachVolumeTestJSON-32273339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c78d20df77421389d4fb0c5a6d2add',uuid=68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c616f895-4bba-477a-b7d6-06c84e91fe79", "address": "fa:16:3e:b5:a1:81", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc616f895-4b", "ovs_interfaceid": "c616f895-4bba-477a-b7d6-06c84e91fe79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75246) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converting VIF {"id": "c616f895-4bba-477a-b7d6-06c84e91fe79", "address": "fa:16:3e:b5:a1:81", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc616f895-4b", "ovs_interfaceid": "c616f895-4bba-477a-b7d6-06c84e91fe79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a1:81,bridge_name='br-int',has_traffic_filtering=True,id=c616f895-4bba-477a-b7d6-06c84e91fe79,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc616f895-4b') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'pci_devices' on Instance uuid 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] End _get_guest_xml xml=<domain type="kvm">
Nov 28 17:38:45 user nova-compute[75246]:   <uuid>68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2</uuid>
Nov 28 17:38:45 user nova-compute[75246]:   <name>instance-00000034</name>
Nov 28 17:38:45 user nova-compute[75246]:   <memory>524288</memory>
Nov 28 17:38:45 user nova-compute[75246]:   <vcpu>1</vcpu>
Nov 28 17:38:45 user nova-compute[75246]:   <metadata>
Nov 28 17:38:45 user nova-compute[75246]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 17:38:45 user nova-compute[75246]:       <nova:package version="0.0.0"/>
Nov 28 17:38:45 user nova-compute[75246]:       <nova:name>tempest-AttachVolumeTestJSON-server-482843426</nova:name>
Nov 28 17:38:45 user nova-compute[75246]:       <nova:creationTime>2023-11-28 17:38:45</nova:creationTime>
Nov 28 17:38:45 user nova-compute[75246]:       <nova:flavor name="m1.tiny">
Nov 28 17:38:45 user nova-compute[75246]:         <nova:memory>512</nova:memory>
Nov 28 17:38:45 user nova-compute[75246]:         <nova:disk>1</nova:disk>
Nov 28 17:38:45 user nova-compute[75246]:         <nova:swap>0</nova:swap>
Nov 28 17:38:45 user nova-compute[75246]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 17:38:45 user nova-compute[75246]:         <nova:vcpus>1</nova:vcpus>
Nov 28 17:38:45 user nova-compute[75246]:       </nova:flavor>
Nov 28 17:38:45 user nova-compute[75246]:       <nova:owner>
Nov 28 17:38:45 user nova-compute[75246]:         <nova:user uuid="c0c78d20df77421389d4fb0c5a6d2add">tempest-AttachVolumeTestJSON-32273339-project-member</nova:user>
Nov 28 17:38:45 user nova-compute[75246]:         <nova:project uuid="ce5e8b8b1dc2469bb172fdc843b8f39c">tempest-AttachVolumeTestJSON-32273339</nova:project>
Nov 28 17:38:45 user nova-compute[75246]:       </nova:owner>
Nov 28 17:38:45 user nova-compute[75246]:       <nova:root type="image" uuid="1ef2d77e-6c24-4e9a-ba2a-b6759061c14d"/>
Nov 28 17:38:45 user nova-compute[75246]:       <nova:ports>
Nov 28 17:38:45 user nova-compute[75246]:         <nova:port uuid="c616f895-4bba-477a-b7d6-06c84e91fe79">
Nov 28 17:38:45 user nova-compute[75246]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 17:38:45 user nova-compute[75246]:         </nova:port>
Nov 28 17:38:45 user nova-compute[75246]:       </nova:ports>
Nov 28 17:38:45 user nova-compute[75246]:     </nova:instance>
Nov 28 17:38:45 user nova-compute[75246]:   </metadata>
Nov 28 17:38:45 user nova-compute[75246]:   <sysinfo type="smbios">
Nov 28 17:38:45 user nova-compute[75246]:     <system>
Nov 28 17:38:45 user nova-compute[75246]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 17:38:45 user nova-compute[75246]:       <entry name="product">OpenStack Nova</entry>
Nov 28 17:38:45 user nova-compute[75246]:       <entry name="version">0.0.0</entry>
Nov 28 17:38:45 user nova-compute[75246]:       <entry name="serial">68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2</entry>
Nov 28 17:38:45 user nova-compute[75246]:       <entry name="uuid">68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2</entry>
Nov 28 17:38:45 user nova-compute[75246]:       <entry name="family">Virtual Machine</entry>
Nov 28 17:38:45 user nova-compute[75246]:     </system>
Nov 28 17:38:45 user nova-compute[75246]:   </sysinfo>
Nov 28 17:38:45 user nova-compute[75246]:   <os>
Nov 28 17:38:45 user nova-compute[75246]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 17:38:45 user nova-compute[75246]:     <boot dev="hd"/>
Nov 28 17:38:45 user nova-compute[75246]:     <smbios mode="sysinfo"/>
Nov 28 17:38:45 user nova-compute[75246]:   </os>
Nov 28 17:38:45 user nova-compute[75246]:   <features>
Nov 28 17:38:45 user nova-compute[75246]:     <acpi/>
Nov 28 17:38:45 user nova-compute[75246]:     <apic/>
Nov 28 17:38:45 user nova-compute[75246]:     <vmcoreinfo/>
Nov 28 17:38:45 user nova-compute[75246]:   </features>
Nov 28 17:38:45 user nova-compute[75246]:   <clock offset="utc">
Nov 28 17:38:45 user nova-compute[75246]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 17:38:45 user nova-compute[75246]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 17:38:45 user nova-compute[75246]:     <timer name="hpet" present="no"/>
Nov 28 17:38:45 user nova-compute[75246]:   </clock>
Nov 28 17:38:45 user nova-compute[75246]:   <cpu mode="custom" match="exact">
Nov 28 17:38:45 user nova-compute[75246]:     <model>Nehalem</model>
Nov 28 17:38:45 user nova-compute[75246]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 17:38:45 user nova-compute[75246]:   </cpu>
Nov 28 17:38:45 user nova-compute[75246]:   <devices>
Nov 28 17:38:45 user nova-compute[75246]:     <disk type="file" device="disk">
Nov 28 17:38:45 user nova-compute[75246]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 17:38:45 user nova-compute[75246]:       <source file="/opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk"/>
Nov 28 17:38:45 user nova-compute[75246]:       <target dev="vda" bus="virtio"/>
Nov 28 17:38:45 user nova-compute[75246]:     </disk>
Nov 28 17:38:45 user nova-compute[75246]:     <interface type="ethernet">
Nov 28 17:38:45 user nova-compute[75246]:       <mac address="fa:16:3e:b5:a1:81"/>
Nov 28 17:38:45 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:38:45 user nova-compute[75246]:       <mtu size="1442"/>
Nov 28 17:38:45 user nova-compute[75246]:       <target dev="tapc616f895-4b"/>
Nov 28 17:38:45 user nova-compute[75246]:     </interface>
Nov 28 17:38:45 user nova-compute[75246]:     <serial type="pty">
Nov 28 17:38:45 user nova-compute[75246]:       <log file="/opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/console.log" append="off"/>
Nov 28 17:38:45 user nova-compute[75246]:     </serial>
Nov 28 17:38:45 user nova-compute[75246]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 17:38:45 user nova-compute[75246]:     <video>
Nov 28 17:38:45 user nova-compute[75246]:       <model type="virtio"/>
Nov 28 17:38:45 user nova-compute[75246]:     </video>
Nov 28 17:38:45 user nova-compute[75246]:     <rng model="virtio">
Nov 28 17:38:45 user nova-compute[75246]:       <backend model="random">/dev/urandom</backend>
Nov 28 17:38:45 user nova-compute[75246]:     </rng>
Nov 28 17:38:45 user nova-compute[75246]:     <controller type="usb" index="0" model="none"/>
Nov 28 17:38:45 user nova-compute[75246]:     <memballoon model="virtio">
Nov 28 17:38:45 user nova-compute[75246]:       <stats period="10"/>
Nov 28 17:38:45 user nova-compute[75246]:     </memballoon>
Nov 28 17:38:45 user nova-compute[75246]:   </devices>
Nov 28 17:38:45 user nova-compute[75246]: </domain>
Nov 28 17:38:45 user nova-compute[75246]:  {{(pid=75246) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-482843426',display_name='tempest-AttachVolumeTestJSON-server-482843426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-482843426',id=52,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+LVd+mi2B6E+xx2BnRVOsbGwQ5ZulyhmhHOmo3VfFrJuv7pvSrOdgRK5j0fUMCZyLwrYb4NVCEiRFdHscF3FqHvt+4ZK5u3rJnCja7k9+D7RIGKKxtHqgxZOOfgJXYWQ==',key_name='tempest-keypair-1037248659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce5e8b8b1dc2469bb172fdc843b8f39c',ramdisk_id='',reservation_id='r-je62onpp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-32273339',owner_user_name='tempest-AttachVolumeTestJSON-32273339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T17:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c78d20df77421389d4fb0c5a6d2add',uuid=68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c616f895-4bba-477a-b7d6-06c84e91fe79", "address": "fa:16:3e:b5:a1:81", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc616f895-4b", "ovs_interfaceid": "c616f895-4bba-477a-b7d6-06c84e91fe79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converting VIF {"id": "c616f895-4bba-477a-b7d6-06c84e91fe79", "address": "fa:16:3e:b5:a1:81", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc616f895-4b", "ovs_interfaceid": "c616f895-4bba-477a-b7d6-06c84e91fe79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a1:81,bridge_name='br-int',has_traffic_filtering=True,id=c616f895-4bba-477a-b7d6-06c84e91fe79,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc616f895-4b') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG os_vif [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a1:81,bridge_name='br-int',has_traffic_filtering=True,id=c616f895-4bba-477a-b7d6-06c84e91fe79,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc616f895-4b') {{(pid=75246) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86e30b0f-891d-534c-bea9-61bb26673cf0', '_type': 'linux-noop'}}, row=False) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc616f895-4b, may_exist=True, interface_attrs={}) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc616f895-4b, col_values=(('qos', UUID('de877dc3-b4ef-4e0a-b798-830411bbbfa2')),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc616f895-4b, col_values=(('external_ids', {'iface-id': 'c616f895-4bba-477a-b7d6-06c84e91fe79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:a1:81', 'vm-uuid': '68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2'}),), if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:45 user nova-compute[75246]: INFO os_vif [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a1:81,bridge_name='br-int',has_traffic_filtering=True,id=c616f895-4bba-477a-b7d6-06c84e91fe79,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc616f895-4b')
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] No VIF found with MAC fa:16:3e:b5:a1:81, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.network.neutron [req-fb30d5f2-a023-44e0-8502-c659de8f4a65 req-99fba27c-ebe7-424b-9f09-fe614af36f59 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Updated VIF entry in instance network info cache for port c616f895-4bba-477a-b7d6-06c84e91fe79. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG nova.network.neutron [req-fb30d5f2-a023-44e0-8502-c659de8f4a65 req-99fba27c-ebe7-424b-9f09-fe614af36f59 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Updating instance_info_cache with network_info: [{"id": "c616f895-4bba-477a-b7d6-06c84e91fe79", "address": "fa:16:3e:b5:a1:81", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc616f895-4b", "ovs_interfaceid": "c616f895-4bba-477a-b7d6-06c84e91fe79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:38:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-fb30d5f2-a023-44e0-8502-c659de8f4a65 req-99fba27c-ebe7-424b-9f09-fe614af36f59 service nova] Releasing lock "refresh_cache-68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:38:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:46 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-0c7a48bc-8526-4f38-be5d-ac7964478e4e req-47903c2a-bc53-444d-9448-a3640d38b9d4 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Received event network-vif-plugged-c616f895-4bba-477a-b7d6-06c84e91fe79 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:38:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0c7a48bc-8526-4f38-be5d-ac7964478e4e req-47903c2a-bc53-444d-9448-a3640d38b9d4 service nova] Acquiring lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:38:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0c7a48bc-8526-4f38-be5d-ac7964478e4e req-47903c2a-bc53-444d-9448-a3640d38b9d4 service nova] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:38:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-0c7a48bc-8526-4f38-be5d-ac7964478e4e req-47903c2a-bc53-444d-9448-a3640d38b9d4 service nova] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:38:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-0c7a48bc-8526-4f38-be5d-ac7964478e4e req-47903c2a-bc53-444d-9448-a3640d38b9d4 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] No waiting events found dispatching network-vif-plugged-c616f895-4bba-477a-b7d6-06c84e91fe79 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:38:46 user nova-compute[75246]: WARNING nova.compute.manager [req-0c7a48bc-8526-4f38-be5d-ac7964478e4e req-47903c2a-bc53-444d-9448-a3640d38b9d4 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Received unexpected event network-vif-plugged-c616f895-4bba-477a-b7d6-06c84e91fe79 for instance with vm_state building and task_state spawning.
Nov 28 17:38:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:48 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Instance event wait completed in 0 seconds for  {{(pid=75246) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 17:38:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Guest created on hypervisor {{(pid=75246) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 17:38:48 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Instance spawned successfully.
Nov 28 17:38:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 17:38:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Found default for hw_cdrom_bus of ide {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:38:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Found default for hw_disk_bus of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:38:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Found default for hw_input_bus of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:38:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Found default for hw_pointer_model of None {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:38:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Found default for hw_video_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:38:48 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Found default for hw_vif_model of virtio {{(pid=75246) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 17:38:48 user nova-compute[75246]: INFO nova.compute.manager [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 28 17:38:48 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Checking state {{(pid=75246) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 17:38:48 user nova-compute[75246]: INFO nova.compute.manager [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Took 5.90 seconds to build instance.
Nov 28 17:38:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3ed7aaf7-b5b0-466a-9069-1d6376e72aaf tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.996s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:38:48 user nova-compute[75246]: DEBUG nova.compute.manager [req-d0c3ac78-a480-4e7f-870a-6efc847ba8f0 req-4b4ebb5a-f16c-4a4d-815d-cd5f85ab21d4 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Received event network-vif-plugged-c616f895-4bba-477a-b7d6-06c84e91fe79 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:38:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d0c3ac78-a480-4e7f-870a-6efc847ba8f0 req-4b4ebb5a-f16c-4a4d-815d-cd5f85ab21d4 service nova] Acquiring lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:38:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d0c3ac78-a480-4e7f-870a-6efc847ba8f0 req-4b4ebb5a-f16c-4a4d-815d-cd5f85ab21d4 service nova] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:38:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-d0c3ac78-a480-4e7f-870a-6efc847ba8f0 req-4b4ebb5a-f16c-4a4d-815d-cd5f85ab21d4 service nova] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:38:48 user nova-compute[75246]: DEBUG nova.compute.manager [req-d0c3ac78-a480-4e7f-870a-6efc847ba8f0 req-4b4ebb5a-f16c-4a4d-815d-cd5f85ab21d4 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] No waiting events found dispatching network-vif-plugged-c616f895-4bba-477a-b7d6-06c84e91fe79 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:38:48 user nova-compute[75246]: WARNING nova.compute.manager [req-d0c3ac78-a480-4e7f-870a-6efc847ba8f0 req-4b4ebb5a-f16c-4a4d-815d-cd5f85ab21d4 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Received unexpected event network-vif-plugged-c616f895-4bba-477a-b7d6-06c84e91fe79 for instance with vm_state active and task_state None.
Nov 28 17:38:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:51 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:38:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:38:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:38:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:38:52 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:38:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:38:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:38:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:38:52 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:38:52 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:38:52 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:38:52 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9044MB free_disk=25.199188232421875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:38:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:38:52 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:38:52 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:38:52 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:38:52 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:38:52 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:38:52 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:38:53 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:38:53 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:38:55 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:38:55 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:38:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:38:55 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:38:55 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:38:56 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:38:56 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:39:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:39:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:39:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:39:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:39:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:39:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:39:00 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:39:00 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:39:04 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:39:04 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:39:04 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:39:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:39:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:39:05 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:39:05 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lazy-loading 'info_cache' on Instance uuid 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:39:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:39:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:39:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:39:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:39:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:39:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:39:05 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Updating instance_info_cache with network_info: [{"id": "c616f895-4bba-477a-b7d6-06c84e91fe79", "address": "fa:16:3e:b5:a1:81", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc616f895-4b", "ovs_interfaceid": "c616f895-4bba-477a-b7d6-06c84e91fe79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:39:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:39:05 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:39:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:39:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:39:12 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:39:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:39:17 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:39:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:39:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:39:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:39:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:39:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:39:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:39:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:39:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:39:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:39:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:39:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:39:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:39:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:39:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:39:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:39:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:39:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:39:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:39:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:39:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:39:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:39:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:39:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:39:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:39:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:39:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:39:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:39:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:39:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:39:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:39:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:39:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:39:53 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:39:53 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:39:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:39:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:39:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:39:54 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:39:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:39:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:39:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:39:54 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:39:54 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:39:54 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:39:54 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8967MB free_disk=25.170787811279297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:39:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:39:54 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:39:54 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:39:54 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:39:54 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:39:55 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:39:55 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:39:55 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:39:55 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:39:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:39:56 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:39:56 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:39:57 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:39:57 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:39:58 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:40:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:40:00 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:40:00 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:40:03 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:40:04 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:40:04 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:40:04 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:40:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:40:05 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:40:05 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:40:05 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lazy-loading 'info_cache' on Instance uuid 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:40:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:40:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:40:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:40:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:40:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:40:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:40:06 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Updating instance_info_cache with network_info: [{"id": "c616f895-4bba-477a-b7d6-06c84e91fe79", "address": "fa:16:3e:b5:a1:81", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc616f895-4b", "ovs_interfaceid": "c616f895-4bba-477a-b7d6-06c84e91fe79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:40:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:40:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:40:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:40:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:40:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:40:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:40:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:40:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:40:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:40:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:40:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:40:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:40:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:40:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:40:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:40:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:40:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:40:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:40:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:40:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:40:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:40:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:40:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:40:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:40:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:40:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:40:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:40:33 user nova-compute[75246]: DEBUG nova.compute.manager [req-1dcc0a79-d364-4e1b-8381-17d7145e8bfb req-f729948b-2f09-4fdb-ae80-b2b56047e9f7 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Received event network-changed-c616f895-4bba-477a-b7d6-06c84e91fe79 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:40:33 user nova-compute[75246]: DEBUG nova.compute.manager [req-1dcc0a79-d364-4e1b-8381-17d7145e8bfb req-f729948b-2f09-4fdb-ae80-b2b56047e9f7 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Refreshing instance network info cache due to event network-changed-c616f895-4bba-477a-b7d6-06c84e91fe79. {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 17:40:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1dcc0a79-d364-4e1b-8381-17d7145e8bfb req-f729948b-2f09-4fdb-ae80-b2b56047e9f7 service nova] Acquiring lock "refresh_cache-68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:40:33 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1dcc0a79-d364-4e1b-8381-17d7145e8bfb req-f729948b-2f09-4fdb-ae80-b2b56047e9f7 service nova] Acquired lock "refresh_cache-68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:40:33 user nova-compute[75246]: DEBUG nova.network.neutron [req-1dcc0a79-d364-4e1b-8381-17d7145e8bfb req-f729948b-2f09-4fdb-ae80-b2b56047e9f7 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Refreshing network info cache for port c616f895-4bba-477a-b7d6-06c84e91fe79 {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 17:40:34 user nova-compute[75246]: DEBUG nova.network.neutron [req-1dcc0a79-d364-4e1b-8381-17d7145e8bfb req-f729948b-2f09-4fdb-ae80-b2b56047e9f7 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Updated VIF entry in instance network info cache for port c616f895-4bba-477a-b7d6-06c84e91fe79. {{(pid=75246) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 17:40:34 user nova-compute[75246]: DEBUG nova.network.neutron [req-1dcc0a79-d364-4e1b-8381-17d7145e8bfb req-f729948b-2f09-4fdb-ae80-b2b56047e9f7 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Updating instance_info_cache with network_info: [{"id": "c616f895-4bba-477a-b7d6-06c84e91fe79", "address": "fa:16:3e:b5:a1:81", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc616f895-4b", "ovs_interfaceid": "c616f895-4bba-477a-b7d6-06c84e91fe79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:40:34 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-1dcc0a79-d364-4e1b-8381-17d7145e8bfb req-f729948b-2f09-4fdb-ae80-b2b56047e9f7 service nova] Releasing lock "refresh_cache-68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:40:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:40:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:40:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:40:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:40:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:40:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG nova.objects.instance [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'flavor' on Instance uuid 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:40:36 user nova-compute[75246]: INFO nova.compute.manager [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Attaching volume 1ff2d33f-6f28-4549-ba15-7b3bf679a605 to /dev/vdb
Nov 28 17:40:36 user nova-compute[75246]: DEBUG os_brick.utils [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59f9c92-b1f9-4dd4-8c80-ce13bf847acf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[94793e3d-af15-44e6-be72-68ae8f4a6776]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[75696911-0ca4-4a57-b0e8-14474f243fbe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81e0cca-cad0-483e-bc94-e2798a8dfd0c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:40:36 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:40:36 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c7b024-3ea5-4dcf-a593-7fda2a5d309e]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG os_brick.utils [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:40:36 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Updating existing volume attachment record: b8da3a71-2f8b-4870-9c19-4caef4a8155f {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:40:37 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:40:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:40:42 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtENvRmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:40:43 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:40:43 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:40:43 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9d8b08-b6b1-4063-bccb-ed74c2705fa9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:40:43 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3741e105-fc05-4441-9fa2-f90c4c36cb53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605] added
Nov 28 17:40:43 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[35da9790-aac9-4ab0-bb0d-861942235b82]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d130035f-2feb-4722-81ac-e34b2d317bf8]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rtENvRmA {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rtENvRmA" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2608cf-a661-4896-9715-495eb7f3d882]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rtENvRmA'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7560e64-8110-4c0e-8e85-1aa815771848]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bd9bac-36c3-4a47-87e7-5ebfc1847639]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 17:40:43 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 17:40:43 user nova-compute[75246]:  {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:40:43 user nova-compute[75246]: WARNING os_brick.initiator.connectors.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 17:40:43 user nova-compute[75246]: 
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[626d5434-0a0d-4c67-ac93-ea65ac8f28ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605, portal: 172.16.0.220,3260]
Nov 28 17:40:43 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605, portal: 172.16.0.220,3260] successful.
Nov 28 17:40:43 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d69642-7d8a-49a8-b545-6cf6c6366eb2]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be8ef63-bba2-4632-9c1a-f9b50e572dd1]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 (non-flash)
Nov 28 17:40:43 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 (non-flash)
Nov 28 17:40:43 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea516cff-1037-46b7-baac-76e46234e33a]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:40:43 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtENvRmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:40:44 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:40:44 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23936383437373161', 'path': '/dev/sdb'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:40:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936383437373161', 'path': '/dev/sdb'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:40:44 user nova-compute[75246]: DEBUG nova.objects.instance [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'flavor' on Instance uuid 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:40:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:40:44 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:40:44 user nova-compute[75246]:   <source dev="/dev/sdb"/>
Nov 28 17:40:44 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:40:44 user nova-compute[75246]:   <serial>1ff2d33f-6f28-4549-ba15-7b3bf679a605</serial>
Nov 28 17:40:44 user nova-compute[75246]: </disk>
Nov 28 17:40:44 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:40:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:40:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:40:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] No VIF found with MAC fa:16:3e:b5:a1:81, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:40:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a3414957-490b-485c-84be-eefdca7db348 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.529s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:40:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG nova.objects.instance [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'flavor' on Instance uuid 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:40:48 user nova-compute[75246]: INFO nova.compute.manager [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Attaching volume 05346cf5-dafe-4144-99d6-bb1b4d0fed03 to /dev/vdc
Nov 28 17:40:48 user nova-compute[75246]: DEBUG os_brick.utils [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ad47f0-b20f-458f-b190-242ef3c1a58e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b2cf03b2297\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6668ecf9-e2fc-4606-85be-5c2bec1a34b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3e0908-15a6-451f-9c9b-b788ebd130be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7ebf72-e873-4cce-8b98-8d4593f8f9a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Running cmd (subprocess): nvme version {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] 'nvme version' failed. Not Retrying. {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] nvme not present on system {{(pid=75246) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 17:40:48 user nova-compute[75246]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 17:40:48 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4bda98-c7fd-4fb9-acd3-2acd3829998b]: (4, '') {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75246) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.lightos [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] LIGHTOS: no hostnqn found. {{(pid=75246) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG os_brick.utils [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b2cf03b2297', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:40:48 user nova-compute[75246]: DEBUG nova.virt.block_device [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Updating existing volume attachment record: de2853d5-32b7-4b9d-95b6-6da8c72e91e3 {{(pid=75246) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 17:40:49 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:40:49 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 17:40:50 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] There are 0 instances to clean {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 17:40:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:40:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:40:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:40:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:40:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:40:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:40:52 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Calling os-brick to attach iSCSI Volume {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycwjrMeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:40:55 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:40:55 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:40:55 user nova-compute[75246]: INFO os_brick.initiator.connectors.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[105e546b-d62a-4e4d-8cf2-7522e1d296d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 17:40:55 user nova-compute[75246]:  {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --interface default --op new {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be5900c-1687-48e8-9790-2e7a0c788c15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03] added\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03] added
Nov 28 17:40:55 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3da9571-ad9a-4bac-bf87-2bc2df47018c]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[23336cd9-67b8-423b-867c-009e45b2c520]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycwjrMeI {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycwjrMeI" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d26e24-d80a-4c50-8651-e397d854c0cc]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ycwjrMeI'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a90172-70b5-4b9a-9767-6397e0607e40]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d3dbec-327c-4c99-a2ce-773c5a05fdbf]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 (non-flash)
Nov 28 17:40:55 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 (non-flash)
Nov 28 17:40:55 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --login {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6267759-dc51-46f2-8a96-3dda300512d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03, portal: 172.16.0.220,3260]
Nov 28 17:40:55 user nova-compute[75246]: Login to [iface: default, target: iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03, portal: 172.16.0.220,3260] successful.
Nov 28 17:40:55 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fccb11c-9b81-4d10-b335-2e1aa14b245e]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b399e4a-b8d0-47b0-8b5d-cfb34f0b986f]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 (non-flash)
Nov 28 17:40:55 user nova-compute[75246]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 (non-flash)
Nov 28 17:40:55 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 (non-flash)
Nov 28 17:40:55 user nova-compute[75246]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 (non-flash)
Nov 28 17:40:55 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Connected to 172.16.0.220:3260 {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=75246) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75246) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[653aa4cc-63a2-47af-b717-1843623a9f63]: (4, ('- - 0', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: None {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:40:55 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:40:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:40:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:40:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:40:56 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:40:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk --force-share --output=json {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:40:56 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75246) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 17:40:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycwjrMeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75246) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 17:40:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:40:56 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23535386130393661', 'path': '/dev/sdc'} {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:40:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535386130393661', 'path': '/dev/sdc'} {{(pid=75246) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 17:40:56 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75246) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:40:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75246) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 17:40:56 user nova-compute[75246]: DEBUG nova.objects.instance [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'flavor' on Instance uuid 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:40:56 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 17:40:56 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:40:56 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:40:56 user nova-compute[75246]:   <target dev="vdc" bus="virtio"/>
Nov 28 17:40:56 user nova-compute[75246]:   <serial>05346cf5-dafe-4144-99d6-bb1b4d0fed03</serial>
Nov 28 17:40:56 user nova-compute[75246]: </disk>
Nov 28 17:40:56 user nova-compute[75246]:  {{(pid=75246) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 17:40:56 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:40:56 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:40:56 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=8970MB free_disk=25.169620513916016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:40:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:40:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:40:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Instance 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75246) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 17:40:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:40:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:40:57 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing inventories for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 17:40:57 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating ProviderTree inventory for provider 241ad926-9deb-44ba-a618-a49e4ac21089 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 17:40:57 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating inventory in ProviderTree for provider 241ad926-9deb-44ba-a618-a49e4ac21089 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 17:40:57 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing aggregate associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, aggregates: None {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 17:40:57 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing trait associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 17:40:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:40:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:40:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75246) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 17:40:57 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] No VIF found with MAC fa:16:3e:b5:a1:81, not building metadata {{(pid=75246) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 17:40:57 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:40:57 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:40:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:40:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:40:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a2a94a0d-0116-49e1-a8f7-99079e8f81f2 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.991s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:40:58 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:40:58 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:40:58 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:40:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:40:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:40:58 user nova-compute[75246]: INFO nova.compute.manager [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Detaching volume 1ff2d33f-6f28-4549-ba15-7b3bf679a605
Nov 28 17:40:58 user nova-compute[75246]: INFO nova.virt.block_device [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Attempting to driver detach volume 1ff2d33f-6f28-4549-ba15-7b3bf679a605 from mountpoint /dev/vdb
Nov 28 17:40:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Attempting to detach device vdb from instance 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:40:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:40:58 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:40:58 user nova-compute[75246]:   <source dev="/dev/sdb"/>
Nov 28 17:40:58 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:40:58 user nova-compute[75246]:   <serial>1ff2d33f-6f28-4549-ba15-7b3bf679a605</serial>
Nov 28 17:40:58 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:40:58 user nova-compute[75246]: </disk>
Nov 28 17:40:58 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:40:58 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Successfully detached device vdb from instance 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 from the persistent domain config.
Nov 28 17:40:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:40:58 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:40:58 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:40:58 user nova-compute[75246]:   <source dev="/dev/sdb"/>
Nov 28 17:40:58 user nova-compute[75246]:   <target dev="vdb" bus="virtio"/>
Nov 28 17:40:58 user nova-compute[75246]:   <serial>1ff2d33f-6f28-4549-ba15-7b3bf679a605</serial>
Nov 28 17:40:58 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 17:40:58 user nova-compute[75246]: </disk>
Nov 28 17:40:58 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:40:59 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:40:59 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:41:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:41:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:41:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:41:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:41:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:00 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:41:00 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:41:02 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:06 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:41:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:41:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:41:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "refresh_cache-68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 17:41:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquired lock "refresh_cache-68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 17:41:07 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Forcefully refreshing network info cache for instance {{(pid=75246) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 17:41:07 user nova-compute[75246]: DEBUG nova.objects.instance [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lazy-loading 'info_cache' on Instance uuid 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:41:07 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:07 user nova-compute[75246]: DEBUG nova.network.neutron [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Updating instance_info_cache with network_info: [{"id": "c616f895-4bba-477a-b7d6-06c84e91fe79", "address": "fa:16:3e:b5:a1:81", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc616f895-4b", "ovs_interfaceid": "c616f895-4bba-477a-b7d6-06c84e91fe79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:41:07 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Releasing lock "refresh_cache-68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" {{(pid=75246) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 17:41:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Updated the network info_cache for instance {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 17:41:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:19 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 is timed out.
Nov 28 17:41:19 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Successfully detached device vdb from instance 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 from the live domain config.
Nov 28 17:41:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtENvRmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:41:19 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b407f0cb-2707-4908-b24f-a37402aca692]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:41:19 user nova-compute[75246]: No targets found.
Nov 28 17:41:19 user nova-compute[75246]: iSNS:
Nov 28 17:41:19 user nova-compute[75246]: No targets found.
Nov 28 17:41:19 user nova-compute[75246]: STATIC:
Nov 28 17:41:19 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605
Nov 28 17:41:19 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:41:19 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:41:19 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03
Nov 28 17:41:19 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:41:19 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:41:19 user nova-compute[75246]: FIRMWARE:
Nov 28 17:41:19 user nova-compute[75246]: No targets found.
Nov 28 17:41:19 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:41:19 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:41:19 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[43915118-4e53-4292-92ba-2ee10c9597c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25c0864-e8db-473b-9b8d-943a8b121fb9]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 (non-flash)
Nov 28 17:41:19 user nova-compute[75246]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 (non-flash)
Nov 28 17:41:19 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 (non-flash)
Nov 28 17:41:19 user nova-compute[75246]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 (non-flash)
Nov 28 17:41:19 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d85a0310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605'): ({'sdb'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Removing single pathed devices sdb {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bbff06-1068-4037-bdf7-f343a380684a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeba75c8-daa3-402a-bcb6-a6cc76c393c9]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Flushing IO for device /dev/sdb {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb050d23-148a-4b6b-a4f0-a6c5c9240bfe]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9ff210-8d92-47f1-b936-024d8b0571c0]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] SCSI volumes sdb have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc8a29d-3728-4f3f-820e-38e262c0337a]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[da18e691-76ee-44a6-8712-aa09b8bb4cd8]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605, portal: 172.16.0.220,3260]
Nov 28 17:41:19 user nova-compute[75246]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605, portal: 172.16.0.220,3260] successful.
Nov 28 17:41:19 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff2d33f-6f28-4549-ba15-7b3bf679a605 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e0de00-d768-4e9b-a265-b6bfa103c9c6]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] <== disconnect_volume: return (291ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:41:19 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:41:20 user nova-compute[75246]: DEBUG nova.objects.instance [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'flavor' on Instance uuid 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:41:20 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-a1e94b4c-0f76-4b90-b263-fd4fb8898e08 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.766s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:41:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:20 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:41:20 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75246) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 17:41:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:41:21 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:41:21 user nova-compute[75246]: INFO nova.compute.manager [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Detaching volume 05346cf5-dafe-4144-99d6-bb1b4d0fed03
Nov 28 17:41:21 user nova-compute[75246]: INFO nova.virt.block_device [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Attempting to driver detach volume 05346cf5-dafe-4144-99d6-bb1b4d0fed03 from mountpoint /dev/vdc
Nov 28 17:41:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Attempting to detach device vdc from instance 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 from the persistent domain config. {{(pid=75246) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 17:41:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:41:21 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:41:21 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:41:21 user nova-compute[75246]:   <target dev="vdc" bus="virtio"/>
Nov 28 17:41:21 user nova-compute[75246]:   <serial>05346cf5-dafe-4144-99d6-bb1b4d0fed03</serial>
Nov 28 17:41:21 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 17:41:21 user nova-compute[75246]: </disk>
Nov 28 17:41:21 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:41:21 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Successfully detached device vdc from instance 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 from the persistent domain config.
Nov 28 17:41:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 from the live domain config. {{(pid=75246) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 17:41:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.guest [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 17:41:21 user nova-compute[75246]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 17:41:21 user nova-compute[75246]:   <source dev="/dev/sdc"/>
Nov 28 17:41:21 user nova-compute[75246]:   <target dev="vdc" bus="virtio"/>
Nov 28 17:41:21 user nova-compute[75246]:   <serial>05346cf5-dafe-4144-99d6-bb1b4d0fed03</serial>
Nov 28 17:41:21 user nova-compute[75246]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 17:41:21 user nova-compute[75246]: </disk>
Nov 28 17:41:21 user nova-compute[75246]:  {{(pid=75246) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 17:41:21 user nova-compute[75246]: DEBUG nova.virt.libvirt.driver [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 {{(pid=75246) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 17:41:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:41:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:41:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:41:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:41:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:41:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:31 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:41:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:41:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:41:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:41:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:41:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:41 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 is timed out.
Nov 28 17:41:41 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Successfully detached device vdc from instance 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 from the live domain config.
Nov 28 17:41:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] calling os-brick to detach iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f01be410>, {'target_iqn': 'iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycwjrMeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 17:41:41 user nova-compute[75246]: WARNING os_brick.initiator.connectors.base [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf69647-e5c1-4cef-83b4-d8caaabc422a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 17:41:41 user nova-compute[75246]: No targets found.
Nov 28 17:41:41 user nova-compute[75246]: iSNS:
Nov 28 17:41:41 user nova-compute[75246]: No targets found.
Nov 28 17:41:41 user nova-compute[75246]: STATIC:
Nov 28 17:41:41 user nova-compute[75246]: Target: iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03
Nov 28 17:41:41 user nova-compute[75246]:         Portal: 172.16.0.220:3260,-1
Nov 28 17:41:41 user nova-compute[75246]:                 Iface Name: default
Nov 28 17:41:41 user nova-compute[75246]: FIRMWARE:
Nov 28 17:41:41 user nova-compute[75246]: No targets found.
Nov 28 17:41:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 17:41:41 user nova-compute[75246]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 17:41:41 user nova-compute[75246]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75246) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03', 0)] {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f468377-dd74-4ba1-99b0-c29da69aca9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f41e07-2860-4c60-b4d5-211c9e49b69c]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 (non-flash)\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 (non-flash)
Nov 28 17:41:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 (non-flash)
Nov 28 17:41:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d8159900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03'): ({'sdc'}, set())}) {{(pid=75246) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Removing single pathed devices sdc {{(pid=75246) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[968c177f-ef66-4ca5-a715-c65850704690]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc3eaec-33b6-4c98-a662-5f7a41e11c68]: (4, ('ok\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Flushing IO for device /dev/sdc {{(pid=75246) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[e120b350-1007-4b5e-80a5-f82830ad0c81]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75246) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[19486bf3-5f06-4d04-b7aa-c1a6b0fc1887]: (4, ('1', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.linuxscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] SCSI volumes sdc have been removed. {{(pid=75246) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03')] {{(pid=75246) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ff5aec-bcb9-47e3-b268-471b3ffd9186]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --logout {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0405945-7518-4ebd-a32b-c8559b1b3c37]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03, portal: 172.16.0.220,3260]
Nov 28 17:41:41 user nova-compute[75246]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03, portal: 172.16.0.220,3260] successful.
Nov 28 17:41:41 user nova-compute[75246]:  stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --op delete {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05346cf5-dafe-4144-99d6-bb1b4d0fed03 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da5b159-5047-4700-8a8f-d004c6f15db2]: (4, ('', '')) {{(pid=85745) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75246) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.base [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG os_brick.initiator.connectors.iscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] <== disconnect_volume: return (295ms) None {{(pid=75246) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 17:41:41 user nova-compute[75246]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Disconnected iSCSI Volume {{(pid=75246) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 17:41:42 user nova-compute[75246]: DEBUG nova.objects.instance [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'flavor' on Instance uuid 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:41:42 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-48768a85-29b9-4fb3-81e7-ef77c047b204 tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.597s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:41:44 user nova-compute[75246]: INFO nova.compute.manager [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Terminating instance
Nov 28 17:41:44 user nova-compute[75246]: DEBUG nova.compute.manager [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Start destroying the instance on the hypervisor. {{(pid=75246) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-dbdcffc1-1939-4113-b6be-44670f8d0f93 req-4f2d8bec-494d-4432-9962-4d2ba904b3f0 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Received event network-vif-unplugged-c616f895-4bba-477a-b7d6-06c84e91fe79 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-dbdcffc1-1939-4113-b6be-44670f8d0f93 req-4f2d8bec-494d-4432-9962-4d2ba904b3f0 service nova] Acquiring lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-dbdcffc1-1939-4113-b6be-44670f8d0f93 req-4f2d8bec-494d-4432-9962-4d2ba904b3f0 service nova] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-dbdcffc1-1939-4113-b6be-44670f8d0f93 req-4f2d8bec-494d-4432-9962-4d2ba904b3f0 service nova] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-dbdcffc1-1939-4113-b6be-44670f8d0f93 req-4f2d8bec-494d-4432-9962-4d2ba904b3f0 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] No waiting events found dispatching network-vif-unplugged-c616f895-4bba-477a-b7d6-06c84e91fe79 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG nova.compute.manager [req-dbdcffc1-1939-4113-b6be-44670f8d0f93 req-4f2d8bec-494d-4432-9962-4d2ba904b3f0 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Received event network-vif-unplugged-c616f895-4bba-477a-b7d6-06c84e91fe79 for instance with task_state deleting. {{(pid=75246) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 17:41:44 user nova-compute[75246]: INFO nova.virt.libvirt.driver [-] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Instance destroyed successfully.
Nov 28 17:41:44 user nova-compute[75246]: DEBUG nova.objects.instance [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lazy-loading 'resources' on Instance uuid 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2 {{(pid=75246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG nova.virt.libvirt.vif [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T17:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-482843426',display_name='tempest-AttachVolumeTestJSON-server-482843426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-482843426',id=52,image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+LVd+mi2B6E+xx2BnRVOsbGwQ5ZulyhmhHOmo3VfFrJuv7pvSrOdgRK5j0fUMCZyLwrYb4NVCEiRFdHscF3FqHvt+4ZK5u3rJnCja7k9+D7RIGKKxtHqgxZOOfgJXYWQ==',key_name='tempest-keypair-1037248659',keypairs=<?>,launch_index=0,launched_at=2023-11-28T17:38:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce5e8b8b1dc2469bb172fdc843b8f39c',ramdisk_id='',reservation_id='r-je62onpp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1ef2d77e-6c24-4e9a-ba2a-b6759061c14d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-32273339',owner_user_name='tempest-AttachVolumeTestJSON-32273339-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T17:38:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0c78d20df77421389d4fb0c5a6d2add',uuid=68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c616f895-4bba-477a-b7d6-06c84e91fe79", "address": "fa:16:3e:b5:a1:81", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc616f895-4b", "ovs_interfaceid": "c616f895-4bba-477a-b7d6-06c84e91fe79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converting VIF {"id": "c616f895-4bba-477a-b7d6-06c84e91fe79", "address": "fa:16:3e:b5:a1:81", "network": {"id": "405e5c79-94c4-44dc-bc25-e8905312fd23", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-875500609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce5e8b8b1dc2469bb172fdc843b8f39c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc616f895-4b", "ovs_interfaceid": "c616f895-4bba-477a-b7d6-06c84e91fe79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG nova.network.os_vif_util [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:a1:81,bridge_name='br-int',has_traffic_filtering=True,id=c616f895-4bba-477a-b7d6-06c84e91fe79,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc616f895-4b') {{(pid=75246) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG os_vif [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:a1:81,bridge_name='br-int',has_traffic_filtering=True,id=c616f895-4bba-477a-b7d6-06c84e91fe79,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc616f895-4b') {{(pid=75246) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc616f895-4b, bridge=br-int, if_exists=True) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de877dc3-b4ef-4e0a-b798-830411bbbfa2) {{(pid=75246) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:44 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:41:44 user nova-compute[75246]: INFO os_vif [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:a1:81,bridge_name='br-int',has_traffic_filtering=True,id=c616f895-4bba-477a-b7d6-06c84e91fe79,network=Network(405e5c79-94c4-44dc-bc25-e8905312fd23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc616f895-4b')
Nov 28 17:41:44 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Deleting instance files /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2_del
Nov 28 17:41:44 user nova-compute[75246]: INFO nova.virt.libvirt.driver [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Deletion of /opt/stack/data/nova/instances/68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2_del complete
Nov 28 17:41:45 user nova-compute[75246]: INFO nova.compute.manager [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 17:41:45 user nova-compute[75246]: DEBUG oslo.service.loopingcall [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75246) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 17:41:45 user nova-compute[75246]: DEBUG nova.compute.manager [-] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Deallocating network for instance {{(pid=75246) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 17:41:45 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] deallocate_for_instance() {{(pid=75246) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 17:41:45 user nova-compute[75246]: DEBUG nova.network.neutron [-] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Updating instance_info_cache with network_info: [] {{(pid=75246) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 17:41:45 user nova-compute[75246]: INFO nova.compute.manager [-] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Took 0.81 seconds to deallocate network for instance.
Nov 28 17:41:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:41:45 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:41:45 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:41:45 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:41:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:41:46 user nova-compute[75246]: INFO nova.scheduler.client.report [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Deleted allocations for instance 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2
Nov 28 17:41:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-c541a002-a295-4af6-8946-4c8631c754ac tempest-AttachVolumeTestJSON-32273339 tempest-AttachVolumeTestJSON-32273339-project-member] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.943s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:41:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-c7614649-a577-4e1e-b8f6-e2213cecaf3f req-575084ae-421a-459b-934f-e60ab4db04f4 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Received event network-vif-plugged-c616f895-4bba-477a-b7d6-06c84e91fe79 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:41:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c7614649-a577-4e1e-b8f6-e2213cecaf3f req-575084ae-421a-459b-934f-e60ab4db04f4 service nova] Acquiring lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:41:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c7614649-a577-4e1e-b8f6-e2213cecaf3f req-575084ae-421a-459b-934f-e60ab4db04f4 service nova] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:41:46 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [req-c7614649-a577-4e1e-b8f6-e2213cecaf3f req-575084ae-421a-459b-934f-e60ab4db04f4 service nova] Lock "68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:41:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-c7614649-a577-4e1e-b8f6-e2213cecaf3f req-575084ae-421a-459b-934f-e60ab4db04f4 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] No waiting events found dispatching network-vif-plugged-c616f895-4bba-477a-b7d6-06c84e91fe79 {{(pid=75246) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 17:41:46 user nova-compute[75246]: WARNING nova.compute.manager [req-c7614649-a577-4e1e-b8f6-e2213cecaf3f req-575084ae-421a-459b-934f-e60ab4db04f4 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Received unexpected event network-vif-plugged-c616f895-4bba-477a-b7d6-06c84e91fe79 for instance with vm_state deleted and task_state None.
Nov 28 17:41:46 user nova-compute[75246]: DEBUG nova.compute.manager [req-c7614649-a577-4e1e-b8f6-e2213cecaf3f req-575084ae-421a-459b-934f-e60ab4db04f4 service nova] [instance: 68a08ece-8840-40f3-8fdc-7e6ebfd2f5b2] Received event network-vif-deleted-c616f895-4bba-477a-b7d6-06c84e91fe79 {{(pid=75246) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 17:41:49 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:41:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:41:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:41:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:41:54 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:41:55 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:41:55 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:41:55 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:41:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:41:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:41:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:41:56 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:41:56 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:41:56 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:41:56 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9095MB free_disk=25.188522338867188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:41:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:41:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:41:56 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:41:56 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:41:56 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:41:56 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:41:56 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:41:56 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:41:59 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:41:59 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:41:59 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:41:59 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:41:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:41:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:41:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:41:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:41:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:41:59 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:42:02 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:42:02 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:42:04 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:42:04 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:42:06 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:42:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:42:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:42:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:42:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:42:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:42:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:42:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:42:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:42:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:42:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:42:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:42:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:42:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:42:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:42:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:42:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:42:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:42:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:42:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:42:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:42:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:42:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:42:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:42:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:42:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:42:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:42:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:42:47 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:42:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:42:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:42:56 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:42:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:42:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:42:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:42:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:42:57 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:42:57 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:42:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9114MB free_disk=25.186874389648438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:42:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:42:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:42:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:42:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:42:57 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:42:57 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:42:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:42:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:42:58 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:42:58 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:42:59 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:42:59 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:43:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:43:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:43:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:43:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:43:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:43:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:43:00 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:43:01 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:43:04 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:43:04 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:43:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:43:08 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:43:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:43:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:43:09 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:43:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:43:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:43:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:43:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:43:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:43:34 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:43:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:43:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:43:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:43:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:43:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:43:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:43:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:43:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:43:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:43:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:43:56 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:43:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:43:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:43:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:43:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:43:57 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:43:57 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:43:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9250MB free_disk=25.154682159423828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:43:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:43:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:43:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:43:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:43:57 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:43:57 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:43:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:43:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:43:59 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:43:59 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:43:59 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:44:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:44:01 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:44:01 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:44:02 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:44:04 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:44:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:44:05 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:44:05 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:44:08 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:44:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:44:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:44:09 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:44:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:44:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:44:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:44:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:44:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:44:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:44:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:44:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:44:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:44:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:44:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:44:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:44:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:44:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:44:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:44:56 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:44:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:44:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:44:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:44:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:44:57 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:44:57 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:44:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9259MB free_disk=25.177146911621094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:44:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:44:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:44:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:44:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:44:57 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:44:57 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:44:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:44:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:44:59 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:44:59 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:44:59 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:45:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:45:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:45:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:45:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:45:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:45:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:45:01 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:45:01 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:45:03 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:45:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:45:05 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:45:05 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:45:08 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:45:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:45:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:45:09 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:45:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:45:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:45:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:45:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:45:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:45:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:45:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:45:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:45:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:45:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:45:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:45:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:45:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:45:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:45:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:45:55 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:45:55 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 17:45:56 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] There are 0 instances to clean {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 17:45:57 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:45:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:45:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:45:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:45:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:45:57 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:45:57 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:45:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9255MB free_disk=25.079444885253906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:45:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:45:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:45:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:45:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:45:57 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing inventories for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 17:45:57 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating ProviderTree inventory for provider 241ad926-9deb-44ba-a618-a49e4ac21089 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 17:45:57 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating inventory in ProviderTree for provider 241ad926-9deb-44ba-a618-a49e4ac21089 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 17:45:57 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing aggregate associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, aggregates: None {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 17:45:57 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing trait associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 17:45:57 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:45:57 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:45:57 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:45:57 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:45:59 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:45:59 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:46:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:46:00 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:46:01 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:46:03 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:46:03 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:46:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:46:06 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:46:06 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:46:09 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:46:09 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:46:09 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:46:09 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:46:10 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:46:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:46:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:46:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:46:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:46:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:46:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:46:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:46:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:46:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:46:29 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:46:29 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75246) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 17:46:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:46:34 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:46:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:46:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:46:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:46:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:46:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:46:57 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:46:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:46:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:46:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:46:58 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:46:58 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:46:58 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:46:58 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9267MB free_disk=25.079803466796875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:46:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:46:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:46:58 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:46:58 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:46:58 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:46:58 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:46:58 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:46:58 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:47:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:47:00 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:47:00 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:47:01 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:47:03 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:47:03 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:47:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:47:05 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:47:07 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:47:07 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:47:09 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:47:10 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:47:10 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:47:10 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:47:10 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:47:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:47:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:47:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:47:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:47:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:47:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:47:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:47:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:47:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:47:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:47:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:47:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:47:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:47:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:47:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:47:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:47:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:47:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:47:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:47:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:47:58 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:47:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:47:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:47:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:47:59 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:47:59 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:47:59 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:47:59 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9286MB free_disk=25.079307556152344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:47:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:47:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:47:59 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:47:59 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:47:59 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:47:59 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:47:59 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:47:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:48:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:48:02 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:48:02 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:48:02 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:48:04 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:48:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:48:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:48:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:48:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:48:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:48:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:48:05 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:48:05 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:48:09 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:48:09 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:48:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:48:10 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:48:11 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:48:11 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:48:11 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:48:12 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:48:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:48:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:48:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:48:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:48:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:48:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:48:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:48:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:48:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:48:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:48:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:48:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:48:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:48:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:48:58 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:48:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:48:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:48:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:48:59 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:48:59 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:48:59 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:48:59 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9286MB free_disk=25.078834533691406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:48:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:48:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:48:59 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:48:59 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:48:59 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:48:59 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:48:59 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:48:59 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:49:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:49:03 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:49:03 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:49:04 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:49:04 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:49:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:49:07 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:49:07 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:49:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:49:10 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:49:10 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:49:11 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:49:11 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:49:11 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:49:12 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:49:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:49:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:49:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:49:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:49:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:49:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:49:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:49:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:49:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:49:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:49:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:49:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:49:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:49:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:49:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:49:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:49:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:49:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:49:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:49:59 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:50:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:50:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:50:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:50:00 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:50:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:50:00 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:50:00 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:50:00 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9293MB free_disk=25.07831573486328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:50:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:50:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:50:00 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:50:00 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:50:00 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:50:00 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:50:00 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:50:00 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:50:03 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:50:03 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:50:04 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:50:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:50:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:50:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:50:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:50:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:50:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:50:05 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:50:07 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:50:08 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:50:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:50:10 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:50:10 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:50:11 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:50:12 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:50:12 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:50:12 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:50:13 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:50:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:50:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:50:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:50:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:50:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:50:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:50:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:50:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:50:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:50:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:50:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:50:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:50:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:50:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:51:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:51:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:51:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:51:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:51:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:51:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:51:01 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:51:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:51:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:51:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:51:02 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:51:02 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:51:02 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:51:02 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9290MB free_disk=25.07782745361328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:51:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:51:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:51:02 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:51:02 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:51:02 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing inventories for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 17:51:02 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating ProviderTree inventory for provider 241ad926-9deb-44ba-a618-a49e4ac21089 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 17:51:02 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating inventory in ProviderTree for provider 241ad926-9deb-44ba-a618-a49e4ac21089 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 17:51:02 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing aggregate associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, aggregates: None {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 17:51:02 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing trait associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 17:51:02 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:51:02 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:51:02 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:51:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:51:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:51:05 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:51:05 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:51:05 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:51:07 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:51:08 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:51:08 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:51:08 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 17:51:09 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] There are 0 instances to clean {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 17:51:10 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:51:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:51:11 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:51:11 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:51:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:51:14 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:51:14 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:51:15 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:51:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:51:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:51:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:51:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:51:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:51:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:51:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:51:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:51:29 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:51:29 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75246) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 17:51:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:51:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:51:36 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:51:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:51:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:51:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:51:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:51:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:51:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:51:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:51:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:51:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:52:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:52:01 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:52:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:52:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:52:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:52:02 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:52:02 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:52:02 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:52:02 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9286MB free_disk=25.077316284179688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:52:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:52:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:52:02 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:52:02 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:52:02 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:52:02 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:52:02 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:52:02 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.125s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:52:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:52:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:52:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:52:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:52:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:52:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:52:06 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:52:06 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:52:06 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:52:09 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:52:09 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:52:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:52:10 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:52:11 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:52:11 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:52:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:52:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:52:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:52:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:52:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:52:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:52:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:52:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:52:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:52:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:52:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:52:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:52:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:52:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:52:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:52:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:52:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:52:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:52:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:53:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:53:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:53:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:53:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:53:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:53:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:53:03 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:53:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:53:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:53:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:53:04 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:53:04 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:53:04 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:53:04 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9293MB free_disk=25.076831817626953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:53:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:53:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:53:04 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:53:04 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:53:04 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:53:04 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:53:04 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:53:04 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:53:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:53:08 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:53:08 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:53:08 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:53:09 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:53:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:53:10 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:53:12 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:53:12 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:53:12 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:53:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:53:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:53:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:53:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:53:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:53:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:53:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:53:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:53:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:53:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:53:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:53:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:53:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:53:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:53:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:53:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:53:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:53:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:54:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:54:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:54:05 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:54:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:54:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:54:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:54:06 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:54:06 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:54:06 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:54:06 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9288MB free_disk=25.076339721679688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:54:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:54:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:54:06 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:54:06 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:54:06 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:54:06 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:54:06 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:54:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.379s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:54:08 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:54:08 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:54:09 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:54:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:54:10 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:54:12 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:54:12 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:54:12 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:54:13 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:54:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:54:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:54:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:54:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:54:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:54:19 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:54:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:54:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:54:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:54:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:54:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:54:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:54:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:54:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:54:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:54:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:54:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:54:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:54:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:55:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:55:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:55:05 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:55:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:55:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:55:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:55:06 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:55:06 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:55:06 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:55:06 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9292MB free_disk=25.075820922851562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:55:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:55:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:55:06 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:55:06 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:55:06 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:55:06 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:55:06 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:55:06 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:55:08 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:55:09 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:55:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:55:10 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:55:12 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:55:13 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:55:13 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:55:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:55:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:55:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:55:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:55:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:55:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:55:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:55:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:55:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:55:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:55:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:55:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:55:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:55:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:55:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:55:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:56:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:56:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:56:07 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:56:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:56:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:56:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:56:08 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:56:08 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:56:08 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:56:08 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9291MB free_disk=25.07532501220703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:56:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:56:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:56:08 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:56:08 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:56:08 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing inventories for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 17:56:08 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating ProviderTree inventory for provider 241ad926-9deb-44ba-a618-a49e4ac21089 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 17:56:08 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Updating inventory in ProviderTree for provider 241ad926-9deb-44ba-a618-a49e4ac21089 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 17:56:08 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing aggregate associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, aggregates: None {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 17:56:08 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Refreshing trait associations for resource provider 241ad926-9deb-44ba-a618-a49e4ac21089, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE {{(pid=75246) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 17:56:08 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:56:08 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:56:08 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:56:08 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:56:09 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:56:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:56:10 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:56:12 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:56:13 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:56:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:56:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:56:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:56:14 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:56:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:56:14 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 17:56:15 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] There are 0 instances to clean {{(pid=75246) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 17:56:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:56:17 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:56:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:56:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:56:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:56:19 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:56:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:56:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:56:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:56:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:56:36 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:56:36 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75246) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 17:56:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:56:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:56:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:56:50 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:56:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:57:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:57:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:57:09 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:57:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:57:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:57:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:57:09 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:57:09 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:57:09 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:57:09 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9293MB free_disk=25.07483673095703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:57:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:57:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:57:09 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:57:09 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:57:09 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:57:09 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:57:09 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:57:09 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:57:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:57:11 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:57:12 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:57:13 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:57:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:57:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:57:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:57:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:57:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:57:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:57:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:57:16 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:57:17 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:57:17 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:57:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:57:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:57:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:57:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:57:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:57:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:57:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:57:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:57:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:57:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:57:39 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:57:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:57:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:57:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:57:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:58:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:58:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:58:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:58:10 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:58:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:58:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:58:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:58:11 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:58:11 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:58:11 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:58:11 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9294MB free_disk=25.0743408203125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:58:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:58:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:58:11 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:58:11 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:58:11 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:58:11 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:58:11 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:58:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:58:13 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:58:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:58:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:58:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:58:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:58:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:58:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:58:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:58:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:58:15 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:58:17 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:58:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:58:17 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:58:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:58:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:58:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:58:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:58:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:58:19 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:58:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:58:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:58:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:58:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:58:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:58:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:58:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:58:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:59:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:59:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:59:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:59:10 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:59:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:59:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:59:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:59:11 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 17:59:11 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:59:11 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 17:59:11 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9293MB free_disk=25.07386016845703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 17:59:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 17:59:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 17:59:11 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 17:59:11 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 17:59:11 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 17:59:11 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 17:59:11 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 17:59:11 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 17:59:13 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:59:14 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:59:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:59:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:59:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:59:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:59:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:59:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 17:59:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 17:59:18 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 17:59:19 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:59:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:59:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:59:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75246) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 17:59:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:59:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75246) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 17:59:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:59:20 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 17:59:20 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 17:59:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:59:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:59:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 17:59:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:59:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:59:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 17:59:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:00:00 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:00:05 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:00:10 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:00:12 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:00:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:00:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:00:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:00:13 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Auditing locally available compute resources for user (node: user) {{(pid=75246) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:00:13 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:00:13 user nova-compute[75246]: WARNING nova.virt.libvirt.driver [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:00:13 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Hypervisor/Node resource view: name=user free_ram=9267MB free_disk=25.07333755493164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75246) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:00:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:00:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:00:13 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:00:13 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75246) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:00:13 user nova-compute[75246]: DEBUG nova.compute.provider_tree [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed in ProviderTree for provider: 241ad926-9deb-44ba-a618-a49e4ac21089 {{(pid=75246) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:00:13 user nova-compute[75246]: DEBUG nova.scheduler.client.report [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Inventory has not changed for provider 241ad926-9deb-44ba-a618-a49e4ac21089 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75246) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:00:13 user nova-compute[75246]: DEBUG nova.compute.resource_tracker [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Compute_service record updated for user:user {{(pid=75246) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:00:13 user nova-compute[75246]: DEBUG oslo_concurrency.lockutils [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.120s {{(pid=75246) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:00:15 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:00:15 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:00:15 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:00:16 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:00:18 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:00:19 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:00:20 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:00:20 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:00:20 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Starting heal instance info cache {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:00:20 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Rebuilding the list of instances to heal {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 18:00:21 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Didn't find any instances for network info cache update. {{(pid=75246) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 18:00:21 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:00:21 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:00:21 user nova-compute[75246]: DEBUG nova.compute.manager [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75246) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:00:22 user nova-compute[75246]: DEBUG oslo_service.periodic_task [None req-3297f595-328e-43e0-9d33-0e299b902be6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75246) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:00:25 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:00:30 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:00:35 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:00:40 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:00:45 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:00:50 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:00:55 user nova-compute[75246]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75246) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}